[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:16.084703  7578 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.102.190:43427
I20260709 12:08:16.086824  7578 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:16.087980  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.107661  7587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.107683  7585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.110486  7578 server_base.cc:1061] running on GCE node
W20260709 12:08:16.107686  7584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.327808  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.328081  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.328358  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598897328314 us; error 0 us; skew 500 ppm
I20260709 12:08:17.329370  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.335507  7578 webserver.cc:533] Webserver started at http://127.7.102.190:35933/ using document root <none> and password file <none>
I20260709 12:08:17.336500  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.336798  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.337327  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.343463  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/master-0-root/instance:
uuid: "82aa833414284dfe9655e8091501eebd"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:17.352258  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:08:17.358134  7593 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.359607  7578 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:17.360076  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/master-0-root
uuid: "82aa833414284dfe9655e8091501eebd"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:17.360483  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.431326  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.433192  7578 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:17.433736  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.516242  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.190:43427
I20260709 12:08:17.516394  7644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.190:43427 every 8 connection(s)
I20260709 12:08:17.525694  7645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.550685  7645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: Bootstrap starting.
I20260709 12:08:17.557996  7645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.560222  7645 log.cc:826] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:17.565950  7645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: No bootstrap required, opened a new log
I20260709 12:08:17.588827  7645 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER }
I20260709 12:08:17.589536  7645 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.589844  7645 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82aa833414284dfe9655e8091501eebd, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.590946  7645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER }
I20260709 12:08:17.591508  7645 raft_consensus.cc:399] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:17.591881  7645 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:17.592268  7645 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.597823  7645 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER }
I20260709 12:08:17.598724  7645 leader_election.cc:304] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82aa833414284dfe9655e8091501eebd; no voters: 
I20260709 12:08:17.600986  7645 leader_election.cc:290] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:17.601534  7648 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.604782  7648 raft_consensus.cc:697] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 1 LEADER]: Becoming Leader. State: Replica: 82aa833414284dfe9655e8091501eebd, State: Running, Role: LEADER
I20260709 12:08:17.605985  7648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER }
I20260709 12:08:17.607081  7645 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:17.621011  7650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82aa833414284dfe9655e8091501eebd. Latest consensus state: current_term: 1 leader_uuid: "82aa833414284dfe9655e8091501eebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER } }
I20260709 12:08:17.622002  7650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.624042  7649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82aa833414284dfe9655e8091501eebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82aa833414284dfe9655e8091501eebd" member_type: VOTER } }
I20260709 12:08:17.625097  7658 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:17.624788  7649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.640012  7658 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:17.642817  7578 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:17.660615  7658 catalog_manager.cc:1383] Generated new cluster ID: 8c4ef9d101ea40e58cc2f9fb1750199f
I20260709 12:08:17.661001  7658 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:17.685863  7658 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:17.688408  7658 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:17.707677  7658 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: Generated new TSK 0
I20260709 12:08:17.709221  7658 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:17.775007  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.786545  7667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.789255  7668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.792073  7670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.792755  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:17.793602  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.793845  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.794026  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598897794001 us; error 0 us; skew 500 ppm
I20260709 12:08:17.794663  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.799691  7578 webserver.cc:533] Webserver started at http://127.7.102.129:40251/ using document root <none> and password file <none>
I20260709 12:08:17.800357  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.800597  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.800990  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.802289  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-0-root/instance:
uuid: "03f71d127907411e842387a41607118f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:17.808611  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:17.813651  7675 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.814728  7578 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:08:17.815196  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
uuid: "03f71d127907411e842387a41607118f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:17.815634  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.837790  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.839699  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.842857  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.849026  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.849387  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.849717  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.849958  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.951131  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.129:42147
I20260709 12:08:17.951225  7737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.129:42147 every 8 connection(s)
I20260709 12:08:17.959751  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.972746  7742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.973806  7743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.981684  7745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.982983  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:17.984059  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.984352  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.984577  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598897984561 us; error 0 us; skew 500 ppm
I20260709 12:08:17.985420  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.988746  7578 webserver.cc:533] Webserver started at http://127.7.102.130:34473/ using document root <none> and password file <none>
I20260709 12:08:17.989462  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.989708  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.990036  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.991573  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-1-root/instance:
uuid: "57412b795ed945618ddd4155e5ad4c2f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:17.992795  7738 heartbeater.cc:344] Connected to a master server at 127.7.102.190:43427
I20260709 12:08:17.993309  7738 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.994352  7738 heartbeater.cc:507] Master 127.7.102.190:43427 requested a full tablet report, sending...
I20260709 12:08:17.997932  7610 ts_manager.cc:194] Registered new tserver with Master: 03f71d127907411e842387a41607118f (127.7.102.129:42147)
I20260709 12:08:17.999385  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
I20260709 12:08:18.001132  7610 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49428
I20260709 12:08:18.005453  7750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.006502  7578 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:08:18.006913  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
uuid: "57412b795ed945618ddd4155e5ad4c2f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-p7fg"
I20260709 12:08:18.007283  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:18.038069  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:18.039812  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:18.042608  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:18.046522  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:18.046810  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.047097  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:18.047314  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.141239  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.130:39065
I20260709 12:08:18.141948  7812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.130:39065 every 8 connection(s)
I20260709 12:08:18.149101  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:18.160827  7816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:18.163045  7817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:18.164224  7813 heartbeater.cc:344] Connected to a master server at 127.7.102.190:43427
I20260709 12:08:18.164691  7813 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:18.165966  7813 heartbeater.cc:507] Master 127.7.102.190:43427 requested a full tablet report, sending...
I20260709 12:08:18.169646  7610 ts_manager.cc:194] Registered new tserver with Master: 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:18.172494  7610 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49430
W20260709 12:08:18.174700  7819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:18.176419  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:18.177649  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:18.177927  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:18.178145  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598898178127 us; error 0 us; skew 500 ppm
I20260709 12:08:18.178866  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:18.181968  7578 webserver.cc:533] Webserver started at http://127.7.102.131:37281/ using document root <none> and password file <none>
I20260709 12:08:18.182606  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:18.182850  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:18.183176  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:18.184651  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-2-root/instance:
uuid: "ff00be387137467ebb737d994c784c67"
format_stamp: "Formatted at 2026-07-09 12:08:18 on dist-test-slave-p7fg"
I20260709 12:08:18.190837  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:18.195500  7824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.196549  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:18.196981  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
uuid: "ff00be387137467ebb737d994c784c67"
format_stamp: "Formatted at 2026-07-09 12:08:18 on dist-test-slave-p7fg"
I20260709 12:08:18.197355  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895902579-7578-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:18.223783  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:18.225451  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:18.227173  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:18.230141  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:18.230432  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.230726  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:18.230945  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:18.324508  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.131:34083
I20260709 12:08:18.324685  7886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.131:34083 every 8 connection(s)
I20260709 12:08:18.345486  7887 heartbeater.cc:344] Connected to a master server at 127.7.102.190:43427
I20260709 12:08:18.345978  7887 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:18.346891  7887 heartbeater.cc:507] Master 127.7.102.190:43427 requested a full tablet report, sending...
I20260709 12:08:18.349273  7610 ts_manager.cc:194] Registered new tserver with Master: ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:18.349772  7578 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01880717s
I20260709 12:08:18.350800  7610 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49434
I20260709 12:08:18.410902  7610 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49444:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:18.415187  7610 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:18.515352  7851 tablet_service.cc:1511] Processing CreateTablet for tablet 2673e303fa6c42d7afb3133ea9b86cb7 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.520026  7852 tablet_service.cc:1511] Processing CreateTablet for tablet 427225faabae4b349846654317040db1 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.518332  7850 tablet_service.cc:1511] Processing CreateTablet for tablet 8b97f8da885d431fa8be060043b1b36a (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.523273  7851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673e303fa6c42d7afb3133ea9b86cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.522482  7849 tablet_service.cc:1511] Processing CreateTablet for tablet 0e14fed6789b417e9ebe9f3ca403408d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.526818  7852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427225faabae4b349846654317040db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.530303  7850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b97f8da885d431fa8be060043b1b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.531883  7849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e14fed6789b417e9ebe9f3ca403408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.530344  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 796ae31a3be64d898b7302134dc6f9eb (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.534818  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ae31a3be64d898b7302134dc6f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.548158  7847 tablet_service.cc:1511] Processing CreateTablet for tablet 38dab0f36df44548a211997bbd000ed8 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.551272  7847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dab0f36df44548a211997bbd000ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.573076  7701 tablet_service.cc:1511] Processing CreateTablet for tablet 8b97f8da885d431fa8be060043b1b36a (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.562842  7846 tablet_service.cc:1511] Processing CreateTablet for tablet e7ce6cf147bc494096bc35aecd245ac0 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.587932  7702 tablet_service.cc:1511] Processing CreateTablet for tablet 2673e303fa6c42d7afb3133ea9b86cb7 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.577883  7700 tablet_service.cc:1511] Processing CreateTablet for tablet 0e14fed6789b417e9ebe9f3ca403408d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.593174  7701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b97f8da885d431fa8be060043b1b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.596081  7846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ce6cf147bc494096bc35aecd245ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.596827  7697 tablet_service.cc:1511] Processing CreateTablet for tablet e7ce6cf147bc494096bc35aecd245ac0 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.604871  7702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673e303fa6c42d7afb3133ea9b86cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.602219  7699 tablet_service.cc:1511] Processing CreateTablet for tablet 796ae31a3be64d898b7302134dc6f9eb (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.587973  7845 tablet_service.cc:1511] Processing CreateTablet for tablet 41ccd15440794c309dc6a39ee7774835 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.585753  7703 tablet_service.cc:1511] Processing CreateTablet for tablet 427225faabae4b349846654317040db1 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.608294  7696 tablet_service.cc:1511] Processing CreateTablet for tablet 41ccd15440794c309dc6a39ee7774835 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.609778  7698 tablet_service.cc:1511] Processing CreateTablet for tablet 38dab0f36df44548a211997bbd000ed8 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.614406  7845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccd15440794c309dc6a39ee7774835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.615226  7700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e14fed6789b417e9ebe9f3ca403408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.626482  7697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ce6cf147bc494096bc35aecd245ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.627959  7695 tablet_service.cc:1511] Processing CreateTablet for tablet f9f46a92817141f58809b70d764d190d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:08:18.638134  7657 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.645166  7698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dab0f36df44548a211997bbd000ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.647409  7696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccd15440794c309dc6a39ee7774835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.653338  7703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427225faabae4b349846654317040db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.656718  7695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f46a92817141f58809b70d764d190d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.659057  7699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ae31a3be64d898b7302134dc6f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.682838  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 2673e303fa6c42d7afb3133ea9b86cb7 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.693702  7773 tablet_service.cc:1511] Processing CreateTablet for tablet 38dab0f36df44548a211997bbd000ed8 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.695514  7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dab0f36df44548a211997bbd000ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.700673  7904 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:18.704936  7771 tablet_service.cc:1511] Processing CreateTablet for tablet 41ccd15440794c309dc6a39ee7774835 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.706743  7778 tablet_service.cc:1511] Processing CreateTablet for tablet 427225faabae4b349846654317040db1 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.699563  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 8b97f8da885d431fa8be060043b1b36a (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.701848  7772 tablet_service.cc:1511] Processing CreateTablet for tablet e7ce6cf147bc494096bc35aecd245ac0 (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.685801  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 0e14fed6789b417e9ebe9f3ca403408d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.716794  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 796ae31a3be64d898b7302134dc6f9eb (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.718297  7770 tablet_service.cc:1511] Processing CreateTablet for tablet f9f46a92817141f58809b70d764d190d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.737655  7844 tablet_service.cc:1511] Processing CreateTablet for tablet f9f46a92817141f58809b70d764d190d (DEFAULT_TABLE table=test-workload [id=4020728ea60c4d98a7938cb4213d5e85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.740733  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f46a92817141f58809b70d764d190d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.748301  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673e303fa6c42d7afb3133ea9b86cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.761534  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b97f8da885d431fa8be060043b1b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.773198  7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccd15440794c309dc6a39ee7774835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.775336  7772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ce6cf147bc494096bc35aecd245ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.778172  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e14fed6789b417e9ebe9f3ca403408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.788146  7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f46a92817141f58809b70d764d190d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.795200  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ae31a3be64d898b7302134dc6f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.813725  7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427225faabae4b349846654317040db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.876400  7905 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:18.877985  7904 tablet_bootstrap.cc:654] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.907727  7906 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:18.944345  7904 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:18.944866  7904 ts_tablet_manager.cc:1403] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.267s	user 0.020s	sys 0.007s
I20260709 12:08:18.946825  7905 tablet_bootstrap.cc:654] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.949388  7904 raft_consensus.cc:359] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.950196  7904 raft_consensus.cc:385] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.950510  7904 raft_consensus.cc:740] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.951606  7904 consensus_queue.cc:260] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.957993  7906 tablet_bootstrap.cc:654] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.967687  7887 heartbeater.cc:499] Master 127.7.102.190:43427 was elected leader, sending a full tablet report...
I20260709 12:08:18.968118  7904 ts_tablet_manager.cc:1434] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:08:18.968894  7905 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:18.969267  7904 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:18.969650  7905 ts_tablet_manager.cc:1403] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.004s
I20260709 12:08:18.973162  7905 raft_consensus.cc:359] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.974376  7905 raft_consensus.cc:385] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.974849  7905 raft_consensus.cc:740] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.976030  7905 consensus_queue.cc:260] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.978374  7904 tablet_bootstrap.cc:654] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.990510  7904 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:18.991032  7904 ts_tablet_manager.cc:1403] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:08:18.992094  7906 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:18.992822  7906 ts_tablet_manager.cc:1403] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.012s
I20260709 12:08:18.994335  7904 raft_consensus.cc:359] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.995139  7904 raft_consensus.cc:385] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.995452  7904 raft_consensus.cc:740] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.996285  7904 consensus_queue.cc:260] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.997152  7906 raft_consensus.cc:359] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:18.998208  7906 raft_consensus.cc:385] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.998615  7906 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.999271  7904 ts_tablet_manager.cc:1434] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:08:18.999835  7906 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.000923  7904 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.005878  7738 heartbeater.cc:499] Master 127.7.102.190:43427 was elected leader, sending a full tablet report...
I20260709 12:08:19.010319  7906 ts_tablet_manager.cc:1434] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 12:08:19.010818  7904 tablet_bootstrap.cc:654] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.011159  7813 heartbeater.cc:499] Master 127.7.102.190:43427 was elected leader, sending a full tablet report...
I20260709 12:08:19.011492  7906 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.017704  7905 ts_tablet_manager.cc:1434] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.025s
I20260709 12:08:19.019114  7905 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.026979  7905 tablet_bootstrap.cc:654] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.028868  7906 tablet_bootstrap.cc:654] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.040755  7905 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.041689  7905 ts_tablet_manager.cc:1403] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 12:08:19.045092  7904 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.045677  7904 ts_tablet_manager.cc:1403] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.017s
I20260709 12:08:19.047371  7905 raft_consensus.cc:359] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.048336  7905 raft_consensus.cc:385] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.048712  7905 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.049660  7906 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.049151  7904 raft_consensus.cc:359] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.050117  7904 raft_consensus.cc:385] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.050216  7906 ts_tablet_manager.cc:1403] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.019s
I20260709 12:08:19.049556  7905 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.056237  7905 ts_tablet_manager.cc:1434] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:19.050498  7904 raft_consensus.cc:740] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.053544  7906 raft_consensus.cc:359] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.056915  7906 raft_consensus.cc:385] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.057266  7906 raft_consensus.cc:740] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.057227  7904 consensus_queue.cc:260] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.058274  7906 consensus_queue.cc:260] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.060822  7906 ts_tablet_manager.cc:1434] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:08:19.061856  7906 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.067056  7905 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.071820  7906 tablet_bootstrap.cc:654] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.073508  7904 ts_tablet_manager.cc:1434] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:08:19.074762  7904 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.079473  7905 tablet_bootstrap.cc:654] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.082548  7904 tablet_bootstrap.cc:654] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:19.083804  7888 tablet.cc:2406] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:19.093928  7906 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.094386  7906 ts_tablet_manager.cc:1403] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.005s
I20260709 12:08:19.096203  7904 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.096755  7904 ts_tablet_manager.cc:1403] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:08:19.097755  7906 raft_consensus.cc:359] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.098539  7906 raft_consensus.cc:385] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.098855  7906 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.099808  7904 raft_consensus.cc:359] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.099761  7906 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.100528  7904 raft_consensus.cc:385] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.100876  7904 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.101637  7904 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.102522  7906 ts_tablet_manager.cc:1434] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:08:19.103050  7905 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.103591  7906 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.103559  7905 ts_tablet_manager.cc:1403] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.001s
I20260709 12:08:19.103878  7904 ts_tablet_manager.cc:1434] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:19.104919  7904 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.106972  7905 raft_consensus.cc:359] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.107764  7905 raft_consensus.cc:385] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.108057  7905 raft_consensus.cc:740] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.108906  7905 consensus_queue.cc:260] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.111502  7905 ts_tablet_manager.cc:1434] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:19.112293  7904 tablet_bootstrap.cc:654] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.112551  7905 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.112890  7906 tablet_bootstrap.cc:654] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.121623  7905 tablet_bootstrap.cc:654] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.134757  7913 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.135170  7904 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.135921  7904 ts_tablet_manager.cc:1403] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:08:19.135406  7913 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.138960  7905 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.139223  7906 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.139443  7905 ts_tablet_manager.cc:1403] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 12:08:19.139731  7906 ts_tablet_manager.cc:1403] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.010s
I20260709 12:08:19.143002  7905 raft_consensus.cc:359] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.143944  7905 raft_consensus.cc:385] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.144296  7905 raft_consensus.cc:740] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.145337  7905 consensus_queue.cc:260] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.147541  7906 raft_consensus.cc:359] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.148330  7906 raft_consensus.cc:385] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.148612  7906 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.149394  7906 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.158466  7905 ts_tablet_manager.cc:1434] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:08:19.159490  7913 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.167254  7905 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.175572  7905 tablet_bootstrap.cc:654] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.177759  7904 raft_consensus.cc:359] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.181653  7904 raft_consensus.cc:385] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.184345  7904 raft_consensus.cc:740] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.186839  7904 consensus_queue.cc:260] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.187530  7905 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.198582  7905 ts_tablet_manager.cc:1403] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.005s
I20260709 12:08:19.201457  7911 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.202032  7905 raft_consensus.cc:359] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.202034  7911 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.203019  7905 raft_consensus.cc:385] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.203351  7905 raft_consensus.cc:740] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.204290  7905 consensus_queue.cc:260] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.195087  7906 ts_tablet_manager.cc:1434] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.055s	user 0.018s	sys 0.033s
I20260709 12:08:19.206674  7906 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.207608  7911 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.213034  7904 ts_tablet_manager.cc:1434] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 12:08:19.214080  7904 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.221648  7908 raft_consensus.cc:493] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.222190  7908 raft_consensus.cc:515] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.227598  7908 leader_election.cc:290] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.241380  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.244045  7904 tablet_bootstrap.cc:654] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.244192  7713 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 0.
I20260709 12:08:19.255712  7751 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:19.258035  7926 raft_consensus.cc:2804] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.258857  7926 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.259223  7926 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.267508  7905 ts_tablet_manager.cc:1434] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.069s	user 0.024s	sys 0.018s
I20260709 12:08:19.278956  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.282759  7905 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: Bootstrap starting.
W20260709 12:08:19.286645  7754 leader_election.cc:343] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff00be387137467ebb737d994c784c67 (127.7.102.131:34083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.288797  7908 raft_consensus.cc:493] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.290781  7908 raft_consensus.cc:515] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.327943  7908 leader_election.cc:290] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.333910  7913 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.334434  7913 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.329562  7926 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.338828  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.342768  7788 raft_consensus.cc:2393] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03f71d127907411e842387a41607118f in current term 1: Already voted for candidate 57412b795ed945618ddd4155e5ad4c2f in this term.
I20260709 12:08:19.347189  7913 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 03f71d127907411e842387a41607118f (127.7.102.129:42147)
I20260709 12:08:19.347738  7913 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.348169  7913 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.349546  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.350157  7862 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 0.
I20260709 12:08:19.352511  7754 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.353731  7905 tablet_bootstrap.cc:654] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.379753  7904 tablet_bootstrap.cc:492] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.354072  7913 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.380528  7904 ts_tablet_manager.cc:1403] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.033s
I20260709 12:08:19.381017  7908 raft_consensus.cc:493] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.381536  7908 raft_consensus.cc:515] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.360188  7906 tablet_bootstrap.cc:654] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.360322  7926 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.383770  7908 leader_election.cc:290] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.384372  7913 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.384871  7913 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.385273  7913 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.387835  7904 raft_consensus.cc:359] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.388666  7904 raft_consensus.cc:385] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.388974  7904 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.389763  7904 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.390295  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.390998  7713 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 0.
I20260709 12:08:19.392222  7904 ts_tablet_manager.cc:1434] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:08:19.392016  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:19.392961  7861 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.354612  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.393044  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.402228  7904 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.400966  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.401190  7713 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 0.
W20260709 12:08:19.411475  7754 leader_election.cc:343] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff00be387137467ebb737d994c784c67 (127.7.102.131:34083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.413249  7913 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.416203  7913 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Requested vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 03f71d127907411e842387a41607118f (127.7.102.129:42147)
I20260709 12:08:19.416402  7861 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 1.
I20260709 12:08:19.419922  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:19.420481  7754 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.420969  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:19.421602  7713 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.421950  7940 raft_consensus.cc:2804] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.422017  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.422858  7940 raft_consensus.cc:697] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:19.423856  7940 consensus_queue.cc:237] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.425170  7825 leader_election.cc:304] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.424960  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.425834  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.426074  7862 raft_consensus.cc:2393] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03f71d127907411e842387a41607118f in current term 1: Already voted for candidate 57412b795ed945618ddd4155e5ad4c2f in this term.
I20260709 12:08:19.420971  7860 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.428138  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:19.428649  7905 tablet_bootstrap.cc:492] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.429853  7905 ts_tablet_manager.cc:1403] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.152s	user 0.008s	sys 0.017s
I20260709 12:08:19.432204  7906 tablet_bootstrap.cc:492] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
W20260709 12:08:19.434145  7751 leader_election.cc:343] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:19.435727  7825 leader_election.cc:343] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.435917  7908 raft_consensus.cc:2804] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.436012  7906 ts_tablet_manager.cc:1403] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.230s	user 0.021s	sys 0.027s
I20260709 12:08:19.436406  7908 raft_consensus.cc:493] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.436448  7825 leader_election.cc:304] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.437587  7908 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.435165  7751 leader_election.cc:343] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.439920  7751 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f; no voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.440622  7713 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 1.
I20260709 12:08:19.442773  7913 raft_consensus.cc:2749] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:19.442200  7751 leader_election.cc:343] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.448211  7860 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 1.
I20260709 12:08:19.450337  7904 tablet_bootstrap.cc:654] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.450464  7679 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03f71d127907411e842387a41607118f; no voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.450074  7941 raft_consensus.cc:2804] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.453892  7913 raft_consensus.cc:493] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.453871  7929 raft_consensus.cc:2749] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.456403  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.455463  7913 raft_consensus.cc:515] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.458344  7754 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 03f71d127907411e842387a41607118f
I20260709 12:08:19.459069  7913 leader_election.cc:290] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.459652  7913 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.460135  7913 raft_consensus.cc:697] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:19.459656  7906 raft_consensus.cc:359] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.461009  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.461506  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.462954  7929 raft_consensus.cc:493] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.454567  7941 raft_consensus.cc:493] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.463397  7929 raft_consensus.cc:515] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.460913  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.461510  7906 raft_consensus.cc:385] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:19.468910  7825 leader_election.cc:343] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.469574  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.467407  7941 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.471107  7825 leader_election.cc:343] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.471280  7929 leader_election.cc:290] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.472323  7825 leader_election.cc:304] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff00be387137467ebb737d994c784c67; no voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.472472  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
W20260709 12:08:19.471536  7751 leader_election.cc:343] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:19.475253  7676 leader_election.cc:343] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.469265  7906 raft_consensus.cc:740] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.477329  7906 consensus_queue.cc:260] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
W20260709 12:08:19.477939  7754 leader_election.cc:343] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff00be387137467ebb737d994c784c67 (127.7.102.131:34083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.478389  7754 leader_election.cc:304] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f; no voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.478427  7787 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 0.
I20260709 12:08:19.479332  7940 raft_consensus.cc:2749] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.480023  7905 raft_consensus.cc:359] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.465865  7908 raft_consensus.cc:515] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.468524  7913 consensus_queue.cc:237] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.484573  7906 ts_tablet_manager.cc:1434] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.004s
I20260709 12:08:19.483985  7905 raft_consensus.cc:385] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.487823  7905 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.486351  7608 catalog_manager.cc:5697] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 1 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.493420  7905 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.493979  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.495285  7860 raft_consensus.cc:2468] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 0.
I20260709 12:08:19.498260  7905 ts_tablet_manager.cc:1434] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.002s
I20260709 12:08:19.497293  7943 raft_consensus.cc:2749] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.499531  7905 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.500278  7906 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.502228  7679 leader_election.cc:304] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.503532  7929 raft_consensus.cc:2804] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.503911  7929 raft_consensus.cc:493] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.504338  7929 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.508387  7908 leader_election.cc:290] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.507074  7941 raft_consensus.cc:515] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.517257  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:19.518491  7904 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.522281  7713 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.525041  7904 ts_tablet_manager.cc:1403] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.013s
I20260709 12:08:19.525031  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
W20260709 12:08:19.527880  7825 leader_election.cc:343] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.529119  7941 leader_election.cc:290] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.530018  7904 raft_consensus.cc:359] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.530903  7904 raft_consensus.cc:385] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.530939  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:19.531421  7904 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.531697  7712 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.532244  7904 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.535387  7929 raft_consensus.cc:515] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.538729  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:19.539635  7787 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.542958  7904 ts_tablet_manager.cc:1434] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 12:08:19.544796  7904 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.547772  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:19.546047  7929 leader_election.cc:290] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.551051  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:19.551704  7860 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.553469  7676 leader_election.cc:343] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.549657  7905 tablet_bootstrap.cc:654] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.559574  7906 tablet_bootstrap.cc:654] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.561154  7713 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 1.
I20260709 12:08:19.562252  7825 leader_election.cc:304] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.563093  7712 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 1.
I20260709 12:08:19.563689  7941 raft_consensus.cc:2804] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.563786  7860 raft_consensus.cc:2468] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 1.
I20260709 12:08:19.564265  7941 raft_consensus.cc:697] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:19.564601  7787 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 1.
I20260709 12:08:19.565733  7904 tablet_bootstrap.cc:654] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.565182  7941 consensus_queue.cc:237] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.566682  7679 leader_election.cc:304] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.566747  7825 leader_election.cc:304] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.567713  7908 raft_consensus.cc:2804] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.567679  7929 raft_consensus.cc:2804] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.568338  7908 raft_consensus.cc:697] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:19.569299  7908 consensus_queue.cc:237] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.568390  7929 raft_consensus.cc:697] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:19.573797  7929 consensus_queue.cc:237] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.584890  7904 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.587167  7906 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.592031  7906 ts_tablet_manager.cc:1403] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.007s
I20260709 12:08:19.589573  7904 ts_tablet_manager.cc:1403] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.001s
I20260709 12:08:19.595574  7906 raft_consensus.cc:359] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.596367  7906 raft_consensus.cc:385] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.596689  7906 raft_consensus.cc:740] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.597463  7906 consensus_queue.cc:260] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.598884  7904 raft_consensus.cc:359] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.599992  7904 raft_consensus.cc:385] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.600385  7904 raft_consensus.cc:740] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.601547  7904 consensus_queue.cc:260] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.604733  7905 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.606483  7904 ts_tablet_manager.cc:1434] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:08:19.605461  7905 ts_tablet_manager.cc:1403] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.013s
I20260709 12:08:19.615900  7929 raft_consensus.cc:493] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.616787  7904 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: Bootstrap starting.
I20260709 12:08:19.616616  7929 raft_consensus.cc:515] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.619341  7929 leader_election.cc:290] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.621105  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
W20260709 12:08:19.632334  7676 leader_election.cc:343] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.632426  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.633167  7860 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 0.
I20260709 12:08:19.633921  7610 catalog_manager.cc:5697] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 1 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.635942  7679 leader_election.cc:304] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.638526  7929 raft_consensus.cc:2804] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.638664  7908 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.639037  7929 raft_consensus.cc:493] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.639489  7929 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.641171  7657 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:19.639118  7908 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.641227  7607 catalog_manager.cc:5697] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.643141  7908 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.645229  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
W20260709 12:08:19.646747  7825 leader_election.cc:343] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.643425  7607 catalog_manager.cc:5697] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.656065  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.656459  7906 ts_tablet_manager.cc:1434] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.004s
I20260709 12:08:19.656945  7788 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 0.
I20260709 12:08:19.657761  7906 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.658546  7825 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 03f71d127907411e842387a41607118f
I20260709 12:08:19.659927  7908 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.660291  7908 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.660660  7908 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.661348  7905 raft_consensus.cc:359] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.662158  7905 raft_consensus.cc:385] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.662443  7905 raft_consensus.cc:740] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.663236  7905 consensus_queue.cc:260] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.668378  7929 raft_consensus.cc:515] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.669885  7905 ts_tablet_manager.cc:1434] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.013s
I20260709 12:08:19.673010  7905 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.672812  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:19.673660  7908 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
W20260709 12:08:19.674333  7676 leader_election.cc:343] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.675777  7929 leader_election.cc:290] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.676486  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:19.677147  7860 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.677706  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:19.681036  7904 tablet_bootstrap.cc:654] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.681129  7905 tablet_bootstrap.cc:654] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.678004  7908 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.683900  7860 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 1.
I20260709 12:08:19.685621  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:19.691623  7788 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.686357  7825 leader_election.cc:343] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.699522  7905 tablet_bootstrap.cc:492] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.700531  7679 leader_election.cc:304] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:19.701745  7929 raft_consensus.cc:2804] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.702287  7929 raft_consensus.cc:697] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:19.702287  7788 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 1.
I20260709 12:08:19.703158  7929 consensus_queue.cc:237] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.703639  7825 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 03f71d127907411e842387a41607118f
I20260709 12:08:19.704731  7908 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.705178  7908 raft_consensus.cc:697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:19.705971  7908 consensus_queue.cc:237] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.687724  7906 tablet_bootstrap.cc:654] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.720343  7904 tablet_bootstrap.cc:492] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: No bootstrap required, opened a new log
I20260709 12:08:19.720839  7904 ts_tablet_manager.cc:1403] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.007s
I20260709 12:08:19.723479  7904 raft_consensus.cc:359] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.724417  7904 raft_consensus.cc:385] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.700150  7905 ts_tablet_manager.cc:1403] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 12:08:19.724774  7904 raft_consensus.cc:740] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.725533  7607 catalog_manager.cc:5697] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 1 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.723409  7610 catalog_manager.cc:5697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.726558  7904 consensus_queue.cc:260] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.731026  7904 ts_tablet_manager.cc:1434] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:08:19.728284  7905 raft_consensus.cc:359] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.733598  7905 raft_consensus.cc:385] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.733911  7905 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.734798  7905 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.735350  7906 tablet_bootstrap.cc:492] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.741634  7905 ts_tablet_manager.cc:1434] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:08:19.742311  7906 ts_tablet_manager.cc:1403] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.013s
I20260709 12:08:19.745092  7906 raft_consensus.cc:359] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.745759  7906 raft_consensus.cc:385] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.745958  7906 raft_consensus.cc:740] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.747090  7905 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: Bootstrap starting.
I20260709 12:08:19.750252  7906 consensus_queue.cc:260] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.752954  7906 ts_tablet_manager.cc:1434] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:08:19.753907  7906 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.754101  7609 catalog_manager.cc:5697] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 1 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.756815  7929 raft_consensus.cc:493] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.757305  7929 raft_consensus.cc:515] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.759536  7929 leader_election.cc:290] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.761633  7906 tablet_bootstrap.cc:654] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.761988  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.762633  7788 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 0.
I20260709 12:08:19.763681  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.764329  7860 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 0.
I20260709 12:08:19.765910  7679 leader_election.cc:304] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:19.771483  7929 raft_consensus.cc:2804] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.771917  7929 raft_consensus.cc:493] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.772254  7929 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.778050  7906 tablet_bootstrap.cc:492] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.778529  7906 ts_tablet_manager.cc:1403] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:08:19.779114  7929 raft_consensus.cc:515] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.780974  7906 raft_consensus.cc:359] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.781625  7906 raft_consensus.cc:385] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.781872  7906 raft_consensus.cc:740] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.782325  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:19.782884  7788 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.782550  7906 consensus_queue.cc:260] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.786000  7906 ts_tablet_manager.cc:1434] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:08:19.787123  7906 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: Bootstrap starting.
I20260709 12:08:19.789024  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:19.789636  7860 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.793232  7906 tablet_bootstrap.cc:654] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.793102  7911 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.793768  7911 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.796341  7911 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.797981  7788 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 1.
I20260709 12:08:19.798032  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.800989  7676 leader_election.cc:304] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:19.801487  7905 tablet_bootstrap.cc:654] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.801831  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.802369  7911 raft_consensus.cc:2804] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.801357  7860 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 1.
I20260709 12:08:19.804163  7788 raft_consensus.cc:2393] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03f71d127907411e842387a41607118f in current term 1: Already voted for candidate ff00be387137467ebb737d994c784c67 in this term.
I20260709 12:08:19.805295  7929 leader_election.cc:290] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.805647  7676 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03f71d127907411e842387a41607118f; no voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.806768  7929 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.814085  7911 raft_consensus.cc:697] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:19.812549  7929 raft_consensus.cc:2749] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.815349  7911 consensus_queue.cc:237] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.815896  7905 tablet_bootstrap.cc:492] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: No bootstrap required, opened a new log
I20260709 12:08:19.816365  7905 ts_tablet_manager.cc:1403] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.002s
I20260709 12:08:19.818914  7906 tablet_bootstrap.cc:492] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: No bootstrap required, opened a new log
I20260709 12:08:19.819506  7906 ts_tablet_manager.cc:1403] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.024s
I20260709 12:08:19.819847  7905 raft_consensus.cc:359] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.820865  7905 raft_consensus.cc:385] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.821220  7905 raft_consensus.cc:740] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.822121  7905 consensus_queue.cc:260] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.823221  7906 raft_consensus.cc:359] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.823951  7906 raft_consensus.cc:385] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.824268  7906 raft_consensus.cc:740] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.825234  7905 ts_tablet_manager.cc:1434] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:08:19.825191  7906 consensus_queue.cc:260] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.827687  7906 ts_tablet_manager.cc:1434] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:08:19.831559  7609 catalog_manager.cc:5697] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 1 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.893342  7913 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.907397  7926 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.928308  7913 raft_consensus.cc:493] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.928930  7913 raft_consensus.cc:515] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.930876  7913 leader_election.cc:290] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.931712  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.932154  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.933085  7860 raft_consensus.cc:2393] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57412b795ed945618ddd4155e5ad4c2f in current term 1: Already voted for candidate 03f71d127907411e842387a41607118f in this term.
I20260709 12:08:19.933933  7911 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.934239  7754 leader_election.cc:304] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f; no voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.934425  7911 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:19.934991  7913 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.936764  7911 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:19.938124  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.938519  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57412b795ed945618ddd4155e5ad4c2f" is_pre_election: true
I20260709 12:08:19.939092  7860 raft_consensus.cc:2393] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03f71d127907411e842387a41607118f in current term 1: Already voted for candidate 57412b795ed945618ddd4155e5ad4c2f in this term.
I20260709 12:08:19.940357  7679 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03f71d127907411e842387a41607118f; no voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.941269  7911 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.942333  7913 raft_consensus.cc:2749] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.948076  7788 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.948580  7941 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.952323  7911 raft_consensus.cc:2749] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.957451  7941 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.974283  7913 raft_consensus.cc:493] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.975095  7913 raft_consensus.cc:515] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:19.979676  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:19.984114  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:19.985045  7860 raft_consensus.cc:2393] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57412b795ed945618ddd4155e5ad4c2f in current term 1: Already voted for candidate 03f71d127907411e842387a41607118f in this term.
I20260709 12:08:19.985373  7913 leader_election.cc:290] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:19.986265  7754 leader_election.cc:304] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f; no voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67
I20260709 12:08:19.987056  7913 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.996007  7913 raft_consensus.cc:2749] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:20.038383  7913 raft_consensus.cc:493] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:20.039003  7913 raft_consensus.cc:515] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.041805  7913 leader_election.cc:290] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.042279  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f" is_pre_election: true
I20260709 12:08:20.042570  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67" is_pre_election: true
I20260709 12:08:20.043022  7712 raft_consensus.cc:2468] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 0.
I20260709 12:08:20.043289  7860 raft_consensus.cc:2468] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 0.
I20260709 12:08:20.044363  7751 leader_election.cc:304] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:20.045514  7913 raft_consensus.cc:2804] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:20.045948  7913 raft_consensus.cc:493] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:20.046293  7913 raft_consensus.cc:3060] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:20.053491  7913 raft_consensus.cc:515] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.055685  7913 leader_election.cc:290] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.056870  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:20.057314  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ae31a3be64d898b7302134dc6f9eb" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.057595  7712 raft_consensus.cc:3060] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:20.057893  7860 raft_consensus.cc:3060] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:20.065327  7860 raft_consensus.cc:2468] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 1.
I20260709 12:08:20.065327  7712 raft_consensus.cc:2468] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 1.
I20260709 12:08:20.067144  7754 leader_election.cc:304] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.067948  7913 raft_consensus.cc:2804] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:20.068547  7913 raft_consensus.cc:697] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.070192  7913 consensus_queue.cc:237] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.070703  7926 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.081854  7607 catalog_manager.cc:5697] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 1 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.084302  7926 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.102243  7941 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.116923  7943 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.125110  7911 consensus_queue.cc:1048] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.135576  7911 consensus_queue.cc:1048] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.156914  7943 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.158536  7929 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.195724  7929 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.201295  7941 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.260560  7911 consensus_queue.cc:1048] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.274096  7911 consensus_queue.cc:1048] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.330207  7787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:56866
I20260709 12:08:20.330982  7787 raft_consensus.cc:606] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:20.350966  7862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a"
dest_uuid: "ff00be387137467ebb737d994c784c67"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:48078
I20260709 12:08:20.351683  7862 raft_consensus.cc:606] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:20.358168  7787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:56866
I20260709 12:08:20.358803  7787 raft_consensus.cc:606] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:20.378612  7713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:08:20.379312  7713 raft_consensus.cc:606] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:20.385957  7862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0"
dest_uuid: "ff00be387137467ebb737d994c784c67"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:48078
I20260709 12:08:20.386597  7862 raft_consensus.cc:606] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:20.392172  7862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "ff00be387137467ebb737d994c784c67"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:48078
I20260709 12:08:20.392745  7862 raft_consensus.cc:606] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:20.398470  7713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9f46a92817141f58809b70d764d190d"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:08:20.399148  7713 raft_consensus.cc:606] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 LEADER]: Received request to transfer leadership to TS ff00be387137467ebb737d994c784c67
I20260709 12:08:20.407068  7913 raft_consensus.cc:993] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.407582  7926 raft_consensus.cc:1081] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.409543  7713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:08:20.410211  7713 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.410602  7713 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.417415  7713 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.419662  7713 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.420749  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:20.421309  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.421460  7787 raft_consensus.cc:3055] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.421934  7862 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.421897  7787 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.423089  7787 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.424697  7787 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.430042  7862 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.431697  7787 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.431649  7679 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.432734  7911 raft_consensus.cc:2804] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.433331  7911 raft_consensus.cc:697] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:20.434170  7911 consensus_queue.cc:237] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.442299  7607 catalog_manager.cc:5697] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f reported cstate change: term changed from 1 to 2, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 2 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.559655  7926 consensus_queue.cc:1048] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.574193  7926 consensus_queue.cc:1048] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.578434  7908 raft_consensus.cc:993] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.579038  7908 raft_consensus.cc:1081] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.586040  7787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:20.586645  7787 raft_consensus.cc:493] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.587064  7787 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.593968  7787 raft_consensus.cc:515] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.596092  7787 leader_election.cc:290] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.597198  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:20.597465  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.598019  7713 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.598067  7862 raft_consensus.cc:3055] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.598726  7862 raft_consensus.cc:740] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:20.599788  7862 consensus_queue.cc:260] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.601312  7862 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.606732  7713 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.608449  7751 leader_election.cc:304] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:20.609408  7862 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.609586  7926 raft_consensus.cc:2804] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.610211  7926 raft_consensus.cc:697] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.611027  7926 consensus_queue.cc:237] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.618778  7607 catalog_manager.cc:5697] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 1 to 2, leader changed from ff00be387137467ebb737d994c784c67 (127.7.102.131) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 2 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.638314  7943 raft_consensus.cc:993] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.638801  7941 raft_consensus.cc:1081] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.641016  7787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:20.641590  7787 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.641953  7787 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.648669  7787 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.651062  7787 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.652241  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.652935  7862 raft_consensus.cc:3055] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.653282  7862 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:20.654258  7862 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.655484  7862 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.656823  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:20.657505  7713 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.663600  7862 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.665023  7713 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.665105  7754 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.666035  7926 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.666584  7926 raft_consensus.cc:697] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.667389  7926 consensus_queue.cc:237] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.675264  7607 catalog_manager.cc:5697] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 1 to 2, leader changed from ff00be387137467ebb737d994c784c67 (127.7.102.131) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 2 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.716075  7940 raft_consensus.cc:993] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.716272  7929 raft_consensus.cc:993] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.716663  7940 raft_consensus.cc:1081] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.716723  7911 raft_consensus.cc:1081] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:20.718446  7713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:08:20.718524  7787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56846
I20260709 12:08:20.719060  7713 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.719141  7787 raft_consensus.cc:493] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.719437  7713 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.719578  7787 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.725239  7713 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:20.726951  7787 raft_consensus.cc:515] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.728093  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.728765  7862 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.729169  7787 leader_election.cc:290] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.731269  7712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:20.731878  7712 raft_consensus.cc:3055] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.732180  7712 raft_consensus.cc:740] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:20.733035  7712 consensus_queue.cc:260] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.734169  7712 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.736451  7713 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Requested vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:20.736748  7941 raft_consensus.cc:993] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.737155  7941 raft_consensus.cc:1081] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:20.741187  7712 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.742188  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.742900  7860 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.743639  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:20.744253  7788 raft_consensus.cc:3055] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.744596  7788 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.745496  7788 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:20.745922  7862 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.746845  7788 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.747251  7679 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.748585  7929 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.749114  7929 raft_consensus.cc:697] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:20.749177  7713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36466
I20260709 12:08:20.749620  7751 leader_election.cc:304] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:20.750119  7713 raft_consensus.cc:493] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.750177  7929 consensus_queue.cc:237] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:20.750705  7713 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.752357  7926 raft_consensus.cc:2804] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.753822  7926 raft_consensus.cc:697] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:20.754805  7926 consensus_queue.cc:237] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.761620  7713 raft_consensus.cc:515] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.762671  7607 catalog_manager.cc:5697] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f reported cstate change: term changed from 1 to 2, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 2 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.763857  7713 leader_election.cc:290] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:20.763970  7609 catalog_manager.cc:5697] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 1 to 2, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 2 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.766592  7860 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:20.766822  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:20.767452  7862 raft_consensus.cc:3055] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.767805  7862 raft_consensus.cc:740] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:20.768651  7862 consensus_queue.cc:260] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.769954  7862 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.776566  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:20.777240  7787 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.778852  7862 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.780320  7679 leader_election.cc:304] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.781188  7929 raft_consensus.cc:2804] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.781690  7929 raft_consensus.cc:697] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:20.782464  7929 consensus_queue.cc:237] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.784097  7787 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.786535  7788 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 2.
I20260709 12:08:20.791152  7609 catalog_manager.cc:5697] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f reported cstate change: term changed from 1 to 2, leader changed from ff00be387137467ebb737d994c784c67 (127.7.102.131) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 2 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.838759  7964 raft_consensus.cc:993] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: : Instructing follower ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:20.839310  7964 raft_consensus.cc:1081] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 LEADER]: Signalling peer ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:20.841429  7860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9f46a92817141f58809b70d764d190d"
dest_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:48062
I20260709 12:08:20.842195  7860 raft_consensus.cc:493] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.842640  7860 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.850782  7860 raft_consensus.cc:515] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.853108  7860 leader_election.cc:290] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 2 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:20.854249  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:20.854533  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f46a92817141f58809b70d764d190d" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:20.855054  7713 raft_consensus.cc:3055] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.855193  7788 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.855433  7713 raft_consensus.cc:740] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:20.856410  7713 consensus_queue.cc:260] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.857498  7713 raft_consensus.cc:3060] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.862449  7788 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 2.
I20260709 12:08:20.862668  7713 raft_consensus.cc:2468] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 2.
I20260709 12:08:20.864158  7825 leader_election.cc:304] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:20.865270  7943 raft_consensus.cc:2804] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.865767  7943 raft_consensus.cc:697] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 2 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:20.866781  7943 consensus_queue.cc:237] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:20.875219  7609 catalog_manager.cc:5697] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 1 to 2, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:20.927322  7788 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.928915  7964 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.939038  7860 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.940930  7929 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.052120  7713 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.053650  7926 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.057616  7712 raft_consensus.cc:1275] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.059795  7926 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.064023  7860 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.066283  7940 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.070834  7862 raft_consensus.cc:1275] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.072433  7940 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.133576  7788 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.135000  7929 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.146900  7862 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.148665  7911 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.199049  7712 raft_consensus.cc:1275] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.200465  7995 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.209745  7862 raft_consensus.cc:1275] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.211594  7940 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.312126  7862 raft_consensus.cc:1275] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.313736  7911 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.323729  7788 raft_consensus.cc:1275] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.325292  7911 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:21.354350  7788 raft_consensus.cc:1275] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.355675  7943 consensus_queue.cc:1048] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:21.367514  7712 raft_consensus.cc:1275] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.369612  8005 consensus_queue.cc:1048] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.432988  7578 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:23.433938  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.450685  7787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:23.451326  7787 raft_consensus.cc:606] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Received request to transfer leadership to TS ff00be387137467ebb737d994c784c67
I20260709 12:08:23.464373  7713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:60156
I20260709 12:08:23.464912  7713 raft_consensus.cc:606] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 LEADER]: Received request to transfer leadership to TS ff00be387137467ebb737d994c784c67
I20260709 12:08:23.466063  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:23.466668  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.586598  8016 raft_consensus.cc:993] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: : Instructing follower ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:23.587213  8002 raft_consensus.cc:1081] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 LEADER]: Signalling peer ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:23.588778  7860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:48062
I20260709 12:08:23.589231  7860 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.589498  7860 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.593992  7860 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:23.595750  7860 leader_election.cc:290] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:23.596819  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:23.596896  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:23.597313  7713 raft_consensus.cc:3055] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.597565  7787 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.597710  7713 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:23.598508  7713 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:23.599414  7713 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.603843  7787 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:23.604809  7713 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:23.605171  7825 leader_election.cc:304] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:23.605957  8011 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.607271  8011 raft_consensus.cc:697] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:23.608158  8011 consensus_queue.cc:237] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:23.618314  7610 catalog_manager.cc:5697] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 2 to 3, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:23.897914  8023 raft_consensus.cc:993] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:23.898425  8023 raft_consensus.cc:1081] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Signalling peer ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:23.900329  7860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:48052
I20260709 12:08:23.900964  7860 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.901397  7860 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.906858  7860 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:23.908687  7860 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:23.909555  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:23.910282  7713 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.910472  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:23.911136  7787 raft_consensus.cc:3055] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.911427  7787 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:23.912118  7787 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:23.913110  7787 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.916338  7713 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:23.917582  7825 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:23.918452  8011 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.918404  7787 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:23.919196  8011 raft_consensus.cc:697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:23.920081  8011 consensus_queue.cc:237] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:23.927196  7610 catalog_manager.cc:5697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 2 to 3, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:24.048112  7787 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.049453  8011 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.060218  7713 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.062160  8017 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.391558  7787 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.392861  8011 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.407181  7712 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.409844  8011 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.467615  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.473098  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.473511  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.474623  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.479406  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.479846  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.481184  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.487565  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.488059  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.489257  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.494366  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.494859  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.495908  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.500942  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.501405  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.831641  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.836687  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.837073  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:30.308082  7734 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6060 after lost signal to thread 7581
W20260709 12:08:30.308892  7734 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6740 after lost signal to thread 7644
W20260709 12:08:30.309729  7734 debug-util.cc:398] Leaking SignalData structure 0x7b0800116760 after lost signal to thread 7737
W20260709 12:08:30.310395  7734 debug-util.cc:398] Leaking SignalData structure 0x7b0800116fe0 after lost signal to thread 7812
W20260709 12:08:30.311028  7734 debug-util.cc:398] Leaking SignalData structure 0x7b0800188a60 after lost signal to thread 7886
I20260709 12:08:30.838158  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.846112  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.846696  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.847991  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.856673  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.857272  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.978760  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:32.983366  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:32.983700  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:33.039623  7883 debug-util.cc:398] Leaking SignalData structure 0x7b080016c060 after lost signal to thread 7581
W20260709 12:08:33.040505  7883 debug-util.cc:398] Leaking SignalData structure 0x7b080016c740 after lost signal to thread 7644
W20260709 12:08:33.041524  7883 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9f80 after lost signal to thread 7737
W20260709 12:08:33.042352  7883 debug-util.cc:398] Leaking SignalData structure 0x7b08001567e0 after lost signal to thread 7812
W20260709 12:08:33.043150  7883 debug-util.cc:398] Leaking SignalData structure 0x7b08001e55c0 after lost signal to thread 7886
I20260709 12:08:34.023515  7578 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:34.029369  7862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "ff00be387137467ebb737d994c784c67"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:48078
I20260709 12:08:34.030299  7862 raft_consensus.cc:606] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:34.036538  7711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:08:34.037274  7711 raft_consensus.cc:606] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:34.043221  7711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:08:34.043886  7711 raft_consensus.cc:606] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:34.049675  7711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "03f71d127907411e842387a41607118f"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:36480
I20260709 12:08:34.050319  7711 raft_consensus.cc:606] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:34.066735  7862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "ff00be387137467ebb737d994c784c67"
mode: GRACEFUL
new_leader_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:48078
I20260709 12:08:34.067389  7862 raft_consensus.cc:606] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Received request to transfer leadership to TS 57412b795ed945618ddd4155e5ad4c2f
I20260709 12:08:34.137347  8054 raft_consensus.cc:993] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.138135  8052 raft_consensus.cc:1081] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.140214  7788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56846
I20260709 12:08:34.140853  7788 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.141217  7788 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.146399  7788 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.149010  7788 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 3 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:34.149946  7711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:34.150336  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:34.150837  7711 raft_consensus.cc:3055] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.150966  7862 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.151279  7711 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:34.152269  7711 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.153667  7711 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.156374  7862 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 3.
I20260709 12:08:34.157990  7754 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:34.159063  8050 raft_consensus.cc:2804] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.160331  8050 raft_consensus.cc:697] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:34.161372  8050 consensus_queue.cc:237] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.164315  7711 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 3.
I20260709 12:08:34.174356  7610 catalog_manager.cc:5697] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 2 to 3, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 3 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.344199  8061 raft_consensus.cc:993] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.344936  8053 raft_consensus.cc:1081] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.346585  7788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:34.347122  7788 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.347396  7788 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.351922  7788 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:34.353502  7788 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 4 election: Requested vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 03f71d127907411e842387a41607118f (127.7.102.129:42147)
I20260709 12:08:34.355405  7711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:34.355320  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:34.356061  7711 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.356070  7862 raft_consensus.cc:3055] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:34.356798  7862 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:34.357698  7862 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:34.359174  7862 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.361675  7711 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 4.
I20260709 12:08:34.363265  7751 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, 57412b795ed945618ddd4155e5ad4c2f; no voters: 
I20260709 12:08:34.364167  8050 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:34.364734  8050 raft_consensus.cc:697] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:34.366142  7862 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 4.
I20260709 12:08:34.365957  8050 consensus_queue.cc:237] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:34.375353  7610 catalog_manager.cc:5697] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 3 to 4, leader changed from ff00be387137467ebb737d994c784c67 (127.7.102.131) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 4 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:34.377539  8061 raft_consensus.cc:993] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.378192  8061 raft_consensus.cc:1081] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.380143  7788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:34.380751  7788 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.381055  7788 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.387699  7788 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.389662  7788 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 4 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:34.391183  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:34.391347  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:34.391933  7713 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.391997  7862 raft_consensus.cc:3055] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:34.392520  7862 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:34.393631  7862 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.394441  7862 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.399552  7862 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 4.
I20260709 12:08:34.400941  7754 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:34.400918  7713 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 4.
I20260709 12:08:34.402347  8050 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:34.402850  8050 raft_consensus.cc:697] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:34.403935  8050 consensus_queue.cc:237] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.413992  7610 catalog_manager.cc:5697] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 3 to 4, leader changed from ff00be387137467ebb737d994c784c67 (127.7.102.131) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 4 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.470359  8054 raft_consensus.cc:993] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.474067  8052 raft_consensus.cc:1081] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.476253  7788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56846
I20260709 12:08:34.476971  7788 raft_consensus.cc:493] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.477347  7788 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.485492  7788 raft_consensus.cc:515] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.488310  7788 leader_election.cc:290] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 3 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:34.488746  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:34.489465  7713 raft_consensus.cc:3055] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.489777  7713 raft_consensus.cc:740] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:34.490206  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b97f8da885d431fa8be060043b1b36a" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:34.490881  7862 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.490573  7713 consensus_queue.cc:260] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.491894  7713 raft_consensus.cc:3060] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.498703  7862 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 3.
I20260709 12:08:34.499859  7713 raft_consensus.cc:2468] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 3.
I20260709 12:08:34.500048  7754 leader_election.cc:304] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:34.501745  8050 raft_consensus.cc:2804] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.502266  8050 raft_consensus.cc:697] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:34.503163  8050 consensus_queue.cc:237] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.514679  7610 catalog_manager.cc:5697] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 2 to 3, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 3 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.564778  7862 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.566138  8050 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:34.588415  7713 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.590607  8050 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:34.591913  8054 raft_consensus.cc:993] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: : Instructing follower 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.592540  8054 raft_consensus.cc:1081] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Signalling peer 57412b795ed945618ddd4155e5ad4c2f to start an election
I20260709 12:08:34.594725  7788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
 from {username='slave'} at 127.0.0.1:56846
I20260709 12:08:34.595276  7788 raft_consensus.cc:493] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.595628  7788 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:34.606050  7788 raft_consensus.cc:515] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.608889  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:34.609587  7713 raft_consensus.cc:3055] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:34.609974  7713 raft_consensus.cc:740] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:34.610605  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2673e303fa6c42d7afb3133ea9b86cb7" candidate_uuid: "57412b795ed945618ddd4155e5ad4c2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:34.611189  7862 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:34.610899  7713 consensus_queue.cc:260] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.619143  7788 leader_election.cc:290] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:34.620311  7713 raft_consensus.cc:3060] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:34.622458  7862 raft_consensus.cc:2468] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:34.623672  7754 leader_election.cc:304] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57412b795ed945618ddd4155e5ad4c2f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:34.624550  8050 raft_consensus.cc:2804] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:34.625100  8050 raft_consensus.cc:697] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Leader. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:34.626031  8050 consensus_queue.cc:237] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:34.629102  7713 raft_consensus.cc:2468] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57412b795ed945618ddd4155e5ad4c2f in term 2.
I20260709 12:08:34.636050  7610 catalog_manager.cc:5697] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f reported cstate change: term changed from 1 to 2, leader changed from 03f71d127907411e842387a41607118f (127.7.102.129) to 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130). New cstate: current_term: 2 leader_uuid: "57412b795ed945618ddd4155e5ad4c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.770051  7711 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.771700  8055 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.789935  7862 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.792835  8050 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.903383  7711 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.905040  8055 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.916355  7860 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.917928  8068 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.998575  7711 raft_consensus.cc:1275] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.000377  8055 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:35.012602  7860 raft_consensus.cc:1275] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.014055  8055 consensus_queue.cc:1048] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.111260  7862 raft_consensus.cc:1275] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:35.112926  8055 consensus_queue.cc:1048] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:35.123297  7711 raft_consensus.cc:1275] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Refusing update from remote peer 57412b795ed945618ddd4155e5ad4c2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:35.125335  8068 consensus_queue.cc:1048] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:37.107556  7578 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:37.108896  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.116664  7788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:37.117419  7788 raft_consensus.cc:606] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:37.120327  7788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:37.120846  7788 raft_consensus.cc:606] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Received request to transfer leadership to TS ff00be387137467ebb737d994c784c67
I20260709 12:08:37.123270  7788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:37.123685  7788 raft_consensus.cc:606] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Received request to transfer leadership to TS ff00be387137467ebb737d994c784c67
I20260709 12:08:37.125979  7788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:37.126368  7788 raft_consensus.cc:606] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:37.128585  7788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0"
dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
mode: GRACEFUL
new_leader_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:51130
I20260709 12:08:37.129052  7788 raft_consensus.cc:606] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Received request to transfer leadership to TS 03f71d127907411e842387a41607118f
I20260709 12:08:37.130210  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:37.130757  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.203498  8068 raft_consensus.cc:993] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:37.204080  8068 raft_consensus.cc:1081] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Signalling peer ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:37.205916  7862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8"
dest_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:48052
I20260709 12:08:37.206352  7862 raft_consensus.cc:493] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.206633  7862 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.212352  7862 raft_consensus.cc:515] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.215121  7862 leader_election.cc:290] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:37.216250  7711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:37.217134  7711 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.217103  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dab0f36df44548a211997bbd000ed8" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:37.217916  7788 raft_consensus.cc:3055] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:37.218291  7788 raft_consensus.cc:740] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:37.219089  7788 consensus_queue.cc:260] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.220084  7788 raft_consensus.cc:3060] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.223852  7711 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:37.225463  7825 leader_election.cc:304] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:37.226435  8061 raft_consensus.cc:2804] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:37.227021  7788 raft_consensus.cc:2468] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 3.
I20260709 12:08:37.227692  8061 raft_consensus.cc:697] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:37.228830  8061 consensus_queue.cc:237] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.236994  7609 catalog_manager.cc:5697] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 2 to 3, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:37.353638  8082 raft_consensus.cc:993] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.354192  8068 raft_consensus.cc:1081] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.355731  7711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:08:37.356323  7711 raft_consensus.cc:493] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.356628  7711 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.362298  7711 raft_consensus.cc:515] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.364919  7711 leader_election.cc:290] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 3 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:37.365856  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:37.366482  7788 raft_consensus.cc:3055] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:37.366297  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ce6cf147bc494096bc35aecd245ac0" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:37.366816  7788 raft_consensus.cc:740] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:37.367013  7862 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.367723  7788 consensus_queue.cc:260] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.368839  7788 raft_consensus.cc:3060] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.371927  7862 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 3.
I20260709 12:08:37.373274  7679 leader_election.cc:304] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:37.373615  7788 raft_consensus.cc:2468] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 3.
I20260709 12:08:37.375312  8089 raft_consensus.cc:2804] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:37.376716  8089 raft_consensus.cc:697] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 3 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:37.377828  8089 consensus_queue.cc:237] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.385264  7609 catalog_manager.cc:5697] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f reported cstate change: term changed from 2 to 3, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 3 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.417902  8082 raft_consensus.cc:993] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.418397  8068 raft_consensus.cc:1081] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.419931  7711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "427225faabae4b349846654317040db1"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:08:37.420423  7711 raft_consensus.cc:493] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.420774  7711 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.426348  7711 raft_consensus.cc:515] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:37.428292  7711 leader_election.cc:290] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 5 election: Requested vote from peers ff00be387137467ebb737d994c784c67 (127.7.102.131:34083), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:37.429168  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:37.429673  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427225faabae4b349846654317040db1" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:37.429857  7862 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.430272  7788 raft_consensus.cc:3055] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:37.430531  7788 raft_consensus.cc:740] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:37.431198  7788 consensus_queue.cc:260] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:37.432179  7788 raft_consensus.cc:3060] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.434643  7862 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 5.
I20260709 12:08:37.435720  7679 leader_election.cc:304] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:37.436607  8089 raft_consensus.cc:2804] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:37.437139  8089 raft_consensus.cc:697] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 5 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:37.438091  7788 raft_consensus.cc:2468] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 5.
I20260709 12:08:37.438046  8089 consensus_queue.cc:237] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } }
I20260709 12:08:37.446408  8082 raft_consensus.cc:993] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.446992  8068 raft_consensus.cc:1081] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Signalling peer 03f71d127907411e842387a41607118f to start an election
I20260709 12:08:37.446552  7609 catalog_manager.cc:5697] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f reported cstate change: term changed from 4 to 5, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 5 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.448477  7711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d"
dest_uuid: "03f71d127907411e842387a41607118f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:08:37.449095  7711 raft_consensus.cc:493] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.449473  7711 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.455433  7711 raft_consensus.cc:515] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.457226  7711 leader_election.cc:290] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 4 election: Requested vote from peers 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065), ff00be387137467ebb737d994c784c67 (127.7.102.131:34083)
I20260709 12:08:37.458077  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:37.458330  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e14fed6789b417e9ebe9f3ca403408d" candidate_uuid: "03f71d127907411e842387a41607118f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff00be387137467ebb737d994c784c67"
I20260709 12:08:37.458645  7788 raft_consensus.cc:3055] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:37.458859  7862 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.459007  7788 raft_consensus.cc:740] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:37.459854  7788 consensus_queue.cc:260] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.460896  7788 raft_consensus.cc:3060] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.463466  7862 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 4.
I20260709 12:08:37.464699  7679 leader_election.cc:304] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:37.465525  8089 raft_consensus.cc:2804] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:37.466069  8089 raft_consensus.cc:697] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 4 LEADER]: Becoming Leader. State: Replica: 03f71d127907411e842387a41607118f, State: Running, Role: LEADER
I20260709 12:08:37.466205  7788 raft_consensus.cc:2468] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f71d127907411e842387a41607118f in term 4.
I20260709 12:08:37.467085  8089 consensus_queue.cc:237] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.474483  7609 catalog_manager.cc:5697] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f reported cstate change: term changed from 3 to 4, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to 03f71d127907411e842387a41607118f (127.7.102.129). New cstate: current_term: 4 leader_uuid: "03f71d127907411e842387a41607118f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.593850  8082 raft_consensus.cc:993] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: : Instructing follower ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:37.594385  8082 raft_consensus.cc:1081] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Signalling peer ff00be387137467ebb737d994c784c67 to start an election
I20260709 12:08:37.596297  7862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835"
dest_uuid: "ff00be387137467ebb737d994c784c67"
 from {username='slave'} at 127.0.0.1:48052
I20260709 12:08:37.596951  7862 raft_consensus.cc:493] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.597298  7862 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.601708  7862 raft_consensus.cc:515] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.603781  7862 leader_election.cc:290] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 5 election: Requested vote from peers 03f71d127907411e842387a41607118f (127.7.102.129:42147), 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130:39065)
I20260709 12:08:37.604756  7711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "03f71d127907411e842387a41607118f"
I20260709 12:08:37.605365  7711 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.605484  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ccd15440794c309dc6a39ee7774835" candidate_uuid: "ff00be387137467ebb737d994c784c67" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "57412b795ed945618ddd4155e5ad4c2f"
I20260709 12:08:37.606143  7788 raft_consensus.cc:3055] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:37.606549  7788 raft_consensus.cc:740] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 57412b795ed945618ddd4155e5ad4c2f, State: Running, Role: LEADER
I20260709 12:08:37.607295  7788 consensus_queue.cc:260] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.608322  7788 raft_consensus.cc:3060] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.610446  7711 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 5.
I20260709 12:08:37.611636  7825 leader_election.cc:304] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f71d127907411e842387a41607118f, ff00be387137467ebb737d994c784c67; no voters: 
I20260709 12:08:37.612406  8061 raft_consensus.cc:2804] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:37.613035  8061 raft_consensus.cc:697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 5 LEADER]: Becoming Leader. State: Replica: ff00be387137467ebb737d994c784c67, State: Running, Role: LEADER
I20260709 12:08:37.614449  7788 raft_consensus.cc:2468] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff00be387137467ebb737d994c784c67 in term 5.
I20260709 12:08:37.614030  8061 consensus_queue.cc:237] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } }
I20260709 12:08:37.624439  7609 catalog_manager.cc:5697] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 reported cstate change: term changed from 4 to 5, leader changed from 57412b795ed945618ddd4155e5ad4c2f (127.7.102.130) to ff00be387137467ebb737d994c784c67 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "ff00be387137467ebb737d994c784c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:37.641530  7711 raft_consensus.cc:1275] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:37.643070  8061 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:37.654157  7788 raft_consensus.cc:1275] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:37.655952  8097 consensus_queue.cc:1048] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:37.883183  7862 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.884668  8089 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:37.895231  7788 raft_consensus.cc:1275] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.897495  8089 consensus_queue.cc:1048] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:37.909492  7788 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.910851  8089 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:37.924649  7862 raft_consensus.cc:1275] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:37.926008  7860 raft_consensus.cc:1275] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.926167  8089 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:37.928114  8090 consensus_queue.cc:1048] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff00be387137467ebb737d994c784c67" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 34083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:37.939730  7788 raft_consensus.cc:1275] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Refusing update from remote peer 03f71d127907411e842387a41607118f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:37.942566  8089 consensus_queue.cc:1048] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:38.114005  7788 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.115427  8061 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57412b795ed945618ddd4155e5ad4c2f" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.124924  7711 raft_consensus.cc:1275] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Refusing update from remote peer ff00be387137467ebb737d994c784c67: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.126533  8083 consensus_queue.cc:1048] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f71d127907411e842387a41607118f" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.132236  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.140946  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.141543  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.142702  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.148144  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.148561  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.149686  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.155417  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.155956  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.157275  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.162326  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.162854  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.163976  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.169059  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.169521  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.170691  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.175670  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.176132  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.177248  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.182070  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.182535  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.183660  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:45.189194  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:45.189680  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:46.209928  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:46.222368  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:46.222862  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:47.253954  7578 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:47.254654  7578 tablet_server.cc:179] TabletServer@127.7.102.129:0 shutting down...
I20260709 12:08:47.293229  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:47.294071  7578 tablet_replica.cc:333] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.295333  7578 raft_consensus.cc:2243] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.296321  7578 raft_consensus.cc:2272] T 796ae31a3be64d898b7302134dc6f9eb P 03f71d127907411e842387a41607118f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:47.298507  7825 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:08:47.299548  7578 tablet_replica.cc:333] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.300331  7578 raft_consensus.cc:2243] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.301097  7578 raft_consensus.cc:2272] T 41ccd15440794c309dc6a39ee7774835 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:47.303615  7825 consensus_peers.cc:597] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 -> Peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Couldn't send request to peer 03f71d127907411e842387a41607118f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.304308  7578 tablet_replica.cc:333] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.304939  7578 raft_consensus.cc:2243] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:08:47.305003  7751 consensus_peers.cc:597] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f -> Peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Couldn't send request to peer 03f71d127907411e842387a41607118f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.305481  7578 raft_consensus.cc:2272] T f9f46a92817141f58809b70d764d190d P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.307224  7578 tablet_replica.cc:333] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.307740  7578 raft_consensus.cc:2243] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.308562  7578 raft_consensus.cc:2272] T 427225faabae4b349846654317040db1 P 03f71d127907411e842387a41607118f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.310225  7578 tablet_replica.cc:333] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.310731  7578 raft_consensus.cc:2243] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.311168  7578 raft_consensus.cc:2272] T 8b97f8da885d431fa8be060043b1b36a P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.312915  7578 tablet_replica.cc:333] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.313412  7578 raft_consensus.cc:2243] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.313823  7578 raft_consensus.cc:2272] T 38dab0f36df44548a211997bbd000ed8 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.315375  7578 tablet_replica.cc:333] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.315871  7578 raft_consensus.cc:2243] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.316771  7578 raft_consensus.cc:2272] T 0e14fed6789b417e9ebe9f3ca403408d P 03f71d127907411e842387a41607118f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.318621  7578 tablet_replica.cc:333] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.319159  7578 raft_consensus.cc:2243] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.319933  7578 raft_consensus.cc:2272] T e7ce6cf147bc494096bc35aecd245ac0 P 03f71d127907411e842387a41607118f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.321550  7578 tablet_replica.cc:333] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f: stopping tablet replica
I20260709 12:08:47.322014  7578 raft_consensus.cc:2243] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.322431  7578 raft_consensus.cc:2272] T 2673e303fa6c42d7afb3133ea9b86cb7 P 03f71d127907411e842387a41607118f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:47.450143  7751 consensus_peers.cc:597] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f -> Peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Couldn't send request to peer 03f71d127907411e842387a41607118f. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:47.450143  7825 consensus_peers.cc:597] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 -> Peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Couldn't send request to peer 03f71d127907411e842387a41607118f. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.466280  7578 tablet_server.cc:196] TabletServer@127.7.102.129:0 shutdown complete.
I20260709 12:08:47.487268  7578 tablet_server.cc:179] TabletServer@127.7.102.130:0 shutting down...
I20260709 12:08:47.528542  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:47.529315  7578 tablet_replica.cc:333] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.529862  7578 raft_consensus.cc:2243] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.530669  7578 raft_consensus.cc:2272] T 2673e303fa6c42d7afb3133ea9b86cb7 P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.532384  7578 tablet_replica.cc:333] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.532950  7578 raft_consensus.cc:2243] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.533356  7578 raft_consensus.cc:2272] T 38dab0f36df44548a211997bbd000ed8 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.534962  7578 tablet_replica.cc:333] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.535408  7578 raft_consensus.cc:2243] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.535789  7578 raft_consensus.cc:2272] T 427225faabae4b349846654317040db1 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.537392  7578 tablet_replica.cc:333] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.537847  7578 raft_consensus.cc:2243] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.538192  7578 raft_consensus.cc:2272] T e7ce6cf147bc494096bc35aecd245ac0 P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.539754  7578 tablet_replica.cc:333] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.540186  7578 raft_consensus.cc:2243] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.540539  7578 raft_consensus.cc:2272] T 0e14fed6789b417e9ebe9f3ca403408d P 57412b795ed945618ddd4155e5ad4c2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.542155  7578 tablet_replica.cc:333] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.542584  7578 raft_consensus.cc:2243] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.543258  7578 raft_consensus.cc:2272] T 8b97f8da885d431fa8be060043b1b36a P 57412b795ed945618ddd4155e5ad4c2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.544902  7578 tablet_replica.cc:333] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.545351  7578 raft_consensus.cc:2243] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.546022  7578 raft_consensus.cc:2272] T 796ae31a3be64d898b7302134dc6f9eb P 57412b795ed945618ddd4155e5ad4c2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.547789  7578 tablet_replica.cc:333] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.548197  7578 raft_consensus.cc:2243] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.548566  7578 raft_consensus.cc:2272] T f9f46a92817141f58809b70d764d190d P 57412b795ed945618ddd4155e5ad4c2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.550175  7578 tablet_replica.cc:333] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f: stopping tablet replica
I20260709 12:08:47.550565  7578 raft_consensus.cc:2243] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.550933  7578 raft_consensus.cc:2272] T 41ccd15440794c309dc6a39ee7774835 P 57412b795ed945618ddd4155e5ad4c2f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.579929  7578 tablet_server.cc:196] TabletServer@127.7.102.130:0 shutdown complete.
I20260709 12:08:47.600554  7578 tablet_server.cc:179] TabletServer@127.7.102.131:0 shutting down...
W20260709 12:08:47.616845  7825 consensus_peers.cc:597] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 -> Peer 03f71d127907411e842387a41607118f (127.7.102.129:42147): Couldn't send request to peer 03f71d127907411e842387a41607118f. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:42147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:47.631384  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:47.632140  7578 tablet_replica.cc:333] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.632861  7578 raft_consensus.cc:2243] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.633703  7578 raft_consensus.cc:2272] T 38dab0f36df44548a211997bbd000ed8 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.635435  7578 tablet_replica.cc:333] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.635960  7578 raft_consensus.cc:2243] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.636394  7578 raft_consensus.cc:2272] T 8b97f8da885d431fa8be060043b1b36a P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.638160  7578 tablet_replica.cc:333] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.638648  7578 raft_consensus.cc:2243] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.639074  7578 raft_consensus.cc:2272] T 427225faabae4b349846654317040db1 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.640791  7578 tablet_replica.cc:333] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.641292  7578 raft_consensus.cc:2243] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.641693  7578 raft_consensus.cc:2272] T 2673e303fa6c42d7afb3133ea9b86cb7 P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.643219  7578 tablet_replica.cc:333] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.643690  7578 raft_consensus.cc:2243] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.644119  7578 raft_consensus.cc:2272] T 0e14fed6789b417e9ebe9f3ca403408d P ff00be387137467ebb737d994c784c67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.645771  7578 tablet_replica.cc:333] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.646271  7578 raft_consensus.cc:2243] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.646732  7578 raft_consensus.cc:2272] T e7ce6cf147bc494096bc35aecd245ac0 P ff00be387137467ebb737d994c784c67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.648284  7578 tablet_replica.cc:333] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.648768  7578 raft_consensus.cc:2243] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.649485  7578 raft_consensus.cc:2272] T f9f46a92817141f58809b70d764d190d P ff00be387137467ebb737d994c784c67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.650906  7578 tablet_replica.cc:333] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.651387  7578 raft_consensus.cc:2243] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.652163  7578 raft_consensus.cc:2272] T 41ccd15440794c309dc6a39ee7774835 P ff00be387137467ebb737d994c784c67 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.653720  7578 tablet_replica.cc:333] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67: stopping tablet replica
I20260709 12:08:47.654163  7578 raft_consensus.cc:2243] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.654546  7578 raft_consensus.cc:2272] T 796ae31a3be64d898b7302134dc6f9eb P ff00be387137467ebb737d994c784c67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.701743  7578 tablet_server.cc:196] TabletServer@127.7.102.131:0 shutdown complete.
I20260709 12:08:47.722406  7578 master.cc:562] Master@127.7.102.190:43427 shutting down...
I20260709 12:08:47.874946  7578 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.875677  7578 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.876056  7578 tablet_replica.cc:333] T 00000000000000000000000000000000 P 82aa833414284dfe9655e8091501eebd: stopping tablet replica
I20260709 12:08:47.896992  7578 master.cc:584] Master@127.7.102.190:43427 shutdown complete.
03f71d127907411e842387a41607118f  4
57412b795ed945618ddd4155e5ad4c2f  4
ff00be387137467ebb737d994c784c67  1
03f71d127907411e842387a41607118f  3
57412b795ed945618ddd4155e5ad4c2f  3
ff00be387137467ebb737d994c784c67  3
03f71d127907411e842387a41607118f  0
57412b795ed945618ddd4155e5ad4c2f  8
ff00be387137467ebb737d994c784c67  1
03f71d127907411e842387a41607118f  3
57412b795ed945618ddd4155e5ad4c2f  3
ff00be387137467ebb737d994c784c67  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31861 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:47.943135  7578 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.102.190:40497
I20260709 12:08:47.944433  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.950860  8124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.951443  8125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.952462  8127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.953687  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:47.954777  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.954960  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.955160  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598927955121 us; error 0 us; skew 500 ppm
I20260709 12:08:47.955812  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.958982  7578 webserver.cc:533] Webserver started at http://127.7.102.190:34909/ using document root <none> and password file <none>
I20260709 12:08:47.959540  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.959750  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.960047  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.961354  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/master-0-root/instance:
uuid: "ce3af9ee8ce746ce8ecdadb9718092e3"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-p7fg"
I20260709 12:08:47.966455  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:47.970399  8132 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.971477  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:08:47.971782  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/master-0-root
uuid: "ce3af9ee8ce746ce8ecdadb9718092e3"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-p7fg"
I20260709 12:08:47.972096  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:48.002727  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:48.003999  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:48.044610  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.190:40497
I20260709 12:08:48.044852  8183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.190:40497 every 8 connection(s)
I20260709 12:08:48.048830  8184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.058923  8184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3: Bootstrap starting.
I20260709 12:08:48.064179  8184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.068842  8184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3: No bootstrap required, opened a new log
I20260709 12:08:48.071230  8184 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER }
I20260709 12:08:48.071767  8184 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.072034  8184 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce3af9ee8ce746ce8ecdadb9718092e3, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.072675  8184 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER }
I20260709 12:08:48.073132  8184 raft_consensus.cc:399] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:48.073338  8184 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:48.073673  8184 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.078172  8184 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER }
I20260709 12:08:48.078686  8184 leader_election.cc:304] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce3af9ee8ce746ce8ecdadb9718092e3; no voters: 
I20260709 12:08:48.079922  8184 leader_election.cc:290] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:48.080502  8187 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.082062  8187 raft_consensus.cc:697] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce3af9ee8ce746ce8ecdadb9718092e3, State: Running, Role: LEADER
I20260709 12:08:48.082850  8187 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER }
I20260709 12:08:48.083096  8184 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:48.088724  8189 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce3af9ee8ce746ce8ecdadb9718092e3. Latest consensus state: current_term: 1 leader_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER } }
I20260709 12:08:48.088764  8188 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce3af9ee8ce746ce8ecdadb9718092e3" member_type: VOTER } }
I20260709 12:08:48.089598  8189 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:48.089900  8188 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:48.092120  8194 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:48.101171  8194 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:48.102308  7578 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:48.111205  8194 catalog_manager.cc:1383] Generated new cluster ID: 2616fd3a4d3a469884a158834c333f16
I20260709 12:08:48.111568  8194 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:48.130616  8194 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:48.131946  8194 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:48.149586  8194 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3: Generated new TSK 0
I20260709 12:08:48.150256  8194 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:48.169129  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:48.175849  8205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:48.176501  8206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:48.178243  8208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:48.179184  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:48.180215  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:48.180452  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:48.180594  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598928180582 us; error 0 us; skew 500 ppm
I20260709 12:08:48.181183  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:48.183739  7578 webserver.cc:533] Webserver started at http://127.7.102.129:40649/ using document root <none> and password file <none>
I20260709 12:08:48.184221  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:48.184402  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:48.184778  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:48.186064  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-0-root/instance:
uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.190972  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:48.194583  8213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.195605  7578 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:48.195953  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.196254  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:48.214999  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:48.216274  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:48.217895  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:48.220304  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:48.220528  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.220867  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:48.221024  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.262048  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.129:39487
I20260709 12:08:48.262252  8275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.129:39487 every 8 connection(s)
I20260709 12:08:48.267033  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:48.275408  8280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:48.276751  8281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:48.280409  8283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:48.280762  7578 server_base.cc:1061] running on GCE node
I20260709 12:08:48.282006  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:48.282290  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:48.282495  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598928282476 us; error 0 us; skew 500 ppm
I20260709 12:08:48.283171  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:48.283535  8276 heartbeater.cc:344] Connected to a master server at 127.7.102.190:40497
I20260709 12:08:48.284075  8276 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:48.285180  8276 heartbeater.cc:507] Master 127.7.102.190:40497 requested a full tablet report, sending...
I20260709 12:08:48.286669  7578 webserver.cc:533] Webserver started at http://127.7.102.130:44505/ using document root <none> and password file <none>
I20260709 12:08:48.287268  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:48.287496  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:48.287770  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:48.287776  8149 ts_manager.cc:194] Registered new tserver with Master: bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487)
I20260709 12:08:48.289170  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-1-root/instance:
uuid: "95a989810fcc42509a0b66089ec8daad"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.289947  8149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58684
I20260709 12:08:48.294030  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:48.297966  8288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.298971  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:08:48.299402  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
uuid: "95a989810fcc42509a0b66089ec8daad"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.299744  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:48.336032  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:48.337447  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:48.339072  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:48.341554  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:48.341799  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.342068  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:48.342252  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.387194  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.130:34837
I20260709 12:08:48.387352  8350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.130:34837 every 8 connection(s)
I20260709 12:08:48.392432  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:48.400027  8354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:48.401466  8355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:48.404394  7578 server_base.cc:1061] running on GCE node
W20260709 12:08:48.405793  8357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:48.406481  8351 heartbeater.cc:344] Connected to a master server at 127.7.102.190:40497
I20260709 12:08:48.406904  8351 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:48.406924  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:48.407364  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:48.407608  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598928407591 us; error 0 us; skew 500 ppm
I20260709 12:08:48.408097  8351 heartbeater.cc:507] Master 127.7.102.190:40497 requested a full tablet report, sending...
I20260709 12:08:48.408376  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:48.410485  8149 ts_manager.cc:194] Registered new tserver with Master: 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:48.411505  7578 webserver.cc:533] Webserver started at http://127.7.102.131:45423/ using document root <none> and password file <none>
I20260709 12:08:48.412053  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:48.412257  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:48.412194  8149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58692
I20260709 12:08:48.412761  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:48.414268  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-2-root/instance:
uuid: "abd80dda9ba24445831eb047beafc198"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.418977  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:48.422559  8362 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.423398  7578 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:08:48.423748  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
uuid: "abd80dda9ba24445831eb047beafc198"
format_stamp: "Formatted at 2026-07-09 12:08:48 on dist-test-slave-p7fg"
I20260709 12:08:48.424079  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895902579-7578-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:48.444887  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:48.446096  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:48.447579  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:48.449864  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:48.450089  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.450335  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:48.450505  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:48.493938  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.131:35923
I20260709 12:08:48.494086  8424 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.131:35923 every 8 connection(s)
I20260709 12:08:48.509368  8425 heartbeater.cc:344] Connected to a master server at 127.7.102.190:40497
I20260709 12:08:48.509841  8425 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:48.510638  8425 heartbeater.cc:507] Master 127.7.102.190:40497 requested a full tablet report, sending...
I20260709 12:08:48.512750  8149 ts_manager.cc:194] Registered new tserver with Master: abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:48.513085  7578 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015867883s
I20260709 12:08:48.514218  8149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58694
I20260709 12:08:48.540557  8149 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58704:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:48.543447  8149 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:48.625428  8241 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9a4dab86b415399fc9fbe939839c4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.626946  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9a4dab86b415399fc9fbe939839c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.627307  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 2b195e78d8544d92b793e3172ae10199 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.628885  8390 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9a4dab86b415399fc9fbe939839c4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.629833  8238 tablet_service.cc:1511] Processing CreateTablet for tablet dcd722edb4b8485a8e3f0cef763a0fa2 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.630295  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9a4dab86b415399fc9fbe939839c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.630192  8240 tablet_service.cc:1511] Processing CreateTablet for tablet cdb9f92f8f8d4e0588e326a871ac358f (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.628916  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b195e78d8544d92b793e3172ae10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.632936  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb9f92f8f8d4e0588e326a871ac358f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.633890  8236 tablet_service.cc:1511] Processing CreateTablet for tablet 808e6587d9d44dc8879000ace52dd706 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.635247  8236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808e6587d9d44dc8879000ace52dd706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.632197  8237 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9e1f0bed22414b92aafaa32953e4d1 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.637840  8237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9e1f0bed22414b92aafaa32953e4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.641121  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd722edb4b8485a8e3f0cef763a0fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.642724  8389 tablet_service.cc:1511] Processing CreateTablet for tablet cdb9f92f8f8d4e0588e326a871ac358f (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.644121  8389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb9f92f8f8d4e0588e326a871ac358f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.643875  8387 tablet_service.cc:1511] Processing CreateTablet for tablet dcd722edb4b8485a8e3f0cef763a0fa2 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.645810  8316 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9a4dab86b415399fc9fbe939839c4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.647091  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9a4dab86b415399fc9fbe939839c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.649933  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 2b195e78d8544d92b793e3172ae10199 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.651434  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b195e78d8544d92b793e3172ae10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.652518  8235 tablet_service.cc:1511] Processing CreateTablet for tablet 40ef404be411470da8a08167b1d09fa4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.653857  8235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ef404be411470da8a08167b1d09fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.653753  8313 tablet_service.cc:1511] Processing CreateTablet for tablet dcd722edb4b8485a8e3f0cef763a0fa2 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.655082  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd722edb4b8485a8e3f0cef763a0fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.656426  8310 tablet_service.cc:1511] Processing CreateTablet for tablet 40ef404be411470da8a08167b1d09fa4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.657737  8310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ef404be411470da8a08167b1d09fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.657846  8312 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9e1f0bed22414b92aafaa32953e4d1 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.659122  8312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9e1f0bed22414b92aafaa32953e4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.660838  8309 tablet_service.cc:1511] Processing CreateTablet for tablet 55588b10ef56468abace9cbc462b73b8 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.662145  8309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55588b10ef56468abace9cbc462b73b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.661832  8311 tablet_service.cc:1511] Processing CreateTablet for tablet 808e6587d9d44dc8879000ace52dd706 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.663085  8311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808e6587d9d44dc8879000ace52dd706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.649986  8388 tablet_service.cc:1511] Processing CreateTablet for tablet 2b195e78d8544d92b793e3172ae10199 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.669234  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 808e6587d9d44dc8879000ace52dd706 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.671200  8315 tablet_service.cc:1511] Processing CreateTablet for tablet cdb9f92f8f8d4e0588e326a871ac358f (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.674701  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 40ef404be411470da8a08167b1d09fa4 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.676783  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 55588b10ef56468abace9cbc462b73b8 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.677807  8308 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0aee98b5484949a1592e18f630ceb0 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.679222  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0aee98b5484949a1592e18f630ceb0 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.681262  8234 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0aee98b5484949a1592e18f630ceb0 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.682572  8234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0aee98b5484949a1592e18f630ceb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.642724  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9e1f0bed22414b92aafaa32953e4d1 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.685758  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd722edb4b8485a8e3f0cef763a0fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.693066  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb9f92f8f8d4e0588e326a871ac358f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.693629  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0aee98b5484949a1592e18f630ceb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.697813  8308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0aee98b5484949a1592e18f630ceb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.702561  8233 tablet_service.cc:1511] Processing CreateTablet for tablet d25c7f5a5db94ac2ae8d853428346b27 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.703951  8233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c7f5a5db94ac2ae8d853428346b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.734810  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808e6587d9d44dc8879000ace52dd706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.735543  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ef404be411470da8a08167b1d09fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.736734  8388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b195e78d8544d92b793e3172ae10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.737686  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9e1f0bed22414b92aafaa32953e4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.738854  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55588b10ef56468abace9cbc462b73b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:48.777235  8133 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.102.129:39487, user_credentials={real_user=slave}} blocked reactor thread for 62151.8us
I20260709 12:08:48.809970  8307 tablet_service.cc:1511] Processing CreateTablet for tablet d25c7f5a5db94ac2ae8d853428346b27 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.811333  8307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c7f5a5db94ac2ae8d853428346b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.824059  8441 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:48.837154  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 55588b10ef56468abace9cbc462b73b8 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.838630  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55588b10ef56468abace9cbc462b73b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.846335  8441 tablet_bootstrap.cc:654] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.852253  8440 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:48.876201  8382 tablet_service.cc:1511] Processing CreateTablet for tablet d25c7f5a5db94ac2ae8d853428346b27 (DEFAULT_TABLE table=test-workload [id=c413ba81b26e48ff9d94e91a7d9113ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.878135  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c7f5a5db94ac2ae8d853428346b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.891788  8440 tablet_bootstrap.cc:654] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.901573  8442 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:48.934924  8441 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:48.935438  8441 ts_tablet_manager.cc:1403] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.047s
I20260709 12:08:48.938416  8441 raft_consensus.cc:359] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:48.939144  8441 raft_consensus.cc:385] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.939442  8441 raft_consensus.cc:740] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.940199  8441 consensus_queue.cc:260] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:48.946411  8442 tablet_bootstrap.cc:654] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.946997  8441 ts_tablet_manager.cc:1434] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.008s
I20260709 12:08:48.949551  8425 heartbeater.cc:499] Master 127.7.102.190:40497 was elected leader, sending a full tablet report...
I20260709 12:08:48.950942  8440 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:48.951328  8441 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:48.951503  8440 ts_tablet_manager.cc:1403] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.009s
I20260709 12:08:48.952280  8442 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:48.952833  8442 ts_tablet_manager.cc:1403] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 12:08:48.954928  8440 raft_consensus.cc:359] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.955731  8440 raft_consensus.cc:385] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.956084  8440 raft_consensus.cc:740] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.955888  8442 raft_consensus.cc:359] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.956782  8442 raft_consensus.cc:385] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.957166  8442 raft_consensus.cc:740] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.958102  8442 consensus_queue.cc:260] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.958603  8441 tablet_bootstrap.cc:654] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.961010  8440 consensus_queue.cc:260] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.962731  8445 raft_consensus.cc:493] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.963282  8445 raft_consensus.cc:515] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:48.964757  8276 heartbeater.cc:499] Master 127.7.102.190:40497 was elected leader, sending a full tablet report...
I20260709 12:08:48.965823  8440 ts_tablet_manager.cc:1434] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:08:48.966179  8445 leader_election.cc:290] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:48.966984  8440 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:48.971283  8351 heartbeater.cc:499] Master 127.7.102.190:40497 was elected leader, sending a full tablet report...
I20260709 12:08:48.972431  8442 ts_tablet_manager.cc:1434] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 12:08:48.973860  8442 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:48.981841  8442 tablet_bootstrap.cc:654] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.981953  8440 tablet_bootstrap.cc:654] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.983390  8447 raft_consensus.cc:493] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.983912  8447 raft_consensus.cc:515] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.986343  8441 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:48.987044  8441 ts_tablet_manager.cc:1403] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.010s
I20260709 12:08:48.987190  8447 leader_election.cc:290] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:48.990810  8441 raft_consensus.cc:359] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.991912  8441 raft_consensus.cc:385] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.992300  8441 raft_consensus.cc:740] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.994583  8441 consensus_queue.cc:260] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:48.997534  8441 ts_tablet_manager.cc:1434] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:08:49.000241  8441 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.006598  8440 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.007315  8440 ts_tablet_manager.cc:1403] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 12:08:49.009759  8441 tablet_bootstrap.cc:654] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.010603  8440 raft_consensus.cc:359] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.011732  8440 raft_consensus.cc:385] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.012177  8440 raft_consensus.cc:740] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.013266  8440 consensus_queue.cc:260] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.015885  8440 ts_tablet_manager.cc:1434] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:08:49.017014  8440 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.024667  8440 tablet_bootstrap.cc:654] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.031431  8441 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.032271  8441 ts_tablet_manager.cc:1403] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.018s
I20260709 12:08:49.036324  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.040832  8442 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.041574  8442 ts_tablet_manager.cc:1403] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.025s
I20260709 12:08:49.041829  8441 raft_consensus.cc:359] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.042747  8441 raft_consensus.cc:385] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.043063  8441 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.043974  8441 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.046545  8441 ts_tablet_manager.cc:1434] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:08:49.045876  8442 raft_consensus.cc:359] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.047050  8442 raft_consensus.cc:385] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.047461  8442 raft_consensus.cc:740] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.048451  8442 consensus_queue.cc:260] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.051265  8442 ts_tablet_manager.cc:1434] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:08:49.052275  8442 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.052700  8440 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.053078  8441 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.053197  8440 ts_tablet_manager.cc:1403] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.012s
I20260709 12:08:49.056600  8440 raft_consensus.cc:359] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
W20260709 12:08:49.057271  8363 leader_election.cc:343] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.060467  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
W20260709 12:08:49.062175  8363 leader_election.cc:343] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.062515  8442 tablet_bootstrap.cc:654] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.062666  8363 leader_election.cc:304] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abd80dda9ba24445831eb047beafc198; no voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.063596  8445 raft_consensus.cc:2749] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.067333  8441 tablet_bootstrap.cc:654] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.070604  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.057447  8440 raft_consensus.cc:385] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.072171  8440 raft_consensus.cc:740] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
W20260709 12:08:49.073392  8289 leader_election.cc:343] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.073364  8440 consensus_queue.cc:260] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.076985  8442 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.077531  8442 ts_tablet_manager.cc:1403] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:08:49.080191  8440 ts_tablet_manager.cc:1434] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:08:49.081373  8440 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.081530  8442 raft_consensus.cc:359] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.082285  8442 raft_consensus.cc:385] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.082587  8442 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.084556  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.085027  8442 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
W20260709 12:08:49.086151  8289 leader_election.cc:343] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.086572  8289 leader_election.cc:304] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.087838  8441 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.088409  8441 ts_tablet_manager.cc:1403] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.005s
I20260709 12:08:49.091189  8445 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.091697  8445 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.092095  8447 raft_consensus.cc:2749] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.092891  8442 ts_tablet_manager.cc:1434] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:08:49.093376  8440 tablet_bootstrap.cc:654] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.093716  8445 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.093951  8442 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.095705  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.096017  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
W20260709 12:08:49.096432  8197 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:49.096103  8441 raft_consensus.cc:359] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.096915  8441 raft_consensus.cc:385] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.097239  8441 raft_consensus.cc:740] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
W20260709 12:08:49.097317  8363 leader_election.cc:343] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.098119  8447 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:49.098373  8363 leader_election.cc:343] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.098623  8447 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.098868  8363 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abd80dda9ba24445831eb047beafc198; no voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.100104  8445 raft_consensus.cc:2749] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.100793  8447 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.101824  8441 consensus_queue.cc:260] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.103453  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.105093  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.105681  8442 tablet_bootstrap.cc:654] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:49.106652  8289 leader_election.cc:343] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:49.107641  8289 leader_election.cc:343] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.107944  8441 ts_tablet_manager.cc:1434] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 12:08:49.108068  8289 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.109032  8441 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.112248  8447 raft_consensus.cc:2749] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.118818  8441 tablet_bootstrap.cc:654] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.120970  8445 raft_consensus.cc:493] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.121539  8445 raft_consensus.cc:515] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.122045  8440 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.122568  8440 ts_tablet_manager.cc:1403] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.006s
I20260709 12:08:49.124392  8445 leader_election.cc:290] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.125617  8440 raft_consensus.cc:359] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.126371  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.126533  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.127072  8251 raft_consensus.cc:2468] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
W20260709 12:08:49.127827  8363 leader_election.cc:343] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.126349  8440 raft_consensus.cc:385] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.128471  8440 raft_consensus.cc:740] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.128667  8363 leader_election.cc:304] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.129927  8445 raft_consensus.cc:2804] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.130290  8445 raft_consensus.cc:493] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.129360  8440 consensus_queue.cc:260] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.130648  8445 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.131137  8442 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.131137  8441 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.131858  8441 ts_tablet_manager.cc:1403] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 12:08:49.131851  8442 ts_tablet_manager.cc:1403] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.011s
I20260709 12:08:49.134920  8442 raft_consensus.cc:359] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.135039  8441 raft_consensus.cc:359] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.135681  8442 raft_consensus.cc:385] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.135829  8441 raft_consensus.cc:385] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.136036  8442 raft_consensus.cc:740] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.136262  8441 raft_consensus.cc:740] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.136999  8442 consensus_queue.cc:260] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.137135  8441 consensus_queue.cc:260] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.139292  8442 ts_tablet_manager.cc:1434] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:49.139514  8440 ts_tablet_manager.cc:1434] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:08:49.140298  8442 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.141552  8441 ts_tablet_manager.cc:1434] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:08:49.142575  8441 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.145514  8445 raft_consensus.cc:515] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.147006  8442 tablet_bootstrap.cc:654] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.149214  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.149840  8251 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.151265  8440 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
W20260709 12:08:49.151414  8352 tablet.cc:2406] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:49.156415  8447 raft_consensus.cc:493] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.161233  8447 raft_consensus.cc:515] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.165242  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
W20260709 12:08:49.167577  8289 leader_election.cc:343] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.169092  8447 leader_election.cc:290] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.170374  8441 tablet_bootstrap.cc:654] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.170849  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
W20260709 12:08:49.172660  8289 leader_election.cc:343] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.173135  8289 leader_election.cc:304] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.173697  8440 tablet_bootstrap.cc:654] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.174466  8447 raft_consensus.cc:2749] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.182533  8251 raft_consensus.cc:2468] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.183734  8440 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.183984  8363 leader_election.cc:304] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.184265  8440 ts_tablet_manager.cc:1403] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260709 12:08:49.185079  8460 raft_consensus.cc:2804] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.186673  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.187602  8440 raft_consensus.cc:359] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
W20260709 12:08:49.187978  8363 leader_election.cc:343] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.188568  8445 leader_election.cc:290] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.188745  8440 raft_consensus.cc:385] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.189420  8460 raft_consensus.cc:697] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.189761  8440 raft_consensus.cc:740] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.190872  8460 consensus_queue.cc:237] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.190909  8440 consensus_queue.cc:260] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.193264  8442 tablet_bootstrap.cc:492] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.193544  8440 ts_tablet_manager.cc:1434] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:08:49.193892  8442 ts_tablet_manager.cc:1403] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.020s
I20260709 12:08:49.194561  8440 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.184283  8441 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.195384  8441 ts_tablet_manager.cc:1403] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.004s
I20260709 12:08:49.197257  8442 raft_consensus.cc:359] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.198048  8442 raft_consensus.cc:385] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.198405  8442 raft_consensus.cc:740] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.198237  8441 raft_consensus.cc:359] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.199316  8441 raft_consensus.cc:385] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.199647  8441 raft_consensus.cc:740] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.199484  8442 consensus_queue.cc:260] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.202075  8440 tablet_bootstrap.cc:654] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.201968  8441 consensus_queue.cc:260] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.204286  8441 ts_tablet_manager.cc:1434] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:08:49.204401  8442 ts_tablet_manager.cc:1434] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:08:49.205335  8441 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.205469  8442 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.216190  8442 tablet_bootstrap.cc:654] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.233830  8440 tablet_bootstrap.cc:492] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.234442  8440 ts_tablet_manager.cc:1403] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.013s
I20260709 12:08:49.235594  8441 tablet_bootstrap.cc:654] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.235370  8149 catalog_manager.cc:5697] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.237601  8440 raft_consensus.cc:359] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.238353  8440 raft_consensus.cc:385] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.238703  8440 raft_consensus.cc:740] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.239887  8440 consensus_queue.cc:260] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.240578  8442 tablet_bootstrap.cc:492] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.241540  8442 ts_tablet_manager.cc:1403] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.013s
I20260709 12:08:49.242647  8440 ts_tablet_manager.cc:1434] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:49.240578  8441 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.244371  8441 ts_tablet_manager.cc:1403] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.009s
I20260709 12:08:49.244670  8442 raft_consensus.cc:359] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.245445  8442 raft_consensus.cc:385] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.245761  8442 raft_consensus.cc:740] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.246654  8442 consensus_queue.cc:260] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.247340  8441 raft_consensus.cc:359] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.248013  8441 raft_consensus.cc:385] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.248288  8441 raft_consensus.cc:740] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.249032  8441 consensus_queue.cc:260] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.243733  8440 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.251457  8441 ts_tablet_manager.cc:1434] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:49.252471  8441 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.256500  8442 ts_tablet_manager.cc:1434] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:08:49.258946  8441 tablet_bootstrap.cc:654] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.260519  8442 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.264925  8440 tablet_bootstrap.cc:654] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.269944  8442 tablet_bootstrap.cc:654] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.278188  8440 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.278581  8460 raft_consensus.cc:493] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.278815  8440 ts_tablet_manager.cc:1403] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:08:49.279175  8460 raft_consensus.cc:515] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.280853  8442 tablet_bootstrap.cc:492] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.281404  8442 ts_tablet_manager.cc:1403] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:08:49.281404  8460 leader_election.cc:290] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.282021  8440 raft_consensus.cc:359] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.282807  8440 raft_consensus.cc:385] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.283113  8440 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.283075  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.283591  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.283905  8251 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.284300  8326 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.284086  8440 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.285367  8363 leader_election.cc:304] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.285264  8442 raft_consensus.cc:359] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.286208  8442 raft_consensus.cc:385] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.286603  8442 raft_consensus.cc:740] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.286914  8460 raft_consensus.cc:2804] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.287317  8460 raft_consensus.cc:493] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.287731  8460 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.288002  8441 tablet_bootstrap.cc:492] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.287487  8442 consensus_queue.cc:260] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.288475  8441 ts_tablet_manager.cc:1403] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.010s
I20260709 12:08:49.289855  8440 ts_tablet_manager.cc:1434] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:08:49.290949  8440 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.292225  8441 raft_consensus.cc:359] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.292970  8441 raft_consensus.cc:385] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.293239  8441 raft_consensus.cc:740] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.293964  8441 consensus_queue.cc:260] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.295921  8441 ts_tablet_manager.cc:1434] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:49.296842  8441 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.298094  8440 tablet_bootstrap.cc:654] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.293320  8442 ts_tablet_manager.cc:1434] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:08:49.302196  8442 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.308661  8442 tablet_bootstrap.cc:654] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.312528  8441 tablet_bootstrap.cc:654] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.320607  8447 raft_consensus.cc:493] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.320917  8442 tablet_bootstrap.cc:492] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.321504  8442 ts_tablet_manager.cc:1403] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.002s
I20260709 12:08:49.327548  8460 raft_consensus.cc:515] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.321213  8447 raft_consensus.cc:515] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.332563  8449 raft_consensus.cc:493] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.333331  8449 raft_consensus.cc:515] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.334227  8447 leader_election.cc:290] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.334980  8447 raft_consensus.cc:493] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.334286  8442 raft_consensus.cc:359] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.335448  8447 raft_consensus.cc:515] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.335942  8442 raft_consensus.cc:385] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.336488  8449 leader_election.cc:290] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.336745  8442 raft_consensus.cc:740] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.338137  8442 consensus_queue.cc:260] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.340058  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.340413  8442 ts_tablet_manager.cc:1434] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:08:49.340541  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.341281  8251 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.340463  8460 leader_election.cc:290] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.344381  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.344993  8326 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.347594  8449 raft_consensus.cc:493] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.347831  8440 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.348285  8440 ts_tablet_manager.cc:1403] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.020s
I20260709 12:08:49.348098  8449 raft_consensus.cc:515] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.349061  8251 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.350252  8449 leader_election.cc:290] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.350504  8363 leader_election.cc:304] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.351547  8460 raft_consensus.cc:2804] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.351462  8440 raft_consensus.cc:359] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.352654  8440 raft_consensus.cc:385] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.353012  8440 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.353175  8460 raft_consensus.cc:697] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.353718  8440 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.354218  8460 consensus_queue.cc:237] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.341686  8442 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.355985  8440 ts_tablet_manager.cc:1434] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:49.356997  8440 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.358369  8445 raft_consensus.cc:493] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.358887  8445 raft_consensus.cc:515] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.360201  8480 raft_consensus.cc:493] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.360932  8445 leader_election.cc:290] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.360747  8480 raft_consensus.cc:515] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.362344  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.363808  8480 leader_election.cc:290] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.364549  8251 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.365840  8363 leader_election.cc:304] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.367648  8447 leader_election.cc:290] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.366267  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.368592  8466 raft_consensus.cc:2804] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.368883  8441 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.369071  8325 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.369370  8441 ts_tablet_manager.cc:1403] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.009s
I20260709 12:08:49.369087  8466 raft_consensus.cc:493] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.370388  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.367049  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.370667  8445 raft_consensus.cc:493] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.371250  8400 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 0.
I20260709 12:08:49.371285  8445 raft_consensus.cc:515] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.370589  8466 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.373134  8440 tablet_bootstrap.cc:654] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.374505  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.373273  8441 raft_consensus.cc:359] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.376883  8441 raft_consensus.cc:385] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.376469  8289 leader_election.cc:304] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
W20260709 12:08:49.376947  8363 leader_election.cc:343] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.378347  8441 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.379304  8442 tablet_bootstrap.cc:654] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.379066  8441 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.380528  8445 leader_election.cc:290] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.381084  8447 raft_consensus.cc:2804] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.381487  8447 raft_consensus.cc:493] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.381871  8447 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.381739  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.382544  8325 raft_consensus.cc:2468] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.384930  8441 ts_tablet_manager.cc:1434] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:08:49.386214  8441 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: Bootstrap starting.
I20260709 12:08:49.365742  8326 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.391219  8363 leader_election.cc:304] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.392840  8445 raft_consensus.cc:2804] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.393349  8445 raft_consensus.cc:493] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.393795  8445 raft_consensus.cc:3060] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.396929  8466 raft_consensus.cc:515] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.399338  8447 raft_consensus.cc:515] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.408170  8399 raft_consensus.cc:2393] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95a989810fcc42509a0b66089ec8daad in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.408479  8447 leader_election.cc:290] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.409592  8466 leader_election.cc:290] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.410943  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.411623  8326 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.411264  8149 catalog_manager.cc:5697] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.412168  8449 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.412833  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.413563  8445 raft_consensus.cc:515] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.414009  8251 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.413674  8449 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.415709  8445 leader_election.cc:290] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.415813  8449 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.416949  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.417567  8400 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.422865  8449 raft_consensus.cc:493] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.426447  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.427712  8250 raft_consensus.cc:2393] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95a989810fcc42509a0b66089ec8daad in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.423450  8449 raft_consensus.cc:515] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.429746  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.430577  8325 raft_consensus.cc:3060] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.430886  8449 leader_election.cc:290] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.437083  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
W20260709 12:08:49.438779  8363 leader_election.cc:343] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.443969  8326 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.450474  8400 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 1.
I20260709 12:08:49.453583  8289 leader_election.cc:304] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:08:49.454450  8447 raft_consensus.cc:2804] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.455016  8447 raft_consensus.cc:697] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:49.455286  8441 tablet_bootstrap.cc:654] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.455863  8447 consensus_queue.cc:237] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.433808  8251 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.463984  8363 leader_election.cc:304] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.465983  8445 raft_consensus.cc:2804] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.466686  8445 raft_consensus.cc:697] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.465751  8325 raft_consensus.cc:2468] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.467798  8445 consensus_queue.cc:237] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.470368  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.472050  8251 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 0.
I20260709 12:08:49.473591  8466 raft_consensus.cc:493] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.474148  8466 raft_consensus.cc:515] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.476105  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.476713  8466 leader_election.cc:290] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.477363  8250 raft_consensus.cc:2393] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95a989810fcc42509a0b66089ec8daad in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.478166  8363 leader_election.cc:304] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.479800  8440 tablet_bootstrap.cc:492] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.480283  8440 ts_tablet_manager.cc:1403] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.123s	user 0.031s	sys 0.030s
I20260709 12:08:49.480324  8442 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.481027  8441 tablet_bootstrap.cc:492] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: No bootstrap required, opened a new log
I20260709 12:08:49.481132  8442 ts_tablet_manager.cc:1403] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.140s	user 0.017s	sys 0.008s
I20260709 12:08:49.481510  8441 ts_tablet_manager.cc:1403] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.003s
I20260709 12:08:49.482369  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.483006  8251 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.485432  8440 raft_consensus.cc:359] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.486582  8440 raft_consensus.cc:385] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.486807  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.487018  8440 raft_consensus.cc:740] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.487540  8250 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.488222  8440 consensus_queue.cc:260] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.489070  8363 leader_election.cc:304] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.489439  8289 leader_election.cc:304] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.490520  8460 raft_consensus.cc:2804] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.490873  8447 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.491292  8440 ts_tablet_manager.cc:1434] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:08:49.481832  8466 raft_consensus.cc:2804] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.490911  8460 raft_consensus.cc:493] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.492705  8440 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: Bootstrap starting.
I20260709 12:08:49.492765  8460 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.485190  8147 catalog_manager.cc:5697] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 0 to 1, leader changed from <none> to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 1 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.508092  8251 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 1.
I20260709 12:08:49.509857  8289 leader_election.cc:304] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.510918  8480 raft_consensus.cc:2749] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.514473  8460 raft_consensus.cc:515] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.516858  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.517797  8326 raft_consensus.cc:2393] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd8f4dca41784f4cb6c2f5b36bc4638c in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.516762  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.523248  8447 raft_consensus.cc:2749] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.524221  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.524893  8323 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 0.
I20260709 12:08:49.518916  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.525717  8449 raft_consensus.cc:493] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.526211  8449 raft_consensus.cc:515] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.527158  8325 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.526989  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.529165  8449 leader_election.cc:290] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.528424  8397 raft_consensus.cc:2468] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 0.
I20260709 12:08:49.529922  8445 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.535194  8445 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.536620  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.537235  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.539215  8445 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.523350  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.540364  8322 raft_consensus.cc:2468] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 0.
I20260709 12:08:49.541222  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.541867  8399 raft_consensus.cc:2393] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd8f4dca41784f4cb6c2f5b36bc4638c in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.541851  8250 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 0.
I20260709 12:08:49.543990  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.546228  8149 catalog_manager.cc:5697] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.524897  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.550742  8442 raft_consensus.cc:359] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.551746  8442 raft_consensus.cc:385] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.552122  8442 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
W20260709 12:08:49.552814  8363 leader_election.cc:343] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.553974  8363 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.554358  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.555267  8251 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.556059  8489 raft_consensus.cc:2804] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.539353  8441 raft_consensus.cc:359] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.556857  8441 raft_consensus.cc:385] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.557420  8441 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.558236  8441 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.560119  8441 ts_tablet_manager.cc:1434] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.002s
I20260709 12:08:49.556535  8489 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.560817  8489 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.561993  8466 raft_consensus.cc:697] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.562865  8442 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.565176  8466 consensus_queue.cc:237] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.566111  8442 ts_tablet_manager.cc:1434] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:08:49.567068  8214 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.567914  8449 raft_consensus.cc:2804] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.568280  8449 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.562402  8460 leader_election.cc:290] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.568980  8449 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.570444  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.571171  8322 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.568897  8251 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.574352  8440 tablet_bootstrap.cc:654] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.574728  8363 leader_election.cc:304] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.575922  8460 raft_consensus.cc:2804] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.576676  8460 raft_consensus.cc:697] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.577379  8214 leader_election.cc:304] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.577628  8460 consensus_queue.cc:237] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.580199  8322 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.582271  8489 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.583563  8442 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: Bootstrap starting.
I20260709 12:08:49.588706  8449 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.598523  8449 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.601466  8493 raft_consensus.cc:2804] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.602207  8493 raft_consensus.cc:493] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.602528  8493 raft_consensus.cc:3060] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.602984  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.603787  8251 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.606074  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad" is_pre_election: true
I20260709 12:08:49.606213  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.607041  8325 raft_consensus.cc:2393] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd8f4dca41784f4cb6c2f5b36bc4638c in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.603775  8489 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
W20260709 12:08:49.608505  8363 leader_election.cc:343] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.609692  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.609901  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c7f5a5db94ac2ae8d853428346b27" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.610339  8325 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.610977  8493 raft_consensus.cc:515] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.611379  8251 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 1.
I20260709 12:08:49.613093  8363 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.614507  8489 raft_consensus.cc:2804] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.618963  8489 raft_consensus.cc:697] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
W20260709 12:08:49.621657  8214 leader_election.cc:343] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:49.622983  8325 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 1.
I20260709 12:08:49.624214  8214 leader_election.cc:304] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198
I20260709 12:08:49.625051  8449 raft_consensus.cc:2749] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.625300  8440 tablet_bootstrap.cc:492] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: No bootstrap required, opened a new log
I20260709 12:08:49.625885  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.626308  8440 ts_tablet_manager.cc:1403] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.012s
I20260709 12:08:49.626489  8400 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.626569  8149 catalog_manager.cc:5697] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.627918  8214 leader_election.cc:304] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198
I20260709 12:08:49.628688  8449 raft_consensus.cc:2749] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.629285  8440 raft_consensus.cc:359] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.630043  8440 raft_consensus.cc:385] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.630357  8442 tablet_bootstrap.cc:654] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.630328  8440 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.625687  8493 leader_election.cc:290] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 election: Requested vote from peers abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:49.631685  8440 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.632083  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.632774  8325 raft_consensus.cc:3060] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.634267  8440 ts_tablet_manager.cc:1434] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:08:49.637666  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9a4dab86b415399fc9fbe939839c4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.636786  8466 consensus_queue.cc:1048] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:08:49.638787  8399 raft_consensus.cc:3060] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.639983  8325 raft_consensus.cc:2468] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 1.
I20260709 12:08:49.641260  8214 leader_election.cc:304] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198
I20260709 12:08:49.642072  8493 raft_consensus.cc:3060] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.642113  8400 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 1.
I20260709 12:08:49.643710  8489 consensus_queue.cc:237] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.646385  8399 raft_consensus.cc:2468] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 1.
I20260709 12:08:49.649729  8442 tablet_bootstrap.cc:492] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: No bootstrap required, opened a new log
I20260709 12:08:49.650230  8442 ts_tablet_manager.cc:1403] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.001s
I20260709 12:08:49.652964  8493 raft_consensus.cc:2749] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.653211  8442 raft_consensus.cc:359] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.653865  8442 raft_consensus.cc:385] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.654134  8442 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.654325  8214 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.654933  8442 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.657055  8442 ts_tablet_manager.cc:1434] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:08:49.661334  8493 raft_consensus.cc:2804] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.661877  8493 raft_consensus.cc:697] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:49.662693  8493 consensus_queue.cc:237] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.671991  8447 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.672808  8447 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.675748  8447 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.676388  8214 leader_election.cc:304] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.677821  8449 raft_consensus.cc:2804] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.685979  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.686952  8399 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 0.
I20260709 12:08:49.688755  8289 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:08:49.682307  8147 catalog_manager.cc:5697] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.692493  8447 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.693078  8447 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.693523  8447 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.695317  8147 catalog_manager.cc:5697] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 0 to 1, leader changed from <none> to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.700558  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.701524  8250 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 0.
I20260709 12:08:49.704394  8460 consensus_queue.cc:1048] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.704852  8449 raft_consensus.cc:697] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:49.706493  8449 consensus_queue.cc:237] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } }
I20260709 12:08:49.719075  8447 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.724835  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.725710  8250 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.728641  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.729506  8399 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.741496  8399 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 1.
I20260709 12:08:49.741647  8250 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 1.
I20260709 12:08:49.743588  8289 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:08:49.745719  8480 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.753338  8447 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.754679  8480 raft_consensus.cc:697] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:49.755910  8480 consensus_queue.cc:237] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.761830  8147 catalog_manager.cc:5697] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.765210  8147 catalog_manager.cc:5697] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.783955  8147 catalog_manager.cc:5697] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 0 to 1, leader changed from <none> to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 1 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.858984  8460 consensus_queue.cc:1048] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.864862  8504 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.870929  8447 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.887362  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:08:49.888223  8400 raft_consensus.cc:606] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.891368  8489 consensus_queue.cc:1048] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.911543  8489 raft_consensus.cc:993] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:49.912106  8445 raft_consensus.cc:1081] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:49.914007  8325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:08:49.914667  8325 raft_consensus.cc:606] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.915282  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39786
I20260709 12:08:49.915892  8250 raft_consensus.cc:493] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.916251  8250 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.920825  8325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:08:49.921422  8325 raft_consensus.cc:606] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.922987  8250 raft_consensus.cc:515] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.924851  8250 leader_election.cc:290] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.925577  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:49.926208  8325 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.926174  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb9f92f8f8d4e0588e326a871ac358f" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.926786  8399 raft_consensus.cc:3055] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.927124  8399 raft_consensus.cc:740] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.927937  8399 consensus_queue.cc:260] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.929217  8399 raft_consensus.cc:3060] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.930045  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:08:49.930610  8400 raft_consensus.cc:606] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.933864  8325 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:49.934614  8447 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.935178  8214 leader_election.cc:304] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:49.935132  8447 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.935874  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:08:49.936148  8399 raft_consensus.cc:2468] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:49.936236  8493 raft_consensus.cc:2804] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.936462  8400 raft_consensus.cc:606] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.936877  8493 raft_consensus.cc:697] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:49.937744  8447 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.937813  8493 consensus_queue.cc:237] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.940019  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" is_pre_election: true
I20260709 12:08:49.940511  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd80dda9ba24445831eb047beafc198" is_pre_election: true
I20260709 12:08:49.940887  8250 raft_consensus.cc:2393] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95a989810fcc42509a0b66089ec8daad in current term 1: Already voted for candidate abd80dda9ba24445831eb047beafc198 in this term.
I20260709 12:08:49.942438  8289 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad; no voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.943385  8447 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.943473  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:08:49.944092  8400 raft_consensus.cc:606] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.947811  8149 catalog_manager.cc:5697] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 1 to 2, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.949391  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:08:49.949923  8400 raft_consensus.cc:606] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:08:49.951049  8447 raft_consensus.cc:2749] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.953413  8460 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.960469  8489 raft_consensus.cc:993] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:49.961130  8445 raft_consensus.cc:1081] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:49.963270  8322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45156
I20260709 12:08:49.964432  8322 raft_consensus.cc:493] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.964963  8322 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.967958  8489 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.974561  8322 raft_consensus.cc:515] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.976212  8489 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.978102  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:49.981742  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:49.982419  8400 raft_consensus.cc:3055] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.982846  8400 raft_consensus.cc:740] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:49.984022  8400 consensus_queue.cc:260] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.985749  8400 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.992771  8322 leader_election.cc:290] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:49.992463  8400 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:49.995846  8289 leader_election.cc:304] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:08:49.996297  8489 raft_consensus.cc:993] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:49.996846  8447 raft_consensus.cc:2804] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.997545  8447 raft_consensus.cc:697] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:49.998538  8447 consensus_queue.cc:237] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:49.996881  8489 raft_consensus.cc:1081] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:50.006672  8322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45156
I20260709 12:08:50.007396  8322 raft_consensus.cc:493] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.007766  8322 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.010572  8445 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.015820  8147 catalog_manager.cc:5697] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 1 to 2, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 2 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.022702  8322 raft_consensus.cc:515] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.027392  8322 leader_election.cc:290] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:50.028663  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:50.028949  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:50.029353  8400 raft_consensus.cc:3055] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:50.029491  8250 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.029733  8400 raft_consensus.cc:740] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:50.030645  8400 consensus_queue.cc:260] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.031982  8400 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.037956  8250 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.039713  8289 leader_election.cc:304] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:50.039978  8400 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.040735  8447 raft_consensus.cc:2804] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:50.041296  8447 raft_consensus.cc:697] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:50.042047  8445 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.042250  8447 consensus_queue.cc:237] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.051929  8149 catalog_manager.cc:5697] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 1 to 2, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 2 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.059958  8490 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.067641  8490 raft_consensus.cc:993] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:50.068053  8490 raft_consensus.cc:1081] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:50.069625  8322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45156
I20260709 12:08:50.070304  8322 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.070719  8322 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.076399  8322 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.078357  8322 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:50.079391  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:50.079653  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:50.080049  8250 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.080214  8400 raft_consensus.cc:3055] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:50.080600  8400 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:50.081503  8400 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.082818  8400 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.087967  8250 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.089515  8289 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:50.090298  8447 raft_consensus.cc:2804] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:50.090553  8400 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.090734  8447 raft_consensus.cc:697] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:50.091670  8447 consensus_queue.cc:237] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.098402  8147 catalog_manager.cc:5697] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 1 to 2, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 2 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.149084  8490 consensus_queue.cc:1048] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.161139  8490 consensus_queue.cc:1048] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.198890  8493 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.212162  8501 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.221611  8490 raft_consensus.cc:993] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:50.222175  8490 raft_consensus.cc:1081] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:08:50.223901  8322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45156
I20260709 12:08:50.224567  8322 raft_consensus.cc:493] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.225009  8322 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.232731  8322 raft_consensus.cc:515] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.233736  8501 consensus_queue.cc:1048] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.235438  8322 leader_election.cc:290] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:50.235702  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:50.236370  8250 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.236747  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0aee98b5484949a1592e18f630ceb0" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:50.237331  8399 raft_consensus.cc:3055] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:50.237670  8399 raft_consensus.cc:740] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:50.238567  8399 consensus_queue.cc:260] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.239874  8399 raft_consensus.cc:3060] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.244324  8250 raft_consensus.cc:2468] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.245921  8289 leader_election.cc:304] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:50.246907  8447 raft_consensus.cc:2804] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:50.247406  8447 raft_consensus.cc:697] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:50.248230  8447 consensus_queue.cc:237] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.254798  8501 consensus_queue.cc:1048] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.250818  8399 raft_consensus.cc:2468] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 2.
I20260709 12:08:50.261135  8148 catalog_manager.cc:5697] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 1 to 2, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 2 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.364230  8447 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:50.370010  8399 raft_consensus.cc:1275] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.371433  8501 consensus_queue.cc:1048] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.372392  8504 raft_consensus.cc:993] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:50.372951  8504 raft_consensus.cc:1081] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:50.376093  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39788
I20260709 12:08:50.376745  8251 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.377137  8251 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.384491  8480 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.387751  8251 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.388988  8250 raft_consensus.cc:1240] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Rejecting Update request from peer 95a989810fcc42509a0b66089ec8daad for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:50.390558  8322 raft_consensus.cc:1275] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.393146  8521 consensus_queue.cc:1048] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.393518  8480 consensus_queue.cc:1059] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:50.393409  8251 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:50.394460  8480 raft_consensus.cc:3055] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:50.395349  8480 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:50.396406  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:50.396322  8480 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.397387  8480 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.398186  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:50.398772  8400 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.407254  8400 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:50.408838  8214 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:50.409674  8521 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:50.410149  8521 raft_consensus.cc:697] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:50.411029  8521 consensus_queue.cc:237] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.413595  8322 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:50.419521  8149 catalog_manager.cc:5697] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 1 to 2, leader changed from 95a989810fcc42509a0b66089ec8daad (127.7.102.130) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.425519  8447 raft_consensus.cc:993] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:50.426076  8447 raft_consensus.cc:1081] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:08:50.427971  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39788
I20260709 12:08:50.428670  8251 raft_consensus.cc:493] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.429098  8251 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.434321  8251 raft_consensus.cc:515] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.436025  8251 leader_election.cc:290] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:08:50.437017  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:50.437328  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:08:50.437729  8322 raft_consensus.cc:3055] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:50.438012  8400 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.438133  8322 raft_consensus.cc:740] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:08:50.439119  8322 consensus_queue.cc:260] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.440201  8322 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.443557  8400 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:50.445268  8214 leader_election.cc:304] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:08:50.445829  8322 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 2.
I20260709 12:08:50.446165  8521 raft_consensus.cc:2804] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:50.446698  8521 raft_consensus.cc:697] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:50.447184  8400 raft_consensus.cc:1275] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.447561  8521 consensus_queue.cc:237] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:50.448700  8480 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.455430  8149 catalog_manager.cc:5697] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 1 to 2, leader changed from 95a989810fcc42509a0b66089ec8daad (127.7.102.130) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:50.456980  8251 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:50.464731  8251 raft_consensus.cc:1275] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.466980  8480 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.494143  8251 raft_consensus.cc:1275] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.495646  8480 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.504114  8400 raft_consensus.cc:1275] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.505925  8504 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.584060  8251 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.585533  8504 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.595477  8400 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.597673  8480 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.706626  8400 raft_consensus.cc:1275] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.706766  8251 raft_consensus.cc:1275] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.708405  8527 consensus_queue.cc:1048] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.709157  8480 consensus_queue.cc:1048] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.822053  8400 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.823565  8521 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.834121  8322 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.835898  8521 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.915418  8400 raft_consensus.cc:1275] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.917232  8521 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.922926  8322 raft_consensus.cc:1275] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.924605  8449 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:52.990281  7578 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:52.990995  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.008395  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:08:53.009114  8251 raft_consensus.cc:606] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Received request to transfer leadership to TS abd80dda9ba24445831eb047beafc198
I20260709 12:08:53.011734  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:08:53.012223  8251 raft_consensus.cc:606] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Received request to transfer leadership to TS abd80dda9ba24445831eb047beafc198
I20260709 12:08:53.013372  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:53.013988  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.286695  8533 raft_consensus.cc:993] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:08:53.287246  8521 raft_consensus.cc:1081] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Signalling peer abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:08:53.288993  8399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:53006
I20260709 12:08:53.289564  8399 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.289953  8399 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:53.296588  8399 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.299152  8399 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 3 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:53.300042  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:53.300359  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:53.300784  8251 raft_consensus.cc:3055] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:53.300922  8322 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:53.301182  8251 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:53.302019  8251 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.303364  8251 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:53.308305  8322 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 3.
I20260709 12:08:53.309752  8363 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:08:53.310124  8251 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 3.
I20260709 12:08:53.310717  8490 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:53.311901  8490 raft_consensus.cc:697] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:53.312875  8490 consensus_queue.cc:237] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.321023  8148 catalog_manager.cc:5697] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 2 to 3, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:53.360385  8533 raft_consensus.cc:993] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:08:53.360913  8521 raft_consensus.cc:1081] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Signalling peer abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:08:53.362521  8399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:53006
I20260709 12:08:53.363016  8399 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.363337  8399 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.369024  8399 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.370756  8399 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 2 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:08:53.371289  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:08:53.371944  8251 raft_consensus.cc:3055] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:53.371945  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:08:53.372363  8251 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:08:53.372697  8322 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.373118  8251 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.374068  8251 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.377743  8322 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 2.
I20260709 12:08:53.378626  8251 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 2.
I20260709 12:08:53.378786  8363 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:08:53.379645  8490 raft_consensus.cc:2804] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:53.380069  8490 raft_consensus.cc:697] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:08:53.380828  8490 consensus_queue.cc:237] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:08:53.388155  8148 catalog_manager.cc:5697] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 1 to 2, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:53.831492  8322 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:53.832938  8490 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:53.844090  8251 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:53.845876  8543 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:53.916013  8251 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.916410  8322 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.917618  8490 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.918358  8543 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:54.015105  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.021144  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.021622  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.022662  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.028219  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.028693  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.121732  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.127452  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.127929  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:56.342780  8272 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf420 after lost signal to thread 7581
W20260709 12:08:56.344012  8272 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccce0 after lost signal to thread 8183
W20260709 12:08:56.345158  8272 debug-util.cc:398] Leaking SignalData structure 0x7b08000f43e0 after lost signal to thread 8275
W20260709 12:08:56.346446  8272 debug-util.cc:398] Leaking SignalData structure 0x7b080017c9c0 after lost signal to thread 8350
W20260709 12:08:56.348280  8272 debug-util.cc:398] Leaking SignalData structure 0x7b080009de20 after lost signal to thread 8424
I20260709 12:08:57.129415  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.140281  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.140980  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.142606  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.151628  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.152196  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.153280  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.158417  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.158798  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.159946  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.165742  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.166172  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.167274  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.173245  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.173745  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.174794  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:02.180962  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:02.181473  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:03.214955  7578 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:03.228852  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:09:03.229858  8400 raft_consensus.cc:606] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:09:03.235092  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:09:03.235554  8400 raft_consensus.cc:606] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:09:03.240572  8322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:09:03.241056  8322 raft_consensus.cc:606] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:09:03.246045  8322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:09:03.246457  8322 raft_consensus.cc:606] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:09:03.251112  8322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
mode: GRACEFUL
new_leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:09:03.251585  8322 raft_consensus.cc:606] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Received request to transfer leadership to TS bd8f4dca41784f4cb6c2f5b36bc4638c
I20260709 12:09:03.367923  8561 raft_consensus.cc:993] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.368395  8561 raft_consensus.cc:1081] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.370123  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39788
I20260709 12:09:03.370628  8251 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.370959  8251 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.376678  8251 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.378338  8251 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:03.379616  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:03.379755  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:03.380649  8400 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.380595  8322 raft_consensus.cc:3055] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:03.381148  8322 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:09:03.382149  8322 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.383675  8322 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.389485  8400 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.390848  8214 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:03.391023  8322 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.391746  8560 raft_consensus.cc:2804] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:03.392861  8560 raft_consensus.cc:697] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:03.393712  8560 consensus_queue.cc:237] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.406584  8563 raft_consensus.cc:993] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.407160  8561 raft_consensus.cc:1081] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.407769  8149 catalog_manager.cc:5697] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 2 to 3, leader changed from 95a989810fcc42509a0b66089ec8daad (127.7.102.130) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.408609  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39788
I20260709 12:09:03.409181  8251 raft_consensus.cc:493] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.409473  8251 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.414160  8251 raft_consensus.cc:515] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.417032  8251 leader_election.cc:290] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:03.417034  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:03.417675  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ef404be411470da8a08167b1d09fa4" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:03.418031  8322 raft_consensus.cc:3055] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:03.418215  8400 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.418354  8322 raft_consensus.cc:740] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:09:03.419193  8322 consensus_queue.cc:260] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.420418  8322 raft_consensus.cc:3060] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.425881  8400 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.427790  8214 leader_election.cc:304] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:03.428036  8322 raft_consensus.cc:2468] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.428776  8560 raft_consensus.cc:2804] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:03.429320  8560 raft_consensus.cc:697] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:03.430310  8560 consensus_queue.cc:237] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.437749  8149 catalog_manager.cc:5697] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 2 to 3, leader changed from 95a989810fcc42509a0b66089ec8daad (127.7.102.130) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.527544  8563 raft_consensus.cc:993] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.528055  8563 raft_consensus.cc:1081] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.529667  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39788
I20260709 12:09:03.530117  8251 raft_consensus.cc:493] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.530418  8251 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.535709  8251 raft_consensus.cc:515] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.537184  8251 leader_election.cc:290] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:03.538116  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:03.538486  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55588b10ef56468abace9cbc462b73b8" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:03.538684  8322 raft_consensus.cc:3055] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:03.538975  8400 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.538980  8322 raft_consensus.cc:740] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:09:03.539981  8322 consensus_queue.cc:260] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.541182  8322 raft_consensus.cc:3060] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.545545  8400 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.547156  8322 raft_consensus.cc:2468] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.551115  8214 leader_election.cc:304] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:03.552618  8560 raft_consensus.cc:2804] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:03.553166  8560 raft_consensus.cc:697] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:03.554244  8560 consensus_queue.cc:237] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.564366  8149 catalog_manager.cc:5697] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 2 to 3, leader changed from 95a989810fcc42509a0b66089ec8daad (127.7.102.130) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.716804  8562 raft_consensus.cc:993] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.717309  8562 raft_consensus.cc:1081] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.718744  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39786
I20260709 12:09:03.719239  8251 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.719537  8251 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:03.723932  8251 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.725504  8251 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 4 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:03.726666  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:03.726670  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:03.727335  8322 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:03.727399  8400 raft_consensus.cc:3055] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:03.727782  8400 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:09:03.728503  8400 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.729485  8400 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:03.732681  8322 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 4.
I20260709 12:09:03.733748  8214 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:03.734076  8400 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 4.
I20260709 12:09:03.734599  8560 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:03.735072  8560 raft_consensus.cc:697] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:03.735970  8560 consensus_queue.cc:237] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.743512  8149 catalog_manager.cc:5697] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 3 to 4, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 4 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.781816  8322 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.783179  8560 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.796572  8400 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.798193  8576 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:03.814193  8572 raft_consensus.cc:993] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: : Instructing follower bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.814888  8562 raft_consensus.cc:1081] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 LEADER]: Signalling peer bd8f4dca41784f4cb6c2f5b36bc4638c to start an election
I20260709 12:09:03.816335  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
 from {username='slave'} at 127.0.0.1:39786
I20260709 12:09:03.816793  8251 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.817106  8251 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.821229  8251 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.822631  8251 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Requested vote from peers 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:03.823501  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:03.823755  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:03.824056  8322 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.824219  8400 raft_consensus.cc:3055] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:03.824524  8400 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:09:03.825274  8400 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.826460  8400 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.830360  8322 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.831404  8214 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:03.832257  8576 raft_consensus.cc:2804] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:03.832718  8576 raft_consensus.cc:697] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Leader. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:03.833473  8400 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd8f4dca41784f4cb6c2f5b36bc4638c in term 3.
I20260709 12:09:03.833509  8576 consensus_queue.cc:237] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:03.841157  8147 catalog_manager.cc:5697] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c reported cstate change: term changed from 2 to 3, leader changed from abd80dda9ba24445831eb047beafc198 (127.7.102.131) to bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.884903  8322 raft_consensus.cc:1275] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.886351  8576 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.895464  8400 raft_consensus.cc:1275] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.897399  8564 consensus_queue.cc:1048] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:03.956887  8322 raft_consensus.cc:1275] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.958292  8564 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.969317  8400 raft_consensus.cc:1275] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.971247  8576 consensus_queue.cc:1048] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:04.268386  8322 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:04.269909  8564 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:04.280063  8400 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:04.282124  8576 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:04.445111  8322 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:04.446424  8576 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:04.457536  8400 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Refusing update from remote peer bd8f4dca41784f4cb6c2f5b36bc4638c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:04.459445  8564 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:06.394565  7578 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:06.395488  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.403550  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:09:06.404490  8251 raft_consensus.cc:606] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:09:06.407812  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:09:06.408408  8251 raft_consensus.cc:606] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Received request to transfer leadership to TS 95a989810fcc42509a0b66089ec8daad
I20260709 12:09:06.411136  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:09:06.411706  8251 raft_consensus.cc:606] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Received request to transfer leadership to TS abd80dda9ba24445831eb047beafc198
I20260709 12:09:06.413969  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
mode: GRACEFUL
new_leader_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:46538
I20260709 12:09:06.414361  8251 raft_consensus.cc:606] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 LEADER]: Received request to transfer leadership to TS abd80dda9ba24445831eb047beafc198
I20260709 12:09:06.415647  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:06.416141  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.524907  8592 raft_consensus.cc:993] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:09:06.525620  8590 raft_consensus.cc:1081] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Signalling peer abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:09:06.527594  8400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:53006
I20260709 12:09:06.528143  8400 raft_consensus.cc:493] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.528507  8400 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.534963  8400 raft_consensus.cc:515] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.537041  8400 leader_election.cc:290] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 4 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:09:06.538313  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:09:06.539047  8251 raft_consensus.cc:3055] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:06.538861  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808e6587d9d44dc8879000ace52dd706" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:06.539285  8251 raft_consensus.cc:740] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:06.539525  8322 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.540158  8251 consensus_queue.cc:260] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.541247  8251 raft_consensus.cc:3060] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.546248  8322 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 4.
I20260709 12:09:06.546469  8251 raft_consensus.cc:2468] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 4.
I20260709 12:09:06.548396  8363 leader_election.cc:304] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd80dda9ba24445831eb047beafc198, bd8f4dca41784f4cb6c2f5b36bc4638c; no voters: 
I20260709 12:09:06.549620  8562 raft_consensus.cc:2804] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:06.550927  8562 raft_consensus.cc:697] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 4 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:09:06.552100  8562 consensus_queue.cc:237] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.566776  8149 catalog_manager.cc:5697] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 3 to 4, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 4 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:06.717988  8592 raft_consensus.cc:993] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:09:06.718479  8590 raft_consensus.cc:1081] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 LEADER]: Signalling peer abd80dda9ba24445831eb047beafc198 to start an election
I20260709 12:09:06.720160  8398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2"
dest_uuid: "abd80dda9ba24445831eb047beafc198"
 from {username='slave'} at 127.0.0.1:53006
I20260709 12:09:06.720793  8398 raft_consensus.cc:493] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.721160  8398 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:06.727526  8398 raft_consensus.cc:515] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.729753  8398 leader_election.cc:290] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 5 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), 95a989810fcc42509a0b66089ec8daad (127.7.102.130:34837)
I20260709 12:09:06.730614  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:09:06.730764  8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd722edb4b8485a8e3f0cef763a0fa2" candidate_uuid: "abd80dda9ba24445831eb047beafc198" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "95a989810fcc42509a0b66089ec8daad"
I20260709 12:09:06.731285  8251 raft_consensus.cc:3055] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:06.731477  8322 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:06.731688  8251 raft_consensus.cc:740] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:06.732684  8251 consensus_queue.cc:260] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.733693  8251 raft_consensus.cc:3060] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:06.737146  8322 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 5.
I20260709 12:09:06.738279  8363 leader_election.cc:304] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:09:06.739125  8251 raft_consensus.cc:2468] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd80dda9ba24445831eb047beafc198 in term 5.
I20260709 12:09:06.739147  8562 raft_consensus.cc:2804] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:06.739856  8562 raft_consensus.cc:697] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 5 LEADER]: Becoming Leader. State: Replica: abd80dda9ba24445831eb047beafc198, State: Running, Role: LEADER
I20260709 12:09:06.740911  8562 consensus_queue.cc:237] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.748793  8149 catalog_manager.cc:5697] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 reported cstate change: term changed from 4 to 5, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to abd80dda9ba24445831eb047beafc198 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "abd80dda9ba24445831eb047beafc198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:06.753108  8591 raft_consensus.cc:993] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:09:06.753693  8590 raft_consensus.cc:1081] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:09:06.755810  8325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45172
I20260709 12:09:06.756413  8325 raft_consensus.cc:493] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.756847  8325 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.762861  8325 raft_consensus.cc:515] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.765394  8325 leader_election.cc:290] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 4 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:06.766021  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:09:06.766489  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9e1f0bed22414b92aafaa32953e4d1" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:06.766729  8251 raft_consensus.cc:3055] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:06.767066  8400 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.767092  8251 raft_consensus.cc:740] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:06.768251  8251 consensus_queue.cc:260] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.769279  8251 raft_consensus.cc:3060] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.772420  8400 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 4.
I20260709 12:09:06.773936  8289 leader_election.cc:304] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:09:06.774838  8563 raft_consensus.cc:2804] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:06.774824  8251 raft_consensus.cc:2468] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 4.
I20260709 12:09:06.776695  8563 raft_consensus.cc:697] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 4 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:09:06.777719  8563 consensus_queue.cc:237] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.785815  8149 catalog_manager.cc:5697] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 3 to 4, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 4 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:06.879441  8592 raft_consensus.cc:993] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: : Instructing follower 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:09:06.880096  8592 raft_consensus.cc:1081] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Signalling peer 95a989810fcc42509a0b66089ec8daad to start an election
I20260709 12:09:06.882016  8325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199"
dest_uuid: "95a989810fcc42509a0b66089ec8daad"
 from {username='slave'} at 127.0.0.1:45172
I20260709 12:09:06.882593  8325 raft_consensus.cc:493] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.882903  8325 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.887862  8325 raft_consensus.cc:515] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.889645  8325 leader_election.cc:290] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 3 election: Requested vote from peers bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487), abd80dda9ba24445831eb047beafc198 (127.7.102.131:35923)
I20260709 12:09:06.890875  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c"
I20260709 12:09:06.891098  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b195e78d8544d92b793e3172ae10199" candidate_uuid: "95a989810fcc42509a0b66089ec8daad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abd80dda9ba24445831eb047beafc198"
I20260709 12:09:06.891674  8400 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.891631  8251 raft_consensus.cc:3055] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:06.892165  8251 raft_consensus.cc:740] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd8f4dca41784f4cb6c2f5b36bc4638c, State: Running, Role: LEADER
I20260709 12:09:06.893079  8251 consensus_queue.cc:260] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.894397  8251 raft_consensus.cc:3060] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.900234  8400 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 3.
I20260709 12:09:06.901669  8289 leader_election.cc:304] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95a989810fcc42509a0b66089ec8daad, abd80dda9ba24445831eb047beafc198; no voters: 
I20260709 12:09:06.902047  8251 raft_consensus.cc:2468] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95a989810fcc42509a0b66089ec8daad in term 3.
I20260709 12:09:06.902637  8563 raft_consensus.cc:2804] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:06.903276  8563 raft_consensus.cc:697] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 3 LEADER]: Becoming Leader. State: Replica: 95a989810fcc42509a0b66089ec8daad, State: Running, Role: LEADER
I20260709 12:09:06.904192  8563 consensus_queue.cc:237] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } }
I20260709 12:09:06.911873  8149 catalog_manager.cc:5697] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad reported cstate change: term changed from 2 to 3, leader changed from bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129) to 95a989810fcc42509a0b66089ec8daad (127.7.102.130). New cstate: current_term: 3 leader_uuid: "95a989810fcc42509a0b66089ec8daad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:06.935478  8325 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:06.937041  8562 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:06.948575  8251 raft_consensus.cc:1275] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:06.950268  8562 consensus_queue.cc:1048] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:07.130527  8251 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 5 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:07.131934  8562 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:07.143675  8325 raft_consensus.cc:1275] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 5 FOLLOWER]: Refusing update from remote peer abd80dda9ba24445831eb047beafc198: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:07.145253  8606 consensus_queue.cc:1048] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a989810fcc42509a0b66089ec8daad" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:07.148252  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd440 after lost signal to thread 7581
W20260709 12:09:07.149353  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdb20 after lost signal to thread 8183
W20260709 12:09:07.150643  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0b20 after lost signal to thread 8275
W20260709 12:09:07.151458  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5cc0 after lost signal to thread 8350
W20260709 12:09:07.152258  8347 debug-util.cc:398] Leaking SignalData structure 0x7b080013ea80 after lost signal to thread 8424
I20260709 12:09:07.281736  8251 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:07.283386  8563 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:07.293951  8400 raft_consensus.cc:1275] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:07.295748  8563 consensus_queue.cc:1048] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:07.360697  8251 raft_consensus.cc:1275] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.361963  8601 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd8f4dca41784f4cb6c2f5b36bc4638c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.373059  8400 raft_consensus.cc:1275] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Refusing update from remote peer 95a989810fcc42509a0b66089ec8daad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.376436  8613 consensus_queue.cc:1048] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd80dda9ba24445831eb047beafc198" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:07.417318  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.423235  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.423720  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.505616  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.516533  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.534873  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:09.397841  8421 debug-util.cc:398] Leaking SignalData structure 0x7b08000b03a0 after lost signal to thread 7581
W20260709 12:09:09.398874  8421 debug-util.cc:398] Leaking SignalData structure 0x7b08000b15a0 after lost signal to thread 8183
W20260709 12:09:09.399916  8421 debug-util.cc:398] Leaking SignalData structure 0x7b080011ecc0 after lost signal to thread 8275
W20260709 12:09:09.400885  8421 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdde0 after lost signal to thread 8350
W20260709 12:09:09.401747  8421 debug-util.cc:398] Leaking SignalData structure 0x7b08000de920 after lost signal to thread 8424
I20260709 12:09:09.536141  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.545991  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.546629  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.689527  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.695209  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.695688  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:10.904280  8347 debug-util.cc:398] Leaking SignalData structure 0x7b080013e7e0 after lost signal to thread 7581
W20260709 12:09:10.905345  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7100 after lost signal to thread 8183
W20260709 12:09:10.906333  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd560 after lost signal to thread 8275
W20260709 12:09:10.907214  8347 debug-util.cc:398] Leaking SignalData structure 0x7b08000b72c0 after lost signal to thread 8350
W20260709 12:09:10.908054  8347 debug-util.cc:398] Leaking SignalData structure 0x7b080016c9a0 after lost signal to thread 8424
I20260709 12:09:11.696808  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.702169  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.702664  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.703828  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.709553  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.710096  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.711194  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.717010  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.717597  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.718614  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.729070  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.729609  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.730793  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:15.738459  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:15.739063  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:16.775267  7578 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:16.775923  7578 tablet_server.cc:179] TabletServer@127.7.102.129:0 shutting down...
I20260709 12:09:16.810508  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:16.811350  7578 tablet_replica.cc:333] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.812052  7578 raft_consensus.cc:2243] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.812706  7578 raft_consensus.cc:2272] T d25c7f5a5db94ac2ae8d853428346b27 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.814847  7578 tablet_replica.cc:333] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.815460  7578 raft_consensus.cc:2243] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.815910  7578 raft_consensus.cc:2272] T 808e6587d9d44dc8879000ace52dd706 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.817788  7578 tablet_replica.cc:333] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.818356  7578 raft_consensus.cc:2243] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.818832  7578 raft_consensus.cc:2272] T dcd722edb4b8485a8e3f0cef763a0fa2 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.820705  7578 tablet_replica.cc:333] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.821285  7578 raft_consensus.cc:2243] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.821738  7578 raft_consensus.cc:2272] T 7f9e1f0bed22414b92aafaa32953e4d1 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.823808  7578 tablet_replica.cc:333] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.824718  7578 raft_consensus.cc:2243] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.825984  7578 raft_consensus.cc:2272] T 55588b10ef56468abace9cbc462b73b8 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.828804  7578 tablet_replica.cc:333] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.829346  7578 raft_consensus.cc:2243] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.829891  7578 raft_consensus.cc:2272] T 8e0aee98b5484949a1592e18f630ceb0 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.831744  7578 tablet_replica.cc:333] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.832254  7578 raft_consensus.cc:2243] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.833084  7578 raft_consensus.cc:2272] T a6f9a4dab86b415399fc9fbe939839c4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.834894  7578 tablet_replica.cc:333] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.835402  7578 raft_consensus.cc:2243] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.836205  7578 raft_consensus.cc:2272] T cdb9f92f8f8d4e0588e326a871ac358f P bd8f4dca41784f4cb6c2f5b36bc4638c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.838104  7578 tablet_replica.cc:333] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.838603  7578 raft_consensus.cc:2243] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.839552  7578 raft_consensus.cc:2272] T 40ef404be411470da8a08167b1d09fa4 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.841370  7578 tablet_replica.cc:333] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c: stopping tablet replica
I20260709 12:09:16.841846  7578 raft_consensus.cc:2243] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.842312  7578 raft_consensus.cc:2272] T 2b195e78d8544d92b793e3172ae10199 P bd8f4dca41784f4cb6c2f5b36bc4638c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:16.859280  8363 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:09:16.866797  8363 consensus_peers.cc:597] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 -> Peer bd8f4dca41784f4cb6c2f5b36bc4638c (127.7.102.129:39487): Couldn't send request to peer bd8f4dca41784f4cb6c2f5b36bc4638c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:16.885550  7578 tablet_server.cc:196] TabletServer@127.7.102.129:0 shutdown complete.
I20260709 12:09:16.907359  7578 tablet_server.cc:179] TabletServer@127.7.102.130:0 shutting down...
I20260709 12:09:16.944396  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:16.945348  7578 tablet_replica.cc:333] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.946074  7578 raft_consensus.cc:2243] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.946677  7578 raft_consensus.cc:2272] T 808e6587d9d44dc8879000ace52dd706 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.949259  7578 tablet_replica.cc:333] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.949816  7578 raft_consensus.cc:2243] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.950332  7578 raft_consensus.cc:2272] T 40ef404be411470da8a08167b1d09fa4 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.952344  7578 tablet_replica.cc:333] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.952955  7578 raft_consensus.cc:2243] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.953872  7578 raft_consensus.cc:2272] T 8e0aee98b5484949a1592e18f630ceb0 P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.955746  7578 tablet_replica.cc:333] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.956276  7578 raft_consensus.cc:2243] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.956779  7578 raft_consensus.cc:2272] T cdb9f92f8f8d4e0588e326a871ac358f P 95a989810fcc42509a0b66089ec8daad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.958643  7578 tablet_replica.cc:333] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.959190  7578 raft_consensus.cc:2243] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.960080  7578 raft_consensus.cc:2272] T 2b195e78d8544d92b793e3172ae10199 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.961993  7578 tablet_replica.cc:333] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.962512  7578 raft_consensus.cc:2243] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.962956  7578 raft_consensus.cc:2272] T a6f9a4dab86b415399fc9fbe939839c4 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.964830  7578 tablet_replica.cc:333] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.965324  7578 raft_consensus.cc:2243] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.965896  7578 raft_consensus.cc:2272] T dcd722edb4b8485a8e3f0cef763a0fa2 P 95a989810fcc42509a0b66089ec8daad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.967662  7578 tablet_replica.cc:333] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.968160  7578 raft_consensus.cc:2243] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.968611  7578 raft_consensus.cc:2272] T 55588b10ef56468abace9cbc462b73b8 P 95a989810fcc42509a0b66089ec8daad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.970485  7578 tablet_replica.cc:333] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.971004  7578 raft_consensus.cc:2243] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.971906  7578 raft_consensus.cc:2272] T 7f9e1f0bed22414b92aafaa32953e4d1 P 95a989810fcc42509a0b66089ec8daad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.973865  7578 tablet_replica.cc:333] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad: stopping tablet replica
I20260709 12:09:16.974313  7578 raft_consensus.cc:2243] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.974817  7578 raft_consensus.cc:2272] T d25c7f5a5db94ac2ae8d853428346b27 P 95a989810fcc42509a0b66089ec8daad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.027861  7578 tablet_server.cc:196] TabletServer@127.7.102.130:0 shutdown complete.
I20260709 12:09:17.048377  7578 tablet_server.cc:179] TabletServer@127.7.102.131:0 shutting down...
I20260709 12:09:17.084362  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:17.085271  7578 tablet_replica.cc:333] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.086088  7578 raft_consensus.cc:2243] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:17.087113  7578 raft_consensus.cc:2272] T 808e6587d9d44dc8879000ace52dd706 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.089359  7578 tablet_replica.cc:333] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.090085  7578 raft_consensus.cc:2243] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.090613  7578 raft_consensus.cc:2272] T 2b195e78d8544d92b793e3172ae10199 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.092679  7578 tablet_replica.cc:333] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.093267  7578 raft_consensus.cc:2243] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.093765  7578 raft_consensus.cc:2272] T 40ef404be411470da8a08167b1d09fa4 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.095677  7578 tablet_replica.cc:333] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.096225  7578 raft_consensus.cc:2243] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:17.097149  7578 raft_consensus.cc:2272] T d25c7f5a5db94ac2ae8d853428346b27 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.098986  7578 tablet_replica.cc:333] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.099561  7578 raft_consensus.cc:2243] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.100059  7578 raft_consensus.cc:2272] T 7f9e1f0bed22414b92aafaa32953e4d1 P abd80dda9ba24445831eb047beafc198 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.101992  7578 tablet_replica.cc:333] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.102566  7578 raft_consensus.cc:2243] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:17.103474  7578 raft_consensus.cc:2272] T dcd722edb4b8485a8e3f0cef763a0fa2 P abd80dda9ba24445831eb047beafc198 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.105599  7578 tablet_replica.cc:333] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.106158  7578 raft_consensus.cc:2243] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.106667  7578 raft_consensus.cc:2272] T 55588b10ef56468abace9cbc462b73b8 P abd80dda9ba24445831eb047beafc198 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.108403  7578 tablet_replica.cc:333] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.108914  7578 raft_consensus.cc:2243] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.109356  7578 raft_consensus.cc:2272] T 8e0aee98b5484949a1592e18f630ceb0 P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.111109  7578 tablet_replica.cc:333] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.111611  7578 raft_consensus.cc:2243] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.112115  7578 raft_consensus.cc:2272] T cdb9f92f8f8d4e0588e326a871ac358f P abd80dda9ba24445831eb047beafc198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.113987  7578 tablet_replica.cc:333] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198: stopping tablet replica
I20260709 12:09:17.114477  7578 raft_consensus.cc:2243] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:17.114892  7578 raft_consensus.cc:2272] T a6f9a4dab86b415399fc9fbe939839c4 P abd80dda9ba24445831eb047beafc198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.165192  7578 tablet_server.cc:196] TabletServer@127.7.102.131:0 shutdown complete.
I20260709 12:09:17.191110  7578 master.cc:562] Master@127.7.102.190:40497 shutting down...
I20260709 12:09:17.217370  7578 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:17.218037  7578 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:17.218384  7578 tablet_replica.cc:333] T 00000000000000000000000000000000 P ce3af9ee8ce746ce8ecdadb9718092e3: stopping tablet replica
I20260709 12:09:17.238556  7578 master.cc:584] Master@127.7.102.190:40497 shutdown complete.
95a989810fcc42509a0b66089ec8daad  4
abd80dda9ba24445831eb047beafc198  1
bd8f4dca41784f4cb6c2f5b36bc4638c  5
95a989810fcc42509a0b66089ec8daad  4
abd80dda9ba24445831eb047beafc198  3
bd8f4dca41784f4cb6c2f5b36bc4638c  3
95a989810fcc42509a0b66089ec8daad  1
abd80dda9ba24445831eb047beafc198  1
bd8f4dca41784f4cb6c2f5b36bc4638c  8
95a989810fcc42509a0b66089ec8daad  3
abd80dda9ba24445831eb047beafc198  3
bd8f4dca41784f4cb6c2f5b36bc4638c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29343 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:17.286417  7578 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.102.190:46065
I20260709 12:09:17.287557  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:17.294476  8634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.294660  8633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.295063  8636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.297819  7578 server_base.cc:1061] running on GCE node
I20260709 12:09:17.299156  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:17.299348  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:17.299571  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598957299533 us; error 0 us; skew 500 ppm
I20260709 12:09:17.300172  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:17.303095  7578 webserver.cc:533] Webserver started at http://127.7.102.190:40907/ using document root <none> and password file <none>
I20260709 12:09:17.303727  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:17.303951  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:17.304257  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:17.305627  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/master-0-root/instance:
uuid: "11a02b83f2af4df69b08a1f984747bcd"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.310560  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:09:17.314509  8641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.315310  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:09:17.315636  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/master-0-root
uuid: "11a02b83f2af4df69b08a1f984747bcd"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.315964  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:17.334553  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:17.335979  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:17.381263  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.190:46065
I20260709 12:09:17.381412  8692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.190:46065 every 8 connection(s)
I20260709 12:09:17.385946  8693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.398273  8693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Bootstrap starting.
I20260709 12:09:17.403038  8693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.408023  8693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: No bootstrap required, opened a new log
I20260709 12:09:17.410460  8693 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER }
I20260709 12:09:17.410948  8693 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.411207  8693 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a02b83f2af4df69b08a1f984747bcd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.411867  8693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER }
I20260709 12:09:17.412366  8693 raft_consensus.cc:399] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:17.412585  8693 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:17.412936  8693 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.417313  8693 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER }
I20260709 12:09:17.417850  8693 leader_election.cc:304] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11a02b83f2af4df69b08a1f984747bcd; no voters: 
I20260709 12:09:17.419123  8693 leader_election.cc:290] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:17.419641  8696 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.421308  8696 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 1 LEADER]: Becoming Leader. State: Replica: 11a02b83f2af4df69b08a1f984747bcd, State: Running, Role: LEADER
I20260709 12:09:17.422266  8696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER }
I20260709 12:09:17.422850  8693 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:17.428372  8697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11a02b83f2af4df69b08a1f984747bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER } }
I20260709 12:09:17.428288  8698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11a02b83f2af4df69b08a1f984747bcd. Latest consensus state: current_term: 1 leader_uuid: "11a02b83f2af4df69b08a1f984747bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a02b83f2af4df69b08a1f984747bcd" member_type: VOTER } }
I20260709 12:09:17.429085  8697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:17.429224  8698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:17.434850  8704 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:17.442957  8704 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:17.444152  7578 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:17.453603  8704 catalog_manager.cc:1383] Generated new cluster ID: a923d3711bc041c0a8cd87eaf607e6de
I20260709 12:09:17.453925  8704 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:17.481087  8704 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:17.482401  8704 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:17.494632  8704 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Generated new TSK 0
I20260709 12:09:17.495270  8704 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:17.510790  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:17.517796  8714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.518325  8715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.521255  7578 server_base.cc:1061] running on GCE node
W20260709 12:09:17.521399  8717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.522611  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:17.522806  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:17.522931  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598957522920 us; error 0 us; skew 500 ppm
I20260709 12:09:17.523412  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:17.526007  7578 webserver.cc:533] Webserver started at http://127.7.102.129:36449/ using document root <none> and password file <none>
I20260709 12:09:17.526474  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:17.526631  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:17.526840  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:17.527963  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/instance:
uuid: "005ae7a1e140481db6cc04faeb268d9c"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.532460  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:09:17.536118  8722 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.537277  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:09:17.537753  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
uuid: "005ae7a1e140481db6cc04faeb268d9c"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.538187  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:17.549634  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:17.550985  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:17.552709  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:17.555269  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:17.555449  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.555622  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:17.555768  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.602969  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.129:39957
I20260709 12:09:17.603078  8784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.129:39957 every 8 connection(s)
I20260709 12:09:17.608764  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:17.620011  8790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.620745  8789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.623149  8792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.623700  7578 server_base.cc:1061] running on GCE node
I20260709 12:09:17.625043  8785 heartbeater.cc:344] Connected to a master server at 127.7.102.190:46065
I20260709 12:09:17.625232  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:09:17.625483  8785 heartbeater.cc:461] Registering TS with master...
W20260709 12:09:17.625491  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:17.625857  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598957625838 us; error 0 us; skew 500 ppm
I20260709 12:09:17.626636  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:17.626536  8785 heartbeater.cc:507] Master 127.7.102.190:46065 requested a full tablet report, sending...
I20260709 12:09:17.629338  8658 ts_manager.cc:194] Registered new tserver with Master: 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:17.629694  7578 webserver.cc:533] Webserver started at http://127.7.102.130:37223/ using document root <none> and password file <none>
I20260709 12:09:17.630298  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:17.630496  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:17.630787  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:17.631625  8658 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41782
I20260709 12:09:17.632035  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/instance:
uuid: "fd116b86a1e4445c994a361f776beba1"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.637293  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:09:17.640913  8797 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.641814  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:09:17.642149  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
uuid: "fd116b86a1e4445c994a361f776beba1"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.642431  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:17.657259  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:17.658476  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:17.659981  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:17.663406  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:17.663710  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.664009  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:17.664244  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.711220  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.130:34317
I20260709 12:09:17.711412  8859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.130:34317 every 8 connection(s)
I20260709 12:09:17.716351  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:17.724673  8863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:17.726723  8864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.730309  7578 server_base.cc:1061] running on GCE node
W20260709 12:09:17.730749  8866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:17.731662  8860 heartbeater.cc:344] Connected to a master server at 127.7.102.190:46065
I20260709 12:09:17.732151  8860 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:17.732445  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:17.732764  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:17.732993  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598957732971 us; error 0 us; skew 500 ppm
I20260709 12:09:17.733219  8860 heartbeater.cc:507] Master 127.7.102.190:46065 requested a full tablet report, sending...
I20260709 12:09:17.733855  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:17.736049  8658 ts_manager.cc:194] Registered new tserver with Master: fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:17.737257  7578 webserver.cc:533] Webserver started at http://127.7.102.131:45621/ using document root <none> and password file <none>
I20260709 12:09:17.737830  8658 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41796
I20260709 12:09:17.737835  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:17.738408  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:17.738736  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:17.740192  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/instance:
uuid: "61fbd5afaa194845917d5b1b04571378"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.745265  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:09:17.749038  8871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.750066  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:09:17.750437  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
uuid: "61fbd5afaa194845917d5b1b04571378"
format_stamp: "Formatted at 2026-07-09 12:09:17 on dist-test-slave-p7fg"
I20260709 12:09:17.750818  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:17.767725  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:17.769241  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:17.770972  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:17.773523  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:17.773787  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.774051  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:17.774240  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:17.820977  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.131:39537
I20260709 12:09:17.821085  8933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.131:39537 every 8 connection(s)
I20260709 12:09:17.836901  8934 heartbeater.cc:344] Connected to a master server at 127.7.102.190:46065
I20260709 12:09:17.837347  8934 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:17.838143  8934 heartbeater.cc:507] Master 127.7.102.190:46065 requested a full tablet report, sending...
I20260709 12:09:17.840605  8658 ts_manager.cc:194] Registered new tserver with Master: 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:17.840835  7578 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016227429s
I20260709 12:09:17.842584  8658 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41812
I20260709 12:09:17.869418  8658 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:17.875485  8658 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:18.083307  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:18.084180  8823 tablet_service.cc:1511] Processing CreateTablet for tablet d4932af0fd1f4f8097c506666a195b54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:18.085038  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff15d7fa845498ba3ccd1874ce63ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.085732  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4932af0fd1f4f8097c506666a195b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.088910  8824 tablet_service.cc:1511] Processing CreateTablet for tablet 7127014b11f244fc9da3cde4600ec6a6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:18.089427  8749 tablet_service.cc:1511] Processing CreateTablet for tablet 7127014b11f244fc9da3cde4600ec6a6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:18.090445  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7127014b11f244fc9da3cde4600ec6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.090721  8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7127014b11f244fc9da3cde4600ec6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.090332  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:18.091886  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff15d7fa845498ba3ccd1874ce63ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.097466  8822 tablet_service.cc:1511] Processing CreateTablet for tablet 5751232c878a452c84d5bd9127abfc1d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:18.097612  8748 tablet_service.cc:1511] Processing CreateTablet for tablet d4932af0fd1f4f8097c506666a195b54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:18.099016  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5751232c878a452c84d5bd9127abfc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.099268  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4932af0fd1f4f8097c506666a195b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.101856  8747 tablet_service.cc:1511] Processing CreateTablet for tablet 5751232c878a452c84d5bd9127abfc1d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:18.103256  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5751232c878a452c84d5bd9127abfc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.105358  8746 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:18.106923  8746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.108114  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 7127014b11f244fc9da3cde4600ec6a6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:18.109706  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7127014b11f244fc9da3cde4600ec6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.113966  8897 tablet_service.cc:1511] Processing CreateTablet for tablet d4932af0fd1f4f8097c506666a195b54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:18.114312  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:18.115527  8897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4932af0fd1f4f8097c506666a195b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.115824  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.117871  8745 tablet_service.cc:1511] Processing CreateTablet for tablet 93afd25256e34a3b902813af41f349c9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:18.118311  8896 tablet_service.cc:1511] Processing CreateTablet for tablet 5751232c878a452c84d5bd9127abfc1d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:18.119304  8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93afd25256e34a3b902813af41f349c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.120316  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5751232c878a452c84d5bd9127abfc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.121393  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:18.124858  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff15d7fa845498ba3ccd1874ce63ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.125774  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:18.127173  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4b3d74e26942a59cf5bdf2c24fcf1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.128526  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 93afd25256e34a3b902813af41f349c9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:18.130075  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93afd25256e34a3b902813af41f349c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.130506  8820 tablet_service.cc:1511] Processing CreateTablet for tablet 93afd25256e34a3b902813af41f349c9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:18.132192  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93afd25256e34a3b902813af41f349c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.144050  8893 tablet_service.cc:1511] Processing CreateTablet for tablet cfd13939e80e4c668025684b9dbc3f54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:18.145560  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd13939e80e4c668025684b9dbc3f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.150269  8744 tablet_service.cc:1511] Processing CreateTablet for tablet cfd13939e80e4c668025684b9dbc3f54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:18.151326  8892 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3efa45bd1e40c79e9873e78f82e8e6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:18.152722  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3efa45bd1e40c79e9873e78f82e8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.153314  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3efa45bd1e40c79e9873e78f82e8e6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:18.153856  8819 tablet_service.cc:1511] Processing CreateTablet for tablet cfd13939e80e4c668025684b9dbc3f54 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:18.155392  8819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd13939e80e4c668025684b9dbc3f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.155623  8742 tablet_service.cc:1511] Processing CreateTablet for tablet 63977b2ac46b48f0ba26c573aeeb69fc (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:18.155623  8818 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3efa45bd1e40c79e9873e78f82e8e6 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:18.157176  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3efa45bd1e40c79e9873e78f82e8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.151767  8744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd13939e80e4c668025684b9dbc3f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.161264  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63977b2ac46b48f0ba26c573aeeb69fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.161952  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3efa45bd1e40c79e9873e78f82e8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.208804  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 63977b2ac46b48f0ba26c573aeeb69fc (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:18.210791  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63977b2ac46b48f0ba26c573aeeb69fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.217568  8949 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:18.235085  8891 tablet_service.cc:1511] Processing CreateTablet for tablet 63977b2ac46b48f0ba26c573aeeb69fc (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:18.236573  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63977b2ac46b48f0ba26c573aeeb69fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.239033  8949 tablet_bootstrap.cc:654] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.245723  8951 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:18.273492  8950 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:18.273100  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 36d20759d6564b039af8cca0f84b0eb5 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:18.274695  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d20759d6564b039af8cca0f84b0eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.275816  8824 tablet_service.cc:1511] Processing CreateTablet for tablet 36d20759d6564b039af8cca0f84b0eb5 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:18.277256  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d20759d6564b039af8cca0f84b0eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.282518  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 92b5e15f0c384f1e8ed394830c71cd90 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:18.283987  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b5e15f0c384f1e8ed394830c71cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.289598  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 36d20759d6564b039af8cca0f84b0eb5 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:18.293272  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d20759d6564b039af8cca0f84b0eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.298779  8949 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:18.299279  8949 ts_tablet_manager.cc:1403] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.018s
I20260709 12:09:18.302302  8949 raft_consensus.cc:359] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:18.303035  8949 raft_consensus.cc:385] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.303351  8949 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.306222  8951 tablet_bootstrap.cc:654] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.307474  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 92b5e15f0c384f1e8ed394830c71cd90 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:18.308943  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b5e15f0c384f1e8ed394830c71cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.314280  8949 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:18.317174  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 92b5e15f0c384f1e8ed394830c71cd90 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:18.321966  8822 tablet_service.cc:1511] Processing CreateTablet for tablet d7cbe23065834283bc7d53543908a219 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:18.323395  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cbe23065834283bc7d53543908a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.323541  8951 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:18.329044  8951 ts_tablet_manager.cc:1403] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.084s	user 0.003s	sys 0.013s
I20260709 12:09:18.333109  8951 raft_consensus.cc:359] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.334227  8951 raft_consensus.cc:385] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.334537  8951 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.334600  8950 tablet_bootstrap.cc:654] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.340607  8894 tablet_service.cc:1511] Processing CreateTablet for tablet d7cbe23065834283bc7d53543908a219 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:18.344969  8748 tablet_service.cc:1511] Processing CreateTablet for tablet d7cbe23065834283bc7d53543908a219 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:18.345410  8747 tablet_service.cc:1511] Processing CreateTablet for tablet 4c57fe22a6bf47dca31c488f82e72a1f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:18.347071  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cbe23065834283bc7d53543908a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.347889  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c57fe22a6bf47dca31c488f82e72a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.356180  8785 heartbeater.cc:499] Master 127.7.102.190:46065 was elected leader, sending a full tablet report...
I20260709 12:09:18.356153  8951 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.366437  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 4c57fe22a6bf47dca31c488f82e72a1f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:18.367710  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cbe23065834283bc7d53543908a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.368008  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c57fe22a6bf47dca31c488f82e72a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.368999  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b5e15f0c384f1e8ed394830c71cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.369769  8949 ts_tablet_manager.cc:1434] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.070s	user 0.018s	sys 0.023s
I20260709 12:09:18.370774  8949 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:18.381100  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 4c57fe22a6bf47dca31c488f82e72a1f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:18.381873  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 16a04653cca743d0966d20df2225c35d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:18.382429  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c57fe22a6bf47dca31c488f82e72a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.383338  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a04653cca743d0966d20df2225c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.394017  8949 tablet_bootstrap.cc:654] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.396955  8824 tablet_service.cc:1511] Processing CreateTablet for tablet 16a04653cca743d0966d20df2225c35d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:18.398331  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a04653cca743d0966d20df2225c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.402969  8950 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:18.405067  8950 ts_tablet_manager.cc:1403] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.009s
I20260709 12:09:18.409406  8950 raft_consensus.cc:359] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.410378  8950 raft_consensus.cc:385] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.410720  8951 ts_tablet_manager.cc:1434] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.000s
I20260709 12:09:18.410760  8950 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.411736  8860 heartbeater.cc:499] Master 127.7.102.190:46065 was elected leader, sending a full tablet report...
I20260709 12:09:18.412241  8950 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.424726  8951 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:18.428921  8954 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.429666  8954 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:18.432016  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 16a04653cca743d0966d20df2225c35d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:18.437353  8951 tablet_bootstrap.cc:654] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.444124  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.444989  8934 heartbeater.cc:499] Master 127.7.102.190:46065 was elected leader, sending a full tablet report...
I20260709 12:09:18.440790  8954 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:18.457854  8949 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:18.458474  8949 ts_tablet_manager.cc:1403] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.023s
I20260709 12:09:18.459786  8950 ts_tablet_manager.cc:1434] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.005s
I20260709 12:09:18.461771  8949 raft_consensus.cc:359] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.463601  8821 tablet_service.cc:1511] Processing CreateTablet for tablet e45c621a9c684915a4c110e0801e4efa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:18.486686  8949 raft_consensus.cc:385] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.487100  8949 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.487417  8950 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:18.468906  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a04653cca743d0966d20df2225c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.468221  8894 tablet_service.cc:1511] Processing CreateTablet for tablet e45c621a9c684915a4c110e0801e4efa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:18.482892  8819 tablet_service.cc:1511] Processing CreateTablet for tablet 412fc8b910864ab39eda6a2eaa63b886 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:18.489533  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45c621a9c684915a4c110e0801e4efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.487896  8949 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.494837  8949 ts_tablet_manager.cc:1434] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:09:18.495924  8949 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:18.507918  8819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412fc8b910864ab39eda6a2eaa63b886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.509357  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45c621a9c684915a4c110e0801e4efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.512580  8949 tablet_bootstrap.cc:654] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.514408  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:18.516494  8725 leader_election.cc:343] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.525800  8951 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:18.526444  8951 ts_tablet_manager.cc:1403] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.016s
I20260709 12:09:18.531391  8748 tablet_service.cc:1511] Processing CreateTablet for tablet e45c621a9c684915a4c110e0801e4efa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:18.531891  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 412fc8b910864ab39eda6a2eaa63b886 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:18.533944  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45c621a9c684915a4c110e0801e4efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.535053  8951 raft_consensus.cc:359] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.537285  8951 raft_consensus.cc:385] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.537671  8951 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.538726  8951 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.541029  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412fc8b910864ab39eda6a2eaa63b886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.543767  8951 ts_tablet_manager.cc:1434] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:09:18.544559  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 412fc8b910864ab39eda6a2eaa63b886 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:18.545130  8951 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:18.546577  8950 tablet_bootstrap.cc:654] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.552017  8951 tablet_bootstrap.cc:654] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.555120  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:18.555996  8824 tablet_service.cc:1511] Processing CreateTablet for tablet a82912909b984cbb88197808b3d66347 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:18.557360  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82912909b984cbb88197808b3d66347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.557271  8747 tablet_service.cc:1511] Processing CreateTablet for tablet a82912909b984cbb88197808b3d66347 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:18.558583  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82912909b984cbb88197808b3d66347. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.565632  8724 leader_election.cc:343] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.566190  8724 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:18.567057  8954 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.573133  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412fc8b910864ab39eda6a2eaa63b886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.576675  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 6cda6b7a1dd54b79a208e39c8a0de491 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:18.576921  8895 tablet_service.cc:1511] Processing CreateTablet for tablet a82912909b984cbb88197808b3d66347 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:18.578117  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cda6b7a1dd54b79a208e39c8a0de491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.578585  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82912909b984cbb88197808b3d66347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.579670  8949 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:18.580287  8949 ts_tablet_manager.cc:1403] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.002s
I20260709 12:09:18.583570  8949 raft_consensus.cc:359] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.585125  8954 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.585628  8954 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.584334  8949 raft_consensus.cc:385] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.590472  8951 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:18.593683  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:18.594581  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 6cda6b7a1dd54b79a208e39c8a0de491 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:18.596050  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cda6b7a1dd54b79a208e39c8a0de491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.596122  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:18.591087  8951 ts_tablet_manager.cc:1403] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.005s
W20260709 12:09:18.597769  8725 leader_election.cc:343] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.599542  8724 leader_election.cc:343] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.590420  8954 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:18.591758  8949 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.601495  8949 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.602329  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:18.602989  8950 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:18.603708  8950 ts_tablet_manager.cc:1403] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.012s
I20260709 12:09:18.603868  8949 ts_tablet_manager.cc:1434] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:09:18.607193  8950 raft_consensus.cc:359] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.607999  8950 raft_consensus.cc:385] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.608299  8950 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.609177  8954 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.610569  8950 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.617726  8819 tablet_service.cc:1511] Processing CreateTablet for tablet 6cda6b7a1dd54b79a208e39c8a0de491 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:18.618865  8950 ts_tablet_manager.cc:1434] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:18.599937  8951 raft_consensus.cc:359] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:18.622189  8951 raft_consensus.cc:385] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.622627  8951 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.622871  8891 tablet_service.cc:1511] Processing CreateTablet for tablet ec2ab93c6c3448edaa2bb2569cfd970b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:18.623572  8951 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:18.624351  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2ab93c6c3448edaa2bb2569cfd970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.625849  8950 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:18.626861  8949 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:18.619375  8819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cda6b7a1dd54b79a208e39c8a0de491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.633675  8824 tablet_service.cc:1511] Processing CreateTablet for tablet ec2ab93c6c3448edaa2bb2569cfd970b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:18.633903  8750 tablet_service.cc:1511] Processing CreateTablet for tablet d70cbe0e284f4df0aca5c9f02140ce70 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:18.633675  8821 tablet_service.cc:1511] Processing CreateTablet for tablet d70cbe0e284f4df0aca5c9f02140ce70 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:18.635324  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70cbe0e284f4df0aca5c9f02140ce70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.641355  8748 tablet_service.cc:1511] Processing CreateTablet for tablet ec2ab93c6c3448edaa2bb2569cfd970b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:18.642199  8896 tablet_service.cc:1511] Processing CreateTablet for tablet d70cbe0e284f4df0aca5c9f02140ce70 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:18.642748  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2ab93c6c3448edaa2bb2569cfd970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.643469  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70cbe0e284f4df0aca5c9f02140ce70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.645226  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70cbe0e284f4df0aca5c9f02140ce70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.646740  8950 tablet_bootstrap.cc:654] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.634182  8951 ts_tablet_manager.cc:1434] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:09:18.648874  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2ab93c6c3448edaa2bb2569cfd970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.649386  8822 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbf5632da664f5c88b13382f86fbdfe (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:18.653405  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbf5632da664f5c88b13382f86fbdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.647334  8745 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbf5632da664f5c88b13382f86fbdfe (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:18.654598  8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbf5632da664f5c88b13382f86fbdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.653034  8744 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6a99f3fc34f97a6aead96582b77eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:18.657588  8744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6a99f3fc34f97a6aead96582b77eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.659159  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6a99f3fc34f97a6aead96582b77eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:18.660604  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6a99f3fc34f97a6aead96582b77eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.661512  8958 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.662057  8958 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.665764  8742 tablet_service.cc:1511] Processing CreateTablet for tablet 3d58802311724215aa71fccdaeca35f7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:18.667218  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d58802311724215aa71fccdaeca35f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.669520  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 3d58802311724215aa71fccdaeca35f7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:18.671247  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d58802311724215aa71fccdaeca35f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.673015  8956 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.673609  8956 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.678025  8820 tablet_service.cc:1511] Processing CreateTablet for tablet efe90059a90047969b785a597928a512 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:18.678346  8749 tablet_service.cc:1511] Processing CreateTablet for tablet efe90059a90047969b785a597928a512 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:18.679649  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe90059a90047969b785a597928a512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.679720  8951 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:18.683524  8746 tablet_service.cc:1511] Processing CreateTablet for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:18.683887  8956 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:18.686825  8892 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6a99f3fc34f97a6aead96582b77eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:18.688210  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6a99f3fc34f97a6aead96582b77eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.690842  8897 tablet_service.cc:1511] Processing CreateTablet for tablet 3d58802311724215aa71fccdaeca35f7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:18.692132  8897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d58802311724215aa71fccdaeca35f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.693406  8741 tablet_service.cc:1511] Processing CreateTablet for tablet 73c6f055a4f7416ab87d6ba45b619ef8 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:18.693641  8899 tablet_service.cc:1511] Processing CreateTablet for tablet efe90059a90047969b785a597928a512 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:18.694875  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe90059a90047969b785a597928a512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.697646  8893 tablet_service.cc:1511] Processing CreateTablet for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:18.697979  8958 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:18.699013  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.734563  8746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.741602  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbf5632da664f5c88b13382f86fbdfe (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:18.743212  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbf5632da664f5c88b13382f86fbdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.745205  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6f055a4f7416ab87d6ba45b619ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.748039  8743 tablet_service.cc:1511] Processing CreateTablet for tablet cac426ada8f6447ebc8beff698a38039 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:18.749517  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac426ada8f6447ebc8beff698a38039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.759368  8956 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.759969  8956 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.773306  8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe90059a90047969b785a597928a512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.784715  8949 tablet_bootstrap.cc:654] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.796345  8951 tablet_bootstrap.cc:654] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.815604  8896 tablet_service.cc:1511] Processing CreateTablet for tablet 73c6f055a4f7416ab87d6ba45b619ef8 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:18.817200  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6f055a4f7416ab87d6ba45b619ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.822094  8744 tablet_service.cc:1511] Processing CreateTablet for tablet 59b21cd8e1b445658842748734f3cc01 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:18.823999  8747 tablet_service.cc:1511] Processing CreateTablet for tablet ba96dc62a22549a6ab209325db961b36 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:18.825997  8894 tablet_service.cc:1511] Processing CreateTablet for tablet cac426ada8f6447ebc8beff698a38039 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:18.827649  8956 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:18.829481  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 59b21cd8e1b445658842748734f3cc01 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:18.831429  8741 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:18.833148  8895 tablet_service.cc:1511] Processing CreateTablet for tablet ba96dc62a22549a6ab209325db961b36 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:18.858294  8748 tablet_service.cc:1511] Processing CreateTablet for tablet a9173a010c254f6b9fac3f924e38f957 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:18.858552  8822 tablet_service.cc:1511] Processing CreateTablet for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:18.859910  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.856534  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac426ada8f6447ebc8beff698a38039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.860911  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b21cd8e1b445658842748734f3cc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.868928  8950 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:18.869656  8950 ts_tablet_manager.cc:1403] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.244s	user 0.040s	sys 0.050s
I20260709 12:09:18.871557  8958 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.872215  8958 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.875329  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba96dc62a22549a6ab209325db961b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.881457  8958 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:18.883438  8965 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.883930  8965 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.884390  8950 raft_consensus.cc:359] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.885111  8950 raft_consensus.cc:385] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.885412  8950 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.886317  8965 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:18.888082  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:18.889866  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:18.890508  8909 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
W20260709 12:09:18.892446  8725 leader_election.cc:343] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.895680  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:18.896207  8744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b21cd8e1b445658842748734f3cc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.898478  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cb41ea20c4484bfefd8f68fcdc475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.850633  8743 tablet_service.cc:1511] Processing CreateTablet for tablet f12377056e86440fb6f80fe02bb59fe1 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:18.901757  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12377056e86440fb6f80fe02bb59fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.901878  8817 tablet_service.cc:1511] Processing CreateTablet for tablet cac426ada8f6447ebc8beff698a38039 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:18.902294  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 59b21cd8e1b445658842748734f3cc01 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:18.902609  8820 tablet_service.cc:1511] Processing CreateTablet for tablet 73c6f055a4f7416ab87d6ba45b619ef8 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:18.903258  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac426ada8f6447ebc8beff698a38039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.903864  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6f055a4f7416ab87d6ba45b619ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.905241  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba96dc62a22549a6ab209325db961b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.905077  8818 tablet_service.cc:1511] Processing CreateTablet for tablet ba96dc62a22549a6ab209325db961b36 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:18.906508  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba96dc62a22549a6ab209325db961b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.915820  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9173a010c254f6b9fac3f924e38f957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.911197  8965 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.917514  8965 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.917914  8965 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.922063  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:18.922609  8745 tablet_service.cc:1511] Processing CreateTablet for tablet d9af31792ab541fbb5b308c83cf60c08 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:18.924019  8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9af31792ab541fbb5b308c83cf60c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.923835  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:18.925746  8798 leader_election.cc:343] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.926433  8798 leader_election.cc:343] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.932030  8816 tablet_service.cc:1511] Processing CreateTablet for tablet f12377056e86440fb6f80fe02bb59fe1 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:18.935997  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b21cd8e1b445658842748734f3cc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.936000  8750 tablet_service.cc:1511] Processing CreateTablet for tablet d0e4c6e5758d4fb18617b5b7c30cd334 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:18.941833  8816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12377056e86440fb6f80fe02bb59fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.950553  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:18.914393  8950 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:18.953449  8872 leader_election.cc:343] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.954941  8950 ts_tablet_manager.cc:1434] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 12:09:18.955750  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:18.957197  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:18.958221  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:18.957167  8891 tablet_service.cc:1511] Processing CreateTablet for tablet d9af31792ab541fbb5b308c83cf60c08 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:18.959129  8834 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
W20260709 12:09:18.961050  8874 leader_election.cc:343] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.961778  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:18.880301  8893 tablet_service.cc:1511] Processing CreateTablet for tablet f12377056e86440fb6f80fe02bb59fe1 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:18.962658  8958 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.967386  8958 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.967782  8958 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.970058  8965 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:18.971421  8759 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:18.975759  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:18.977264  8949 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:18.977783  8949 ts_tablet_manager.cc:1403] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.351s	user 0.020s	sys 0.033s
I20260709 12:09:18.978313  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e4c6e5758d4fb18617b5b7c30cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.979661  8951 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:18.938756  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:18.981290  8824 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:19.004823  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 23ed5434fbd54337b1b9a26153e96d0e (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:18.986441  8951 ts_tablet_manager.cc:1403] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.307s	user 0.012s	sys 0.006s
I20260709 12:09:18.989666  8949 raft_consensus.cc:359] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.006385  8949 raft_consensus.cc:385] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.006800  8949 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.007059  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:19.007735  8909 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.996842  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:18.998339  8821 tablet_service.cc:1511] Processing CreateTablet for tablet a9173a010c254f6b9fac3f924e38f957 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:18.999552  8956 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.005498  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cb41ea20c4484bfefd8f68fcdc475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.981976  8746 tablet_service.cc:1511] Processing CreateTablet for tablet 23ed5434fbd54337b1b9a26153e96d0e (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:18.995467  8958 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:19.011555  8725 leader_election.cc:343] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.010537  8956 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:19.013489  8951 raft_consensus.cc:359] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.024276  8951 raft_consensus.cc:385] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.024724  8951 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.024943  8956 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:19.012424  8746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ed5434fbd54337b1b9a26153e96d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.025724  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:19.026486  8834 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.026949  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:19.027632  8759 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:19.025744  8951 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.010226  8965 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:19.030400  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:19.037372  8909 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:19.037793  8956 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.038246  8956 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.038607  8956 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.038897  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:19.034705  8749 tablet_service.cc:1511] Processing CreateTablet for tablet 78cfd04e1cc248b9b904175f207f3f40 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:19.040807  8950 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:19.041342  8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cfd04e1cc248b9b904175f207f3f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.007802  8949 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.044263  8954 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.045632  8949 ts_tablet_manager.cc:1434] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 12:09:19.045642  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9173a010c254f6b9fac3f924e38f957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.046682  8949 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:19.046969  8956 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:19.051733  8897 tablet_service.cc:1511] Processing CreateTablet for tablet a9173a010c254f6b9fac3f924e38f957 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:19.053375  8949 tablet_bootstrap.cc:654] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.057163  8892 tablet_service.cc:1511] Processing CreateTablet for tablet d0e4c6e5758d4fb18617b5b7c30cd334 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:19.058506  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e4c6e5758d4fb18617b5b7c30cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.057163  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 23ed5434fbd54337b1b9a26153e96d0e (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:19.059638  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ed5434fbd54337b1b9a26153e96d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.065413  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9af31792ab541fbb5b308c83cf60c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.070847  8956 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:19.071677  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 78cfd04e1cc248b9b904175f207f3f40 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:19.073030  8951 ts_tablet_manager.cc:1434] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:09:19.073429  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12377056e86440fb6f80fe02bb59fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.074050  8951 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:19.077355  8975 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.077696  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cb41ea20c4484bfefd8f68fcdc475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.031831  8958 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:19.095032  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cfd04e1cc248b9b904175f207f3f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.096262  8741 tablet_service.cc:1511] Processing CreateTablet for tablet 4f78b2d2f5154e388ca8e35799e1afeb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:19.097747  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f78b2d2f5154e388ca8e35799e1afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.101207  8897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9173a010c254f6b9fac3f924e38f957. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.115190  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 84914.8us
W20260709 12:09:19.087986  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 112332us
I20260709 12:09:19.116981  8954 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:19.146741  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:19.147437  8760 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.147960  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:19.148975  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:19.149616  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:19.146754  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:19.154072  8820 tablet_service.cc:1511] Processing CreateTablet for tablet a047cca1ee434f14ac79b5f67b7aac73 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:19.134208  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:19.139418  8834 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:19.161000  8759 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.144356  8742 tablet_service.cc:1511] Processing CreateTablet for tablet a047cca1ee434f14ac79b5f67b7aac73 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:19.164189  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a047cca1ee434f14ac79b5f67b7aac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.154695  8909 raft_consensus.cc:2393] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:19.132231  8898 tablet_service.cc:1511] Processing CreateTablet for tablet a047cca1ee434f14ac79b5f67b7aac73 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:19.166126  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a047cca1ee434f14ac79b5f67b7aac73. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.170488  8799 leader_election.cc:343] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.134953  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 78cfd04e1cc248b9b904175f207f3f40 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:09:19.172428  8799 leader_election.cc:343] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.173170  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:19.159385  8760 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:19.159829  8954 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.125702  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ed5434fbd54337b1b9a26153e96d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.162853  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:19.177943  8975 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.178471  8975 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:19.179315  8975 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.184999  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a047cca1ee434f14ac79b5f67b7aac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.186543  8950 tablet_bootstrap.cc:654] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.156006  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 4f78b2d2f5154e388ca8e35799e1afeb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:19.190826  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f78b2d2f5154e388ca8e35799e1afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.190763  8747 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcd7668cd44a658ba674d10aa778d9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:19.192279  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcd7668cd44a658ba674d10aa778d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.161667  8896 tablet_service.cc:1511] Processing CreateTablet for tablet 4f78b2d2f5154e388ca8e35799e1afeb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:19.174467  8759 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:19.193943  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f78b2d2f5154e388ca8e35799e1afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.194927  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:19.196394  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcd7668cd44a658ba674d10aa778d9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:19.197446  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cfd04e1cc248b9b904175f207f3f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.197240  8819 tablet_service.cc:1511] Processing CreateTablet for tablet d9af31792ab541fbb5b308c83cf60c08 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:19.191848  8744 tablet_service.cc:1511] Processing CreateTablet for tablet 56a6b1a7ca5440f18f286ddd5e44afce (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:19.192651  8818 tablet_service.cc:1511] Processing CreateTablet for tablet d0e4c6e5758d4fb18617b5b7c30cd334 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:19.208321  8822 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcd7668cd44a658ba674d10aa778d9 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:19.207392  8956 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.217813  8956 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.218520  8956 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:19.222333  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50015us
W20260709 12:09:19.223206  8799 leader_election.cc:343] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.224291  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:19.224679  8956 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:19.225317  8956 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.225673  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:19.227102  8798 leader_election.cc:343] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.229964  8748 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce14b8d8c8a43d48b1570f033c4e64f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:19.231410  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce14b8d8c8a43d48b1570f033c4e64f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.239975  8861 tablet.cc:2406] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:19.243419  8893 tablet_service.cc:1511] Processing CreateTablet for tablet 56a6b1a7ca5440f18f286ddd5e44afce (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:19.244486  8819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9af31792ab541fbb5b308c83cf60c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.245577  8951 tablet_bootstrap.cc:654] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.245995  8744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a6b1a7ca5440f18f286ddd5e44afce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.246460  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e4c6e5758d4fb18617b5b7c30cd334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.248575  8949 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:19.249094  8949 ts_tablet_manager.cc:1403] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.203s	user 0.012s	sys 0.016s
I20260709 12:09:19.249771  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 12a516db16ef4c1bae0d02a9c8d29be4 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:19.207903  8976 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.253784  8976 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:19.253700  8745 tablet_service.cc:1511] Processing CreateTablet for tablet 12a516db16ef4c1bae0d02a9c8d29be4 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:19.249138  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcd7668cd44a658ba674d10aa778d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.267107  8958 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.255224  8976 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:19.267683  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a6b1a7ca5440f18f286ddd5e44afce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.255679  8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a516db16ef4c1bae0d02a9c8d29be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.272360  8958 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.281132  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 67e3054fb6044180b7de9b761b2ea05b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:19.282071  8958 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:19.283351  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:19.286661  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:19.287348  8759 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
W20260709 12:09:19.287577  8874 leader_election.cc:343] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.291182  8657 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.293560  8949 raft_consensus.cc:359] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.294370  8949 raft_consensus.cc:385] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.298492  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a516db16ef4c1bae0d02a9c8d29be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.304534  8658 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.310412  8824 tablet_service.cc:1511] Processing CreateTablet for tablet 56a6b1a7ca5440f18f286ddd5e44afce (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:19.311905  8824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a6b1a7ca5440f18f286ddd5e44afce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.324117  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 99799.4us
I20260709 12:09:19.326756  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcd7668cd44a658ba674d10aa778d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.327068  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce14b8d8c8a43d48b1570f033c4e64f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:19.328660  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce14b8d8c8a43d48b1570f033c4e64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.337636  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e3054fb6044180b7de9b761b2ea05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.345978  8821 tablet_service.cc:1511] Processing CreateTablet for tablet 12a516db16ef4c1bae0d02a9c8d29be4 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:19.349323  8821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a516db16ef4c1bae0d02a9c8d29be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.296563  8949 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.353240  8949 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.355003  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 431583fc4c754d42936c71ee0279ae80 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:19.355553  8816 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce14b8d8c8a43d48b1570f033c4e64f (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:19.355881  8892 tablet_service.cc:1511] Processing CreateTablet for tablet 67e3054fb6044180b7de9b761b2ea05b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:19.357937  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 67e3054fb6044180b7de9b761b2ea05b (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:19.358352  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:19.405385  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e3054fb6044180b7de9b761b2ea05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.408757  8958 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.409266  8958 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.409615  8958 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.414110  8950 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:19.414553  8950 ts_tablet_manager.cc:1403] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.386s	user 0.005s	sys 0.014s
I20260709 12:09:19.421793  8891 tablet_service.cc:1511] Processing CreateTablet for tablet d412a1e35a1a4f75b3628a5642ddd121 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:19.424732  8816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce14b8d8c8a43d48b1570f033c4e64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.457633  8749 tablet_service.cc:1511] Processing CreateTablet for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:09:19.458463  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.449355  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431583fc4c754d42936c71ee0279ae80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.439414  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 114121us
I20260709 12:09:19.452023  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e3054fb6044180b7de9b761b2ea05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.468367  8958 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.479072  8656 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.479666  8818 tablet_service.cc:1511] Processing CreateTablet for tablet d412a1e35a1a4f75b3628a5642ddd121 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:19.463016  8746 tablet_service.cc:1511] Processing CreateTablet for tablet d412a1e35a1a4f75b3628a5642ddd121 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:19.467437  8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ff6a40f13a4be9b4a05ca797f8fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.482044  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d412a1e35a1a4f75b3628a5642ddd121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.471338  8949 ts_tablet_manager.cc:1434] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.222s	user 0.008s	sys 0.000s
I20260709 12:09:19.473766  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:19.443450  8950 raft_consensus.cc:359] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:19.483616  8950 raft_consensus.cc:385] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.483883  8949 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:19.484074  8950 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.484797  8819 tablet_service.cc:1511] Processing CreateTablet for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:19.485314  8950 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
W20260709 12:09:19.486409  8799 leader_election.cc:343] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.486945  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:19.488656  8950 ts_tablet_manager.cc:1434] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.004s
I20260709 12:09:19.488090  8976 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.494787  8746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d412a1e35a1a4f75b3628a5642ddd121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.496179  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:19.496964  8759 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.497715  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:19.498495  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d412a1e35a1a4f75b3628a5642ddd121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.496407  8958 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:19.499118  8874 leader_election.cc:343] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.512527  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 431583fc4c754d42936c71ee0279ae80 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:19.515045  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431583fc4c754d42936c71ee0279ae80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.521849  8747 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecd2fc45134ac8a031c2a6f90284d7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:19.523599  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecd2fc45134ac8a031c2a6f90284d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.523301  8742 tablet_service.cc:1511] Processing CreateTablet for tablet 57327b790014487690d5754a4e058fae (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:19.524909  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57327b790014487690d5754a4e058fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.529670  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:19.531025  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ff6a40f13a4be9b4a05ca797f8fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.510742  8819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ff6a40f13a4be9b4a05ca797f8fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.554142  8741 tablet_service.cc:1511] Processing CreateTablet for tablet 01a81765aa0b4241bacb910d72fb71cb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:19.554612  8759 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:19.555665  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a81765aa0b4241bacb910d72fb71cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.556143  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:19.557745  8958 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.558328  8958 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:19.559288  8820 tablet_service.cc:1511] Processing CreateTablet for tablet 57327b790014487690d5754a4e058fae (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:19.561445  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57327b790014487690d5754a4e058fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.573889  8896 tablet_service.cc:1511] Processing CreateTablet for tablet 57327b790014487690d5754a4e058fae (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:19.575469  8896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57327b790014487690d5754a4e058fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.577731  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 01a81765aa0b4241bacb910d72fb71cb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:19.579129  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a81765aa0b4241bacb910d72fb71cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.578773  8897 tablet_service.cc:1511] Processing CreateTablet for tablet 0982edf61b2c41e6b7c3414f279d4f31 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:19.541867  8949 tablet_bootstrap.cc:654] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.542140  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecd2fc45134ac8a031c2a6f90284d7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:19.581266  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecd2fc45134ac8a031c2a6f90284d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.513789  8950 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:19.550856  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 431583fc4c754d42936c71ee0279ae80 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:19.580255  8897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0982edf61b2c41e6b7c3414f279d4f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.551345  8951 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:19.601222  8951 ts_tablet_manager.cc:1403] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.527s	user 0.043s	sys 0.025s
I20260709 12:09:19.616904  8975 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.618638  8954 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.624737  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431583fc4c754d42936c71ee0279ae80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.625402  8954 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.625876  8954 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.628942  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:19.630484  8954 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:19.631536  8725 leader_election.cc:343] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.631891  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:19.559283  8958 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.641273  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 01a81765aa0b4241bacb910d72fb71cb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:19.643345  8822 tablet_service.cc:1511] Processing CreateTablet for tablet 0982edf61b2c41e6b7c3414f279d4f31 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:19.643769  8745 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd6228ae6144924a1ddc7362f86742d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:19.604524  8951 raft_consensus.cc:359] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.670063  8893 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecd2fc45134ac8a031c2a6f90284d7 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:19.671679  8893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecd2fc45134ac8a031c2a6f90284d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.660378  8951 raft_consensus.cc:385] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.673585  8951 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.674925  8951 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.677449  8822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0982edf61b2c41e6b7c3414f279d4f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.678155  8951 ts_tablet_manager.cc:1434] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:09:19.679705  8951 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
W20260709 12:09:19.646018  8724 leader_election.cc:343] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.685137  8724 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:19.685156  8818 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd6228ae6144924a1ddc7362f86742d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:19.688927  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd6228ae6144924a1ddc7362f86742d (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:19.690138  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd6228ae6144924a1ddc7362f86742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.690855  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd6228ae6144924a1ddc7362f86742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.695304  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 0982edf61b2c41e6b7c3414f279d4f31 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:19.699795  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a81765aa0b4241bacb910d72fb71cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.717713  8954 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.720916  8725 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.725240  8951 tablet_bootstrap.cc:654] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.664435  8950 tablet_bootstrap.cc:654] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.741525  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0982edf61b2c41e6b7c3414f279d4f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.743484  8976 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.780046  8818 tablet_service.cc:1511] Processing CreateTablet for tablet c18b8defabce4ce7a420d8548c885e28 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:19.781481  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18b8defabce4ce7a420d8548c885e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.785293  8975 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.786566  8892 tablet_service.cc:1511] Processing CreateTablet for tablet c18b8defabce4ce7a420d8548c885e28 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:19.787029  8949 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:19.787650  8949 ts_tablet_manager.cc:1403] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.304s	user 0.007s	sys 0.008s
I20260709 12:09:19.790736  8949 raft_consensus.cc:359] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.791554  8949 raft_consensus.cc:385] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.791848  8949 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.792765  8949 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.794866  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18b8defabce4ce7a420d8548c885e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.803308  8949 ts_tablet_manager.cc:1434] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:19.823978  8975 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.824798  8975 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } }
I20260709 12:09:19.828852  8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd6228ae6144924a1ddc7362f86742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.831439  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:19.834792  8975 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:19.837819  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:19.840133  8872 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:19.841272  8975 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.843241  8949 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:19.883419  8951 tablet_bootstrap.cc:492] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:19.883013  8894 tablet_service.cc:1511] Processing CreateTablet for tablet 93fd9eae511442cda809efae9c60a8dd (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:19.883980  8951 ts_tablet_manager.cc:1403] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.205s	user 0.023s	sys 0.024s
I20260709 12:09:19.884495  8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fd9eae511442cda809efae9c60a8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.885764  8890 tablet_service.cc:1511] Processing CreateTablet for tablet a342b86867884bfaa83a903e1502daaa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:19.887358  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a342b86867884bfaa83a903e1502daaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.889828  8949 tablet_bootstrap.cc:654] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.906793  8891 tablet_service.cc:1511] Processing CreateTablet for tablet 2947e409c3964d228748bbb8d2e40832 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:19.908324  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2947e409c3964d228748bbb8d2e40832. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.909194  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 264602us
I20260709 12:09:19.913823  8818 tablet_service.cc:1511] Processing CreateTablet for tablet 93fd9eae511442cda809efae9c60a8dd (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:19.914906  8909 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.915570  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fd9eae511442cda809efae9c60a8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.917707  8750 tablet_service.cc:1511] Processing CreateTablet for tablet c18b8defabce4ce7a420d8548c885e28 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:19.919039  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18b8defabce4ce7a420d8548c885e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.944130  8744 tablet_service.cc:1511] Processing CreateTablet for tablet 93fd9eae511442cda809efae9c60a8dd (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:19.945605  8950 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:19.945761  8744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fd9eae511442cda809efae9c60a8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.946228  8950 ts_tablet_manager.cc:1403] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.440s	user 0.012s	sys 0.019s
I20260709 12:09:19.949848  8950 raft_consensus.cc:359] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:19.952708  8750 tablet_service.cc:1511] Processing CreateTablet for tablet a342b86867884bfaa83a903e1502daaa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:19.950670  8950 raft_consensus.cc:385] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.899547  8825 tablet_service.cc:1511] Processing CreateTablet for tablet a342b86867884bfaa83a903e1502daaa (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:19.960111  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a342b86867884bfaa83a903e1502daaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.970057  8747 tablet_service.cc:1511] Processing CreateTablet for tablet 2947e409c3964d228748bbb8d2e40832 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:19.954869  8950 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.973569  8741 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea14ea70b8b462ca548019b513f4211 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:19.978416  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea14ea70b8b462ca548019b513f4211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.993203  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a342b86867884bfaa83a903e1502daaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.999965  8988 log.cc:927] Time spent T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.130s	user 0.003s	sys 0.002s
I20260709 12:09:19.994521  8816 tablet_service.cc:1511] Processing CreateTablet for tablet 2947e409c3964d228748bbb8d2e40832 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:20.007141  8816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2947e409c3964d228748bbb8d2e40832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.932265  8951 raft_consensus.cc:359] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.014074  8951 raft_consensus.cc:385] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.038199  8820 tablet_service.cc:1511] Processing CreateTablet for tablet 10825d3a2b3b4d21bb372d5172d112eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:20.027740  8951 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.039700  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10825d3a2b3b4d21bb372d5172d112eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.040407  8951 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.041567  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea14ea70b8b462ca548019b513f4211 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:20.042959  8951 ts_tablet_manager.cc:1434] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.003s
I20260709 12:09:20.043217  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea14ea70b8b462ca548019b513f4211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.043597  8742 tablet_service.cc:1511] Processing CreateTablet for tablet 10825d3a2b3b4d21bb372d5172d112eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:20.036520  8892 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea14ea70b8b462ca548019b513f4211 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:20.046742  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea14ea70b8b462ca548019b513f4211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.047425  8997 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.022306  8950 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.032065  8747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2947e409c3964d228748bbb8d2e40832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.081632  8990 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.057986  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 10825d3a2b3b4d21bb372d5172d112eb (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:20.082247  8990 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.083336  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10825d3a2b3b4d21bb372d5172d112eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.058053  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10825d3a2b3b4d21bb372d5172d112eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.099501  8982 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.100098  8982 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.102391  8982 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.103960  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.104316  8951 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.104746  8950 ts_tablet_manager.cc:1434] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.158s	user 0.014s	sys 0.006s
I20260709 12:09:20.105456  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.105917  8950 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
W20260709 12:09:20.107205  8799 leader_election.cc:343] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.108316  8798 leader_election.cc:343] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.108817  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.110385  8990 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.111028  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.111761  8835 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.113255  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:20.114790  8724 leader_election.cc:343] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.115612  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.116916  8982 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.117731  8990 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.118216  8990 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.118575  8990 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.119889  8949 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.120427  8949 ts_tablet_manager.cc:1403] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.278s	user 0.017s	sys 0.022s
I20260709 12:09:20.123646  8949 raft_consensus.cc:359] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.124436  8949 raft_consensus.cc:385] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.135053  8949 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.149379  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 883fe3a6d9a747ed8f95a683702eb669 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:20.151005  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883fe3a6d9a747ed8f95a683702eb669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.152927  8823 tablet_service.cc:1511] Processing CreateTablet for tablet 883fe3a6d9a747ed8f95a683702eb669 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:20.154590  8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883fe3a6d9a747ed8f95a683702eb669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.155364  8949 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.164323  8898 tablet_service.cc:1511] Processing CreateTablet for tablet 883fe3a6d9a747ed8f95a683702eb669 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:20.166043  8898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883fe3a6d9a747ed8f95a683702eb669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.167626  8951 tablet_bootstrap.cc:654] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.182891  8749 tablet_service.cc:1511] Processing CreateTablet for tablet 6479206f1d4545ec83633cfa7a99b648 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:20.184333  8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479206f1d4545ec83633cfa7a99b648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.185614  8949 ts_tablet_manager.cc:1434] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.003s
I20260709 12:09:20.186748  8949 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.191294  8990 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.192188  8818 tablet_service.cc:1511] Processing CreateTablet for tablet 6479206f1d4545ec83633cfa7a99b648 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:20.193588  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479206f1d4545ec83633cfa7a99b648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.199857  8895 tablet_service.cc:1511] Processing CreateTablet for tablet 6479206f1d4545ec83633cfa7a99b648 (DEFAULT_TABLE table=test-workload [id=ec8fe22733c840e299e729aec5181346]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:20.201131  8895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479206f1d4545ec83633cfa7a99b648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.212316  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:20.213056  8834 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.215368  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:09:20.217036  8724 leader_election.cc:343] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.213032  8990 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.221208  8949 tablet_bootstrap.cc:654] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.210048  8950 tablet_bootstrap.cc:654] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.246232  8975 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.240010  8657 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.255653  8951 tablet_bootstrap.cc:492] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.256172  8951 ts_tablet_manager.cc:1403] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.002s
I20260709 12:09:20.241573  8834 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.269866  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.271953  8835 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.276834  8990 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.277469  8990 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:20.278558  8990 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.284865  8951 raft_consensus.cc:359] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.285959  8951 raft_consensus.cc:385] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.286403  8951 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.295217  8975 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.295842  8975 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.297622  8982 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.298110  8982 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.301045  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.301728  8759 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:20.302716  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.303066  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:20.303900  8958 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.304253  8958 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.304574  8958 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.305428  8982 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.308873  8951 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.312120  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.313827  8799 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.316130  8975 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:20.316784  8975 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.320497  8949 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.321058  8949 ts_tablet_manager.cc:1403] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.045s
I20260709 12:09:20.321676  8982 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:20.323365  8949 raft_consensus.cc:359] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.323940  8949 raft_consensus.cc:385] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.324267  8949 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.323820  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.325263  8834 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:20.325122  8949 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.327134  8951 ts_tablet_manager.cc:1434] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:09:20.327576  8949 ts_tablet_manager.cc:1434] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:20.328250  8951 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.328661  8949 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.327631  8958 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.335001  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:20.335670  8949 tablet_bootstrap.cc:654] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.335615  8758 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.337654  8958 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:20.343376  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:20.344163  8656 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.345223  8758 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:20.351200  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:20.345820  8834 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.353451  8975 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.359241  8951 tablet_bootstrap.cc:654] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.348522  8950 tablet_bootstrap.cc:492] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.360278  8834 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:20.360687  8950 ts_tablet_manager.cc:1403] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.007s
I20260709 12:09:20.376209  8975 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:20.377291  8975 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.386806  8949 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.387012  8951 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.387405  8949 ts_tablet_manager.cc:1403] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.014s
I20260709 12:09:20.387590  8951 ts_tablet_manager.cc:1403] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.004s
I20260709 12:09:20.389976  8950 raft_consensus.cc:359] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.392836  8950 raft_consensus.cc:385] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.393198  8950 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.390393  8951 raft_consensus.cc:359] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.390749  8949 raft_consensus.cc:359] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.394002  8951 raft_consensus.cc:385] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.394224  8949 raft_consensus.cc:385] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.394443  8951 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.394842  8949 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.395851  8951 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.395988  8949 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.398301  8951 ts_tablet_manager.cc:1434] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:09:20.393951  8950 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.399261  8951 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.399902  8949 ts_tablet_manager.cc:1434] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:09:20.402405  8949 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.402899  8658 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.401304  8950 ts_tablet_manager.cc:1434] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:09:20.404892  8950 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.417572  8950 tablet_bootstrap.cc:654] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.409997  8949 tablet_bootstrap.cc:654] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.426105  8951 tablet_bootstrap.cc:654] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.433282  8949 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.433686  8950 tablet_bootstrap.cc:492] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.433817  8949 ts_tablet_manager.cc:1403] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 12:09:20.434389  8950 ts_tablet_manager.cc:1403] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.002s
I20260709 12:09:20.436302  8949 raft_consensus.cc:359] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.437014  8949 raft_consensus.cc:385] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.437407  8949 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.438086  8949 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.439432  8951 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.439954  8951 ts_tablet_manager.cc:1403] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:09:20.439981  8949 ts_tablet_manager.cc:1434] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:09:20.441839  8950 raft_consensus.cc:359] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.442657  8950 raft_consensus.cc:385] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.442950  8950 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.443362  8951 raft_consensus.cc:359] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.444169  8951 raft_consensus.cc:385] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.443785  8950 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.444461  8951 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.445361  8951 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.446314  8950 ts_tablet_manager.cc:1434] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:09:20.446959  8990 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.447345  8950 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.447389  8990 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.450762  8990 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.452772  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.454236  8950 tablet_bootstrap.cc:654] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.455799  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:20.457280  8724 leader_election.cc:343] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.458228  8725 leader_election.cc:343] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.458662  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:20.460358  9003 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.465538  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.469867  8949 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.478088  8949 tablet_bootstrap.cc:654] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.486023  8951 ts_tablet_manager.cc:1434] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:09:20.487694  8835 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.495400  8951 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.503155  8951 tablet_bootstrap.cc:654] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.516580  8950 tablet_bootstrap.cc:492] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.516886  8949 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.517133  8950 ts_tablet_manager.cc:1403] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.043s
I20260709 12:09:20.517450  8949 ts_tablet_manager.cc:1403] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.017s
I20260709 12:09:20.520198  8950 raft_consensus.cc:359] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.520977  8950 raft_consensus.cc:385] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.520466  8949 raft_consensus.cc:359] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.521297  8950 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.521468  8949 raft_consensus.cc:385] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.521836  8949 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.522087  8950 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.523273  8949 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.526317  8951 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.526818  8951 ts_tablet_manager.cc:1403] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:09:20.527480  8950 ts_tablet_manager.cc:1434] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:09:20.528577  8950 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.529563  8951 raft_consensus.cc:359] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.530297  8951 raft_consensus.cc:385] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.530580  8951 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.531316  8951 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.533810  8949 ts_tablet_manager.cc:1434] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:20.535068  8950 tablet_bootstrap.cc:654] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.536118  8951 ts_tablet_manager.cc:1434] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:20.537185  8951 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.536188  8949 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.549571  8951 tablet_bootstrap.cc:654] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.550717  8949 tablet_bootstrap.cc:654] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.567001  8951 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.567536  8951 ts_tablet_manager.cc:1403] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 12:09:20.567622  8949 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.568272  8949 ts_tablet_manager.cc:1403] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 12:09:20.570840  8951 raft_consensus.cc:359] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.571137  8949 raft_consensus.cc:359] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.571660  8951 raft_consensus.cc:385] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.571794  8949 raft_consensus.cc:385] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.572144  8949 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.572022  8951 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.573066  8949 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.573338  8951 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.575228  8950 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.575814  8950 ts_tablet_manager.cc:1403] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.010s
I20260709 12:09:20.576964  8990 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.577467  8990 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.578951  8950 raft_consensus.cc:359] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.579684  8950 raft_consensus.cc:385] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.580008  8950 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.580790  8950 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.581746  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.581782  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.582806  8951 ts_tablet_manager.cc:1434] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:20.582796  8835 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.584225  8990 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.584124  8725 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.585558  8950 ts_tablet_manager.cc:1434] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:20.586122  8990 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.586625  8950 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.586874  8990 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.586966  9015 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.587280  8990 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.583909  8909 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.588527  8951 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.588904  8949 ts_tablet_manager.cc:1434] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:09:20.587689  9015 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.590327  8949 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.596662  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.598966  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.599790  8835 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:20.601011  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:20.594914  9015 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:20.601941  8975 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.610019  8975 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.613317  8990 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.616415  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:20.617090  8835 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.619390  9003 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.619868  9003 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.622102  9003 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.624186  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.624209  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.625275  8990 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.628365  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:20.626587  8835 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:09:20.628937  8724 leader_election.cc:343] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.629182  8907 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.629886  8725 leader_election.cc:343] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.630340  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:20.631623  8725 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.632383  9003 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.632472  8990 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.633116  8990 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:20.634061  8990 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.638976  8950 tablet_bootstrap.cc:654] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.641463  8907 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.643011  8949 tablet_bootstrap.cc:654] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.643234  8951 tablet_bootstrap.cc:654] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.653286  8950 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.653975  8950 ts_tablet_manager.cc:1403] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.007s
I20260709 12:09:20.658020  8950 raft_consensus.cc:359] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.658969  8950 raft_consensus.cc:385] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.659312  8950 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.660221  8950 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.661363  8655 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.663014  8950 ts_tablet_manager.cc:1434] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:09:20.664152  8950 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.670708  8950 tablet_bootstrap.cc:654] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.679466  8990 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.679769  8951 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.680361  8951 ts_tablet_manager.cc:1403] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.002s
I20260709 12:09:20.680078  8990 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.682487  8990 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.683312  8951 raft_consensus.cc:359] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.684051  8951 raft_consensus.cc:385] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.684347  8951 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.684859  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.685199  8951 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.685799  8907 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.688081  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:20.689216  8990 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.689654  8990 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.689698  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.690148  8990 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.690663  8835 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.698210  8990 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.699268  8949 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.699998  8949 ts_tablet_manager.cc:1403] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.016s
I20260709 12:09:20.700290  8951 ts_tablet_manager.cc:1434] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:09:20.701341  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:20.702167  8835 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.709507  8990 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.710637  8951 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.711417  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:20.712256  8907 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.719520  8950 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.720146  8950 ts_tablet_manager.cc:1403] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.056s	user 0.040s	sys 0.012s
I20260709 12:09:20.721721  8907 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.722740  8949 raft_consensus.cc:359] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.723101  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:20.723613  8835 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.724450  8951 tablet_bootstrap.cc:654] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.724512  8990 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.725215  8990 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:20.726471  8949 raft_consensus.cc:385] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.726146  8990 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.726843  8949 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.727787  8949 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.730242  8949 ts_tablet_manager.cc:1434] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:09:20.731288  8949 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.730967  8950 raft_consensus.cc:359] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.731946  8950 raft_consensus.cc:385] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.732283  8950 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.735005  8950 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.737970  8997 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.737510  8950 ts_tablet_manager.cc:1434] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 12:09:20.738523  8997 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.743672  8997 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.747005  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.747820  8760 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.749203  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.749586  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.750206  8997 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.751147  8997 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.751586  8997 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.750232  8907 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.754026  9003 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.754875  9003 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.758244  9003 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.759593  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.760330  8835 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.761485  8951 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.761705  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.762042  8951 ts_tablet_manager.cc:1403] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.019s
I20260709 12:09:20.762863  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.763561  8907 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.764727  9003 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.763098  8949 tablet_bootstrap.cc:654] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.765110  9003 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.765108  8951 raft_consensus.cc:359] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.765748  9003 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.766017  8951 raft_consensus.cc:385] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.766300  8951 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.767059  8951 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.767751  8976 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.768239  8976 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.770453  8976 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.754377  8950 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.772830  8951 ts_tablet_manager.cc:1434] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:09:20.773936  8951 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.773934  9003 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.777653  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:20.778263  8950 tablet_bootstrap.cc:654] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.778352  8907 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.781420  8951 tablet_bootstrap.cc:654] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.781698  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:20.783752  8799 leader_election.cc:343] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.785960  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:20.786710  8835 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.787696  8907 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.788808  9003 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.790608  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:20.791898  9003 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.797366  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.798138  8760 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.799536  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.799976  9003 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:20.800482  8976 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.800917  8976 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.801252  8976 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.801481  9003 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.806515  8949 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.807199  8949 ts_tablet_manager.cc:1403] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.005s
I20260709 12:09:20.811671  8950 tablet_bootstrap.cc:492] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.811120  8949 raft_consensus.cc:359] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.812206  8950 ts_tablet_manager.cc:1403] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.003s
I20260709 12:09:20.812219  8949 raft_consensus.cc:385] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.813970  8949 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.814572  8949 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.816286  8976 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.816958  8951 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.817432  8951 ts_tablet_manager.cc:1403] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.016s
I20260709 12:09:20.818912  8949 ts_tablet_manager.cc:1434] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:09:20.820356  8949 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.820511  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:20.821686  8760 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.822649  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:09:20.824183  8799 leader_election.cc:343] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.825922  8976 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.825455  8950 raft_consensus.cc:359] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.827525  8950 raft_consensus.cc:385] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.827910  8950 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.830780  8760 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:20.830897  8951 raft_consensus.cc:359] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.831727  8951 raft_consensus.cc:385] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.831336  8997 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.832082  8951 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.832261  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:20.819411  8835 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:20.832890  8951 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.834057  8950 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.818684  8655 catalog_manager.cc:5697] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.836398  8950 ts_tablet_manager.cc:1434] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:20.836953  8982 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.837145  8949 tablet_bootstrap.cc:654] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.838857  8950 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:20.841682  8951 ts_tablet_manager.cc:1434] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.007s
I20260709 12:09:20.842999  8951 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.846506  8976 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.847112  8976 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.847543  9003 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.853387  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.854270  8909 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.856101  8951 tablet_bootstrap.cc:654] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.856621  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.858376  8950 tablet_bootstrap.cc:654] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.859356  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.860105  8760 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.861466  9041 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.861923  9041 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.862289  9041 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.863740  8997 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.864775  8982 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:20.865754  8982 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.866375  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:20.866992  8758 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.877754  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:20.879519  8909 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.878750  8976 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.898093  8975 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.901443  8909 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:20.903796  8799 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.891932  8982 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.904886  8997 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.905444  8997 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:20.898584  8655 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.905400  8758 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:20.906528  8997 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.908878  8949 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:20.909363  8949 ts_tablet_manager.cc:1403] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.004s
I20260709 12:09:20.909446  9003 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.904769  8982 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.912590  8949 raft_consensus.cc:359] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.913602  8949 raft_consensus.cc:385] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.913942  8949 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.914716  8949 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.915954  8982 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.917472  8949 ts_tablet_manager.cc:1434] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:09:20.920272  8949 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:20.920087  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.925477  8951 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:20.926116  8951 ts_tablet_manager.cc:1403] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.003s
I20260709 12:09:20.927037  9003 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.927731  8760 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:20.927553  9003 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.929150  8798 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.929939  9003 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:20.933949  8950 tablet_bootstrap.cc:492] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:20.934588  8950 ts_tablet_manager.cc:1403] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.016s
I20260709 12:09:20.933854  8982 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.934223  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.927556  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:20.938472  8975 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.939914  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.938591  8982 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.954344  8951 raft_consensus.cc:359] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.955013  8951 raft_consensus.cc:385] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.955252  8951 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.956130  8951 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.930783  8657 catalog_manager.cc:5697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.953541  8982 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.951486  8834 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:20.963750  8951 ts_tablet_manager.cc:1434] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 12:09:20.964988  8951 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:20.949572  8975 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.970799  8725 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.972882  8990 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.973932  8990 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.974442  8990 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.972927  8906 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
W20260709 12:09:20.983389  8799 leader_election.cc:343] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.984406  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:20.985196  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:20.985244  8834 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:20.988099  8874 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:20.991371  8990 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:20.993285  8760 raft_consensus.cc:2393] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:20.993865  8975 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.004856  9015 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.005285  9015 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.005635  9015 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.030841  8982 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.049546  8950 raft_consensus.cc:359] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.051317  8950 raft_consensus.cc:385] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.051606  8950 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.052407  8950 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.054447  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:21.055382  8834 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.054620  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.056303  8760 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.056855  8982 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.061931  8950 ts_tablet_manager.cc:1434] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.127s	user 0.003s	sys 0.004s
W20260709 12:09:21.050349  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62338.7us
I20260709 12:09:21.072240  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:21.070127  8990 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.087077  9052 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:21.089944  8950 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.103672  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:21.104909  8949 tablet_bootstrap.cc:654] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.108165  8799 leader_election.cc:343] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.114277  8834 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:21.135857  9015 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.137740  8907 raft_consensus.cc:2393] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:21.141742  8725 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.140342  8760 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:21.144248  9056 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.144747  9056 raft_consensus.cc:697] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:21.134961  9041 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.156430  8949 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.156992  8949 ts_tablet_manager.cc:1403] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.237s	user 0.017s	sys 0.005s
I20260709 12:09:21.157013  9058 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:21.150730  8798 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.158885  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.160192  8982 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.160737  8982 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:21.161648  8982 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.146306  9056 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.184017  9015 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.177850  9039 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:21.187204  8951 tablet_bootstrap.cc:654] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.190910  9060 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:21.192394  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:21.193742  9041 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.194348  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:21.195276  8833 raft_consensus.cc:2393] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:21.193133  8909 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.196842  8982 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.199992  8982 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.202258  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.202939  8760 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.202713  8874 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.204332  9052 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.205204  8950 tablet_bootstrap.cc:654] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.207808  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:21.209537  8799 leader_election.cc:343] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.211285  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:21.213232  8798 leader_election.cc:343] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.213703  8798 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.214998  9041 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.214818  9039 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.212154  8949 raft_consensus.cc:359] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.219548  8949 raft_consensus.cc:385] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.219880  8949 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.220974  8949 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.222389  8760 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:21.223158  8949 ts_tablet_manager.cc:1434] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:09:21.220415  8982 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.227540  8949 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.229677  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:21.232801  8982 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.233610  8982 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:21.226190  8909 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:21.246805  8982 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.264120  9039 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.269095  9039 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.279451  8655 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.284359  9039 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.285934  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.287997  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:21.288249  8725 leader_election.cc:343] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.294584  8724 leader_election.cc:343] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.303263  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.308315  9039 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.335427  9039 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.336342  9060 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.340675  9042 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.342990  8949 tablet_bootstrap.cc:654] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.347184  8950 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.354398  8951 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.355846  8951 ts_tablet_manager.cc:1403] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.391s	user 0.023s	sys 0.005s
I20260709 12:09:21.359895  8951 raft_consensus.cc:359] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.361155  8951 raft_consensus.cc:385] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.361575  8951 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.362757  8951 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.366569  8951 ts_tablet_manager.cc:1434] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:09:21.384956  8951 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:21.384433  8654 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.381117  8949 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.364113  8950 ts_tablet_manager.cc:1403] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.274s	user 0.022s	sys 0.011s
I20260709 12:09:21.386561  9042 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.397521  8907 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.401023  8950 raft_consensus.cc:359] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.401580  8950 raft_consensus.cc:385] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.401752  8950 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.402462  8949 ts_tablet_manager.cc:1403] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.004s
I20260709 12:09:21.402274  8950 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.404421  8950 ts_tablet_manager.cc:1434] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:09:21.404978  8949 raft_consensus.cc:359] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.405483  8950 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.405622  8949 raft_consensus.cc:385] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.405887  8949 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.406638  8949 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.411968  8949 ts_tablet_manager.cc:1434] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 12:09:21.412526  8950 tablet_bootstrap.cc:654] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.413089  8949 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.427925  9041 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.433037  8982 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.442809  8950 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.443548  8950 ts_tablet_manager.cc:1403] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.004s
I20260709 12:09:21.444538  8982 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.445188  8982 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.447291  8982 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.449179  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:21.450138  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:21.450590  8799 leader_election.cc:343] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.450978  8759 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:21.452589  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.453517  8982 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.453985  8982 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.454389  8982 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.455154  8951 tablet_bootstrap.cc:654] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.459328  8949 tablet_bootstrap.cc:654] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.475391  8657 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.478291  8657 catalog_manager.cc:5697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.479094  8950 raft_consensus.cc:359] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.479768  8950 raft_consensus.cc:385] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.480048  8950 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.481076  8950 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.474668  8982 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.485848  8950 ts_tablet_manager.cc:1434] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
I20260709 12:09:21.487792  8950 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.494326  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.494601  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:21.495080  8950 tablet_bootstrap.cc:654] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.495034  8760 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.496202  8799 leader_election.cc:343] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.497117  8982 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:21.490518  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.499317  9015 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.499791  9015 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.501266  8951 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.501884  8951 ts_tablet_manager.cc:1403] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.015s
I20260709 12:09:21.502102  9015 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.503739  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.504366  8760 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:21.506968  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.507212  8951 raft_consensus.cc:359] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.507884  8951 raft_consensus.cc:385] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.508174  8997 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.508735  8997 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:21.509626  8997 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.517753  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.519958  8760 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:21.522755  8872 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.523514  9015 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.508172  8951 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.521481  8949 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.526880  8949 ts_tablet_manager.cc:1403] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.006s
I20260709 12:09:21.529518  8949 raft_consensus.cc:359] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.530145  8949 raft_consensus.cc:385] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.530385  8949 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.531083  9015 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.531113  8949 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.531688  8951 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.532294  8950 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.533303  8950 ts_tablet_manager.cc:1403] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.009s
I20260709 12:09:21.534672  8951 ts_tablet_manager.cc:1434] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.001s
I20260709 12:09:21.536582  8949 ts_tablet_manager.cc:1434] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:21.537230  9058 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.537571  8949 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.537720  9058 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.540503  8950 raft_consensus.cc:359] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.541214  8950 raft_consensus.cc:385] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.541486  8950 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.541522  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:21.542172  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.542165  8950 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:21.543512  8724 leader_election.cc:343] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.545365  8725 leader_election.cc:343] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.545857  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.547490  9060 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.548014  8658 catalog_manager.cc:5697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.540418  9058 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.550577  8950 ts_tablet_manager.cc:1434] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:09:21.551553  8950 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.551744  8982 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.552165  8982 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.556561  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.557410  8949 tablet_bootstrap.cc:654] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.558161  8798 leader_election.cc:343] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.558319  8982 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.558555  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:21.559792  8951 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
W20260709 12:09:21.560688  8799 leader_election.cc:343] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.561167  8799 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.562142  8997 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.562497  8982 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.564760  8950 tablet_bootstrap.cc:654] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.570567  8949 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.571386  9052 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.572008  9052 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.575451  8949 ts_tablet_manager.cc:1403] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 12:09:21.576077  9015 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.576697  9015 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.576924  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.577656  8833 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.578239  8949 raft_consensus.cc:359] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.578967  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:21.579803  8975 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.578896  9015 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.580751  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.581820  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:21.582034  8874 leader_election.cc:343] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.582543  8759 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.580312  8975 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.578883  8949 raft_consensus.cc:385] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.583443  8975 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.583678  8949 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.586059  8951 tablet_bootstrap.cc:654] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.588461  8949 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.591159  8949 ts_tablet_manager.cc:1434] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:21.592097  8949 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.592702  8950 tablet_bootstrap.cc:492] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.593302  8950 ts_tablet_manager.cc:1403] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:09:21.596153  8976 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.596552  8950 raft_consensus.cc:359] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.596748  9052 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.596941  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.597601  8760 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.597651  8950 raft_consensus.cc:385] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.600317  8950 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.600399  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.601778  9052 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.602268  9052 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.602632  9052 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.603929  8951 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.604455  8951 ts_tablet_manager.cc:1403] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.005s
I20260709 12:09:21.605093  8975 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.607141  8951 raft_consensus.cc:359] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.612386  8951 raft_consensus.cc:385] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.612787  8951 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.613569  8951 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.616030  8951 ts_tablet_manager.cc:1434] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:09:21.618731  8951 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:21.618842  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.624536  8760 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.601271  8950 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.624696  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:21.625538  8833 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.626626  8950 ts_tablet_manager.cc:1434] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:21.616919  9052 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.631773  9052 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.623543  8975 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.632920  8949 tablet_bootstrap.cc:654] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.632987  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.633683  8759 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.637821  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:09:21.639293  8874 leader_election.cc:343] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.640298  9060 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.644127  8760 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:21.645716  8759 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:21.646034  8872 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:21.646744  8950 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.647097  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.647902  9052 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.648406  9052 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:21.649159  8975 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.649237  9052 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.653508  8950 tablet_bootstrap.cc:654] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.653766  8951 tablet_bootstrap.cc:654] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.654826  8833 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:21.663933  8975 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:21.665307  8975 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.676155  8950 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.676926  8950 ts_tablet_manager.cc:1403] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.001s
I20260709 12:09:21.679823  8950 raft_consensus.cc:359] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.680346  8950 raft_consensus.cc:385] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.680531  8950 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.681433  8950 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.683696  8950 ts_tablet_manager.cc:1434] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:21.685026  8950 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.685156  8951 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.685840  8951 ts_tablet_manager.cc:1403] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.003s
I20260709 12:09:21.690060  8951 raft_consensus.cc:359] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.692282  8951 raft_consensus.cc:385] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.692618  8951 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.694392  8950 tablet_bootstrap.cc:654] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.697470  8951 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.704254  8951 ts_tablet_manager.cc:1434] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:09:21.705266  8951 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:21.713423  8951 tablet_bootstrap.cc:654] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.718009  9003 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.733894  8950 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.734493  8950 ts_tablet_manager.cc:1403] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.009s
I20260709 12:09:21.737747  8950 raft_consensus.cc:359] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.737747  8657 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.739948  8657 catalog_manager.cc:5697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.738655  8950 raft_consensus.cc:385] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.741892  8950 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.742769  8950 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.746621  8950 ts_tablet_manager.cc:1434] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:09:21.747545  8950 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.769007  8976 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.769536  8950 tablet_bootstrap.cc:654] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.770526  8949 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.771031  8949 ts_tablet_manager.cc:1403] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.179s	user 0.039s	sys 0.038s
I20260709 12:09:21.771396  8951 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.771940  8951 ts_tablet_manager.cc:1403] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.003s
I20260709 12:09:21.774279  8949 raft_consensus.cc:359] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.775238  8949 raft_consensus.cc:385] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.774914  8951 raft_consensus.cc:359] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.775576  8949 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.775676  8951 raft_consensus.cc:385] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.776036  8951 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.776273  8949 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.776726  8951 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.778832  8949 ts_tablet_manager.cc:1434] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:21.779062  8951 ts_tablet_manager.cc:1434] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:21.779991  8949 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.780354  8951 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:21.787731  8949 tablet_bootstrap.cc:654] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.793691  8976 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.800496  8976 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.806015  9042 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.814124  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:21.814582  8950 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.815275  8950 ts_tablet_manager.cc:1403] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.033s
I20260709 12:09:21.815972  8976 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.816121  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.818792  8950 raft_consensus.cc:359] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.819500  8950 raft_consensus.cc:385] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.819767  8950 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.820498  8951 tablet_bootstrap.cc:654] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.821839  8950 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:21.822922  8799 leader_election.cc:343] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.824045  8950 ts_tablet_manager.cc:1434] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:21.825011  8950 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
W20260709 12:09:21.824862  8798 leader_election.cc:343] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.825356  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.826516  8976 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.828503  8976 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.830770  8949 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:21.831369  8949 ts_tablet_manager.cc:1403] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.008s
I20260709 12:09:21.831657  8950 tablet_bootstrap.cc:654] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.833976  8949 raft_consensus.cc:359] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.834883  8949 raft_consensus.cc:385] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.835191  8949 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.835997  8949 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.838881  8949 ts_tablet_manager.cc:1434] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:21.842659  9052 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.839411  8976 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.843291  9052 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.845275  8976 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.846268  8949 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:21.846202  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.847029  8760 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:21.847640  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.848197  9052 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.848101  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:21.848251  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:21.849936  9042 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:21.850242  8799 leader_election.cc:343] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.850407  9042 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.850762  9042 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.851457  8950 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:21.848256  8833 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.852192  8950 ts_tablet_manager.cc:1403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:09:21.848078  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:21.854137  8872 leader_election.cc:343] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.854859  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:21.856324  9052 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.856768  9052 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.857118  9052 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.858132  8950 raft_consensus.cc:359] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.858906  8950 raft_consensus.cc:385] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.859208  8950 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.865006  9052 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.865545  8975 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.865993  8975 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.867187  9052 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.867856  8975 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.867908  8950 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.869961  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.870003  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.872021  8951 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:21.871765  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:21.872783  8951 ts_tablet_manager.cc:1403] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 12:09:21.872913  8833 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.871562  8872 leader_election.cc:343] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.876155  8874 leader_election.cc:343] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.870082  8950 ts_tablet_manager.cc:1434] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:09:21.878456  9042 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.878883  9052 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.879462  9052 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.882405  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:21.885339  8872 leader_election.cc:343] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.888144  8950 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:21.893966  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.894971  8834 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.896922  8874 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:21.898053  9052 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.898855  8975 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.899561  8975 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.900470  8975 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.900648  9042 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.901357  8951 raft_consensus.cc:359] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.889925  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.902464  8951 raft_consensus.cc:385] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.902755  8951 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.902889  9093 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.904294  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:21.905081  8760 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.907153  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:21.908802  8833 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:21.909030  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.909718  8759 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:21.910115  8951 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.910145  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:21.912361  8951 ts_tablet_manager.cc:1434] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.009s
I20260709 12:09:21.912585  9052 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.913360  8951 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:21.913378  9052 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:09:21.918164  8799 leader_election.cc:343] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.920548  9052 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.923368  8760 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:21.923727  8949 tablet_bootstrap.cc:654] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.924685  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:21.925982  9042 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.927309  9042 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:21.929464  9042 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.930228  9093 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.930757  9093 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.931689  8951 tablet_bootstrap.cc:654] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.933313  9093 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.928861  8975 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.938994  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.944923  9060 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.945504  9060 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.971047  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:21.971890  8833 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.972246  8950 tablet_bootstrap.cc:654] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.982650  8833 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:21.983428  8975 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:21.983162  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:21.984416  9060 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:21.989130  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:21.989562  8725 leader_election.cc:343] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.991003  8724 leader_election.cc:343] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.991636  8874 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:21.991649  8724 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.994329  8975 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.994141  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:21.995213  8975 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:21.995513  8760 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:21.996502  8975 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:21.998733  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:21.999680  9015 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.009277  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:22.011425  8760 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.012293  9015 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.010372  9060 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.016881  8997 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.027066  9060 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.028143  9060 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.030272  8950 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.030941  8950 ts_tablet_manager.cc:1403] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.003s
I20260709 12:09:22.032034  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.032809  9060 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.034392  8949 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.034502  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:22.036146  8725 leader_election.cc:343] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.037395  8724 leader_election.cc:343] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.037911  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:22.038120  8658 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.039258  9060 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.044978  8760 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:22.043445  8657 catalog_manager.cc:5697] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.049996  8950 raft_consensus.cc:359] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.050776  8950 raft_consensus.cc:385] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.051018  8950 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.051724  8950 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.053732  8950 ts_tablet_manager.cc:1434] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:22.057260  8949 ts_tablet_manager.cc:1403] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.042s
I20260709 12:09:22.062726  8658 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.066195  8951 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.066743  8951 ts_tablet_manager.cc:1403] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.028s
I20260709 12:09:22.068905  9015 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.069013  8982 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.069651  8951 raft_consensus.cc:359] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.070353  8951 raft_consensus.cc:385] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.070732  8951 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.073621  8949 raft_consensus.cc:359] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.074306  8949 raft_consensus.cc:385] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.074580  8949 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.074777  8950 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.075244  8949 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.082293  8950 tablet_bootstrap.cc:654] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.071424  8951 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.088147  8951 ts_tablet_manager.cc:1434] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:09:22.089092  8951 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.093971  8951 tablet_bootstrap.cc:654] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.105192  8874 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.106997  8951 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.107416  8951 ts_tablet_manager.cc:1403] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 12:09:22.110412  8951 raft_consensus.cc:359] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.111104  8951 raft_consensus.cc:385] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.111379  8951 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.112033  8951 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.113528  8951 ts_tablet_manager.cc:1434] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:22.114243  8951 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.119010  8951 tablet_bootstrap.cc:654] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.119135  8949 ts_tablet_manager.cc:1434] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.001s
I20260709 12:09:22.125865  8949 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.135170  8949 tablet_bootstrap.cc:654] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.149010  8950 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.149200  8951 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.149526  8950 ts_tablet_manager.cc:1403] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.025s
I20260709 12:09:22.149773  8951 ts_tablet_manager.cc:1403] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.017s
I20260709 12:09:22.152961  8951 raft_consensus.cc:359] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.153769  8951 raft_consensus.cc:385] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.152406  8950 raft_consensus.cc:359] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.153967  8976 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.154183  8951 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.154794  8976 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.154582  8950 raft_consensus.cc:385] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.155714  8950 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.157146  8976 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.157100  8950 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.157939  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.159262  8950 ts_tablet_manager.cc:1434] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 12:09:22.159642  8798 leader_election.cc:343] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.160190  8950 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.164294  9093 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.155405  8951 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.167135  8950 tablet_bootstrap.cc:654] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.167555  8949 tablet_bootstrap.cc:492] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.168103  8949 ts_tablet_manager.cc:1403] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 12:09:22.168975  8951 ts_tablet_manager.cc:1434] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:22.170133  8951 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.171034  8949 raft_consensus.cc:359] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.171818  8949 raft_consensus.cc:385] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.172109  8949 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.172976  8949 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.174773  8949 ts_tablet_manager.cc:1434] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.007s
I20260709 12:09:22.175740  8949 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.179543  8951 tablet_bootstrap.cc:654] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.180328  9039 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.180917  9039 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.182485  8949 tablet_bootstrap.cc:654] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.184306  9039 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.185706  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.186630  8906 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:22.188411  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:22.190506  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.191455  8834 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:22.202709  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.203914  8906 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:22.209060  9039 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.209771  9039 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.210285  9039 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.216495  9052 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.219890  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:22.221662  8976 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.222203  8976 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.222653  8976 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.297092  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48502us
I20260709 12:09:22.316601  9003 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.317619  9003 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.323235  9003 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.325220  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:22.327934  8724 leader_election.cc:343] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.329427  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.330966  8834 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:22.337527  9093 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.338330  9093 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.365835  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:22.375897  9003 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.395901  8982 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.396486  8982 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.398427  8982 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.400763  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:22.404281  8798 leader_election.cc:343] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.404785  9042 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.392361  9003 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.406683  9003 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.412578  9039 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.423825  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.425503  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:22.425945  8799 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:22.441208  8872 leader_election.cc:343] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.441952  8799 leader_election.cc:343] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.442427  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:22.443228  9003 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.444576  8982 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.417646  9093 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:22.447214  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:22.447849  8907 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.431910  8976 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.452428  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:09:22.454085  8798 leader_election.cc:343] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.458151  8907 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:09:22.459656  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.481506  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:22.482116  8906 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.482187  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.482913  8951 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.483462  8951 ts_tablet_manager.cc:1403] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.314s	user 0.098s	sys 0.148s
I20260709 12:09:22.487287  8951 raft_consensus.cc:359] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.488076  8951 raft_consensus.cc:385] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.488394  8951 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.489238  8951 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.489491  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:22.490582  9060 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.496165  8951 ts_tablet_manager.cc:1434] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:09:22.479056  8949 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.478840  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:22.496924  8833 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.497319  8951 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.497831  8950 tablet_bootstrap.cc:492] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.498292  8950 ts_tablet_manager.cc:1403] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.338s	user 0.081s	sys 0.174s
I20260709 12:09:22.501010  8950 raft_consensus.cc:359] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.501682  8950 raft_consensus.cc:385] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.501947  8950 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.502723  8950 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.503667  9093 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.504747  8951 tablet_bootstrap.cc:654] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.504721  8833 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:22.479679  8976 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.480046  9039 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.506752  8950 ts_tablet_manager.cc:1434] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:09:22.506834  8949 ts_tablet_manager.cc:1403] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.331s	user 0.068s	sys 0.124s
I20260709 12:09:22.507638  8906 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:22.508869  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:22.509382  8950 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.510015  8976 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.510705  8976 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:22.511688  8976 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.513499  9003 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.514709  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:09:22.518965  8724 leader_election.cc:343] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.515218  9060 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:22.516841  8949 raft_consensus.cc:359] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.519634  8949 raft_consensus.cc:385] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.519944  8949 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.520062  9060 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.520859  8949 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.519129  8950 tablet_bootstrap.cc:654] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.522743  8949 ts_tablet_manager.cc:1434] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:22.523643  8949 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
W20260709 12:09:22.523713  8874 leader_election.cc:343] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.524151  8874 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:22.525362  9093 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.530012  9052 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:22.536765  9125 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.537346  9125 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.541428  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.542855  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:22.543187  9125 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.543510  8832 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.548620  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.550048  8949 tablet_bootstrap.cc:654] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.555910  8951 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.556425  8951 ts_tablet_manager.cc:1403] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.014s
I20260709 12:09:22.556474  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.567159  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:22.568353  8997 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.610677  9052 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.611220  9052 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.616784  9060 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.684402  9060 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.596014  8832 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:09:22.625366  9132 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:09:22.624439  9052 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:22.640538  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.694378  8950 tablet_bootstrap.cc:492] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.695392  8950 ts_tablet_manager.cc:1403] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.022s
I20260709 12:09:22.616784  9093 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.715451  9060 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.698086  9093 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.707693  8951 raft_consensus.cc:359] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.719255  8951 raft_consensus.cc:385] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.719637  8951 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.720429  8951 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.721011  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.723747  8906 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:22.724040  8951 ts_tablet_manager.cc:1434] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.001s
I20260709 12:09:22.725070  8951 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.718791  8656 catalog_manager.cc:5697] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.726528  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.732928  8950 raft_consensus.cc:359] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.733503  8950 raft_consensus.cc:385] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.733681  8950 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.734608  8950 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.736564  8834 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.737105  8950 ts_tablet_manager.cc:1434] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 12:09:22.738689  8950 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.741179  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:22.742494  9060 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.742980  9060 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:22.744484  9060 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.749401  8949 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.749953  8949 ts_tablet_manager.cc:1403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.226s	user 0.016s	sys 0.011s
I20260709 12:09:22.753404  9093 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:22.754592  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.755761  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:09:22.756184  8872 leader_election.cc:343] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.756752  9093 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.760495  8975 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.761164  8949 raft_consensus.cc:359] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.761832  8949 raft_consensus.cc:385] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.762105  8949 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.769127  8950 tablet_bootstrap.cc:654] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.774605  8949 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.775226  8951 tablet_bootstrap.cc:654] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.777081  8949 ts_tablet_manager.cc:1434] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:09:22.777201  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.778139  8949 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.778867  8725 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:22.780465  9060 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.788832  9060 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.791456  8949 tablet_bootstrap.cc:654] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.793877  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:22.801080  8874 leader_election.cc:343] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.801610  8874 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:22.802896  8975 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.811192  8950 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.811821  8950 ts_tablet_manager.cc:1403] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.000s
I20260709 12:09:22.813813  8949 tablet_bootstrap.cc:492] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.814297  8951 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.814337  8949 ts_tablet_manager.cc:1403] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
I20260709 12:09:22.815003  8951 ts_tablet_manager.cc:1403] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.015s
I20260709 12:09:22.818092  8950 raft_consensus.cc:359] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.818811  8950 raft_consensus.cc:385] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.818579  8949 raft_consensus.cc:359] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.818785  8951 raft_consensus.cc:359] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.819386  8950 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.819531  8949 raft_consensus.cc:385] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.819599  8951 raft_consensus.cc:385] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.820000  8951 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.820098  8949 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.820128  8950 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.820900  8951 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.821188  8949 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.822743  8951 ts_tablet_manager.cc:1434] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:22.822743  8950 ts_tablet_manager.cc:1434] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:09:22.823704  8951 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.823865  8950 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.824071  8949 ts_tablet_manager.cc:1434] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:22.825176  8949 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.830470  8951 tablet_bootstrap.cc:654] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.830470  8950 tablet_bootstrap.cc:654] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.831876  8949 tablet_bootstrap.cc:654] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.833550  8658 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.861200  8758 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.879534  8949 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.880196  8949 ts_tablet_manager.cc:1403] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.005s
I20260709 12:09:22.881616  8951 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:22.885602  8951 ts_tablet_manager.cc:1403] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.044s
I20260709 12:09:22.883355  8949 raft_consensus.cc:359] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.888684  9060 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.888841  8949 raft_consensus.cc:385] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.888357  8951 raft_consensus.cc:359] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.889269  8949 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.889451  8951 raft_consensus.cc:385] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.889297  9060 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.889997  8951 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.890162  8949 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.891331  8951 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.892431  9003 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.892966  9003 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.893457  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.893234  8656 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.894049  8951 ts_tablet_manager.cc:1434] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:22.895129  8951 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:22.895304  9003 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.896533  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.897114  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.897226  8834 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:22.897828  8906 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
W20260709 12:09:22.895377  8725 leader_election.cc:343] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.899199  8725 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:22.900532  9003 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.900813  8951 tablet_bootstrap.cc:654] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.900959  9003 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.901412  9003 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.902197  8975 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.902695  8975 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.906121  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.906366  8906 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.906884  8950 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.906836  8758 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:22.907424  8950 ts_tablet_manager.cc:1403] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.009s
I20260709 12:09:22.908403  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:22.909387  9093 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.909734  9093 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.910064  9093 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.910625  8950 raft_consensus.cc:359] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.911288  8950 raft_consensus.cc:385] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.911456  8975 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:22.911566  8950 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.912474  8950 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.912768  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:22.913456  8834 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:22.915784  8950 ts_tablet_manager.cc:1434] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:22.916769  8950 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.917162  9093 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.917920  9060 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.918076  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:22.918740  8907 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:22.919441  8949 ts_tablet_manager.cc:1434] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 12:09:22.920100  8724 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:22.920243  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:22.921013  8758 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.921897  9003 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.920531  8949 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.924074  9003 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.924329  8950 tablet_bootstrap.cc:654] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.925834  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:22.926442  8834 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.927615  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:22.927158  9093 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:22.928220  8907 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.936414  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:22.937182  8835 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.939599  9127 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.933303  8949 tablet_bootstrap.cc:654] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.940025  9127 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.940433  9127 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.945144  8758 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:22.946903  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:22.947925  9093 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.948668  9093 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:22.949581  9093 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.951684  8907 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:22.953996  8834 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:22.947392  8835 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:22.956900  8949 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:22.957422  8949 ts_tablet_manager.cc:1403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:09:22.957754  8725 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:22.959206  9003 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.959708  9003 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:22.960258  8949 raft_consensus.cc:359] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.961025  8949 raft_consensus.cc:385] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.960546  9003 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.961346  8949 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.962059  8949 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.964152  8949 ts_tablet_manager.cc:1434] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:22.966919  8976 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.967478  8976 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.969964  8950 tablet_bootstrap.cc:492] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:22.970484  8950 ts_tablet_manager.cc:1403] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.005s
I20260709 12:09:22.970538  8976 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:22.971251  8949 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:22.975201  9127 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.976724  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:22.977799  8949 tablet_bootstrap.cc:654] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.978678  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:22.979012  8798 leader_election.cc:343] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.980283  8799 leader_election.cc:343] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.980939  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:22.981462  8950 raft_consensus.cc:359] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.982213  8950 raft_consensus.cc:385] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.982466  8950 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.983160  8950 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:22.988706  8950 ts_tablet_manager.cc:1434] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:09:22.989732  8950 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:22.984450  8976 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.996024  8950 tablet_bootstrap.cc:654] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.009681  8975 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.010421  8975 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.017684  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.018488  8834 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:23.019232  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.019945  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:23.021144  9133 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.021521  9133 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:23.021572  8872 leader_election.cc:343] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.021951  9133 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.030418  8975 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.031320  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:09:23.039168  8725 leader_election.cc:343] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.033298  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:23.047883  8907 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.052892  9133 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.062368  9133 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.047164  9093 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.064471  9093 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.066684  9093 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.070022  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.070900  8835 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:23.071224  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.073591  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.062904  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:23.063483  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.076465  8834 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.033886  9127 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.075655  9093 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.084559  8657 catalog_manager.cc:5697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.091387  9093 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.093376  8834 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
W20260709 12:09:23.093466  8872 leader_election.cc:343] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.096513  8949 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.096300  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:23.097206  8949 ts_tablet_manager.cc:1403] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.126s	user 0.053s	sys 0.068s
I20260709 12:09:23.098476  9052 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.098963  9052 raft_consensus.cc:697] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:23.099442  8950 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.099893  8950 ts_tablet_manager.cc:1403] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.029s
I20260709 12:09:23.099977  8949 raft_consensus.cc:359] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.100615  8949 raft_consensus.cc:385] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.100912  8949 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.099757  9052 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.101646  8949 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.102432  8950 raft_consensus.cc:359] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.103223  8950 raft_consensus.cc:385] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.103456  8950 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.103854  8949 ts_tablet_manager.cc:1434] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:23.104175  8950 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.104983  8949 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.106701  8950 ts_tablet_manager.cc:1434] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:23.107604  8950 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.108239  8951 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.108805  8951 ts_tablet_manager.cc:1403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.214s	user 0.018s	sys 0.025s
I20260709 12:09:23.111192  8949 tablet_bootstrap.cc:654] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.112586  8950 tablet_bootstrap.cc:654] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.112917  8654 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.117193  8907 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:23.121852  8724 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.123550  9127 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.124178  9127 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:23.125353  9127 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.138513  8976 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.139192  8976 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.143478  8976 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.144147  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.145160  8907 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:23.146452  8951 raft_consensus.cc:359] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.147228  8951 raft_consensus.cc:385] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.147542  8951 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.148061  9127 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.148207  8951 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.158249  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:23.164891  8951 ts_tablet_manager.cc:1434] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:09:23.164999  9060 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.174623  8982 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.175228  8982 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.175678  8982 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.177218  8951 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.187584  9039 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.189632  8949 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.190290  8949 ts_tablet_manager.cc:1403] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.086s	user 0.043s	sys 0.030s
I20260709 12:09:23.193104  8949 raft_consensus.cc:359] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.193795  8949 raft_consensus.cc:385] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.194067  8949 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.194684  8949 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.152110  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.195390  8951 tablet_bootstrap.cc:654] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.189632  8950 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.196024  8950 ts_tablet_manager.cc:1403] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.089s	user 0.040s	sys 0.038s
I20260709 12:09:23.195881  8759 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:23.196728  8949 ts_tablet_manager.cc:1434] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:23.197672  8949 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.203976  9060 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.204085  8976 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.204989  8949 tablet_bootstrap.cc:654] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.214286  8654 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.230477  8949 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.232234  8949 ts_tablet_manager.cc:1403] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
I20260709 12:09:23.226809  8950 raft_consensus.cc:359] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.233096  8950 raft_consensus.cc:385] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.234025  8950 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.231150  8982 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.234920  8949 raft_consensus.cc:359] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.235654  8949 raft_consensus.cc:385] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.235953  8949 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.236574  8949 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.237596  8982 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.238973  8949 ts_tablet_manager.cc:1434] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:23.238984  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:23.240067  8949 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.239655  8907 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.235662  8950 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.246165  8951 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.246721  8951 ts_tablet_manager.cc:1403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.004s
I20260709 12:09:23.248731  8950 ts_tablet_manager.cc:1434] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.005s
I20260709 12:09:23.249662  8950 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.254945  8907 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:23.255312  8950 tablet_bootstrap.cc:654] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.256533  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:23.257941  8976 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.258415  8976 raft_consensus.cc:697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:23.258994  8949 tablet_bootstrap.cc:654] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.259238  8976 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.260859  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:23.261570  8758 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.266427  9125 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.267079  9125 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.268229  8654 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.270656  9125 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.265450  8951 raft_consensus.cc:359] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.273164  8951 raft_consensus.cc:385] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.273593  8951 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.274439  8951 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.284323  8949 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.270942  8758 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:23.272404  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.284144  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.285250  8905 raft_consensus.cc:2393] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:23.285810  8949 ts_tablet_manager.cc:1403] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.008s
I20260709 12:09:23.289875  8949 raft_consensus.cc:359] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.290848  8949 raft_consensus.cc:385] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.291198  8949 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.292218  8949 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.295126  8951 ts_tablet_manager.cc:1434] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 12:09:23.305774  8657 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.306874  8951 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.302898  9127 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.309684  9127 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.297595  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:23.317507  8982 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.318058  9127 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.325896  8949 ts_tablet_manager.cc:1434] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 12:09:23.327230  8949 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.336010  8976 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.349977  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:23.351642  8724 leader_election.cc:343] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.352986  8950 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.353482  8950 ts_tablet_manager.cc:1403] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.029s
I20260709 12:09:23.356041  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.356721  8832 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:23.357833  8950 raft_consensus.cc:359] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.358510  8950 raft_consensus.cc:385] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.358780  8950 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.359462  8950 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.364576  8951 tablet_bootstrap.cc:654] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.368491  8950 ts_tablet_manager.cc:1434] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:23.369726  8950 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.373354  9039 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.374006  8725 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:23.374083  9039 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.374987  9003 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.375399  9003 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.375743  9003 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.377084  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.377770  8832 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:23.379781  9039 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.381419  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.382820  8906 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:23.385563  9133 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.385524  8724 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:23.374185  8982 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.387540  9127 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.387916  9127 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.388259  9127 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.389673  8949 tablet_bootstrap.cc:654] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.386358  9133 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.396122  9093 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.398644  9127 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.390412  9003 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.410923  9133 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.411652  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.412352  8835 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.415963  9127 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.417498  9003 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.419662  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:23.421152  8874 leader_election.cc:343] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.421701  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:23.422029  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:23.422662  8907 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.423087  8724 leader_election.cc:343] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.427644  8835 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:23.429057  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.431488  8950 tablet_bootstrap.cc:654] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.434541  9060 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.448321  8907 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:23.462034  8951 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.462818  8951 ts_tablet_manager.cc:1403] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.002s
W20260709 12:09:23.470168  8872 leader_election.cc:343] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.471850  8872 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.457957  9127 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.474215  8724 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:23.472930  9093 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.475024  9052 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.479118  9127 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.499390  9127 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.501732  8951 raft_consensus.cc:359] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.502518  8951 raft_consensus.cc:385] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.502786  8951 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.503490  8951 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.511080  9127 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.512240  9127 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:23.513154  9127 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.518453  8949 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.519057  8949 ts_tablet_manager.cc:1403] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.192s	user 0.018s	sys 0.021s
I20260709 12:09:23.522480  8951 ts_tablet_manager.cc:1434] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.059s	user 0.012s	sys 0.001s
I20260709 12:09:23.523442  8951 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.525291  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.536017  8949 raft_consensus.cc:359] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.540341  8949 raft_consensus.cc:385] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.540603  8759 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.540674  8949 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.541996  8949 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.546139  8949 ts_tablet_manager.cc:1434] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:09:23.547633  8949 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.547997  8950 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.548429  8950 ts_tablet_manager.cc:1403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.179s	user 0.006s	sys 0.007s
I20260709 12:09:23.552024  8950 raft_consensus.cc:359] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.552582  8950 raft_consensus.cc:385] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.552853  8950 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.553400  8950 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.555730  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.556768  8835 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.559327  8658 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.564047  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.566298  8832 raft_consensus.cc:2393] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:23.572965  8950 ts_tablet_manager.cc:1434] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:23.573828  8950 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.574678  9176 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.575194  9176 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.578193  9176 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.579380  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:23.580984  8724 leader_election.cc:343] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.588851  8835 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:23.591681  9093 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.594632  8949 tablet_bootstrap.cc:654] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.595824  8951 tablet_bootstrap.cc:654] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.600728  9093 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.601274  9093 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.603436  9093 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.604821  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.606423  8835 raft_consensus.cc:2393] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:23.610082  8950 tablet_bootstrap.cc:654] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.609850  8725 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.613991  8725 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:23.619234  9176 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.619375  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.620271  9176 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:23.619928  9003 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.621498  9176 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.622563  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.624362  9060 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.627972  9060 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.628908  9060 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.636737  9060 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.638897  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:23.642030  8724 leader_election.cc:343] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.654666  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.658650  9093 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.667862  8658 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.670718  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.669219  9093 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.672816  9093 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.673673  8950 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.676280  8950 ts_tablet_manager.cc:1403] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.013s
I20260709 12:09:23.678403  8950 raft_consensus.cc:359] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.678897  8950 raft_consensus.cc:385] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.679123  8950 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.679800  8950 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.674986  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.681627  8950 ts_tablet_manager.cc:1434] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:23.675812  8951 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.682143  8951 ts_tablet_manager.cc:1403] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.005s
I20260709 12:09:23.676113  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.654538  9060 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:23.683369  8950 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.686812  8951 raft_consensus.cc:359] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.688486  8951 raft_consensus.cc:385] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.688812  8951 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.689585  8951 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.694489  8951 ts_tablet_manager.cc:1434] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:09:23.689706  8832 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:23.695524  8951 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.696529  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:23.695425  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.698354  8975 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.697834  9052 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.699101  9052 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.706954  8950 tablet_bootstrap.cc:654] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.692983  8725 leader_election.cc:343] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.699445  9060 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.701987  9052 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.710124  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.713989  9060 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.722122  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:23.723580  8724 leader_election.cc:343] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.724145  9060 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:23.718441  8872 leader_election.cc:343] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.729362  8951 tablet_bootstrap.cc:654] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.727684  9060 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.745252  8949 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.745739  8949 ts_tablet_manager.cc:1403] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.012s
I20260709 12:09:23.751048  8949 raft_consensus.cc:359] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:23.737425  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 66825.5us
I20260709 12:09:23.768795  8949 raft_consensus.cc:385] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.770123  8949 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.773514  8950 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.774055  8950 ts_tablet_manager.cc:1403] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.006s
I20260709 12:09:23.776909  8975 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.780736  8949 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.785491  8949 ts_tablet_manager.cc:1434] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.010s
I20260709 12:09:23.786470  8949 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.792096  8975 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:23.800135  8725 leader_election.cc:343] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.803082  8950 raft_consensus.cc:359] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.803802  8950 raft_consensus.cc:385] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.804097  8950 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.801307  9052 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.806808  8950 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.812713  8951 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.814481  8951 ts_tablet_manager.cc:1403] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.007s
I20260709 12:09:23.807116  9175 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:23.823029  8951 raft_consensus.cc:359] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.824676  8951 raft_consensus.cc:385] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.824968  8951 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.826198  9093 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.826710  9093 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.827260  8950 ts_tablet_manager.cc:1434] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 12:09:23.831372  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.802066  8725 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.832600  9093 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.834254  8950 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:23.833763  9052 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.835379  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:23.835518  9039 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.836097  9175 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.825660  8951 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.867359  9175 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.868387  8951 ts_tablet_manager.cc:1434] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:09:23.869470  8951 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.869632  9175 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:23.837235  8874 leader_election.cc:343] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.840487  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.871860  8757 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:23.872943  8832 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:23.841250  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:23.852885  9127 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.866941  8949 tablet_bootstrap.cc:654] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.875928  8951 tablet_bootstrap.cc:654] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.845428  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.877408  8834 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.886468  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:09:23.887593  8872 leader_election.cc:343] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.888106  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:23.888797  8758 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:23.888973  8949 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:23.889588  8949 ts_tablet_manager.cc:1403] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.007s
I20260709 12:09:23.889586  9133 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.890270  9133 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.890704  9133 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.892838  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.895893  8950 tablet_bootstrap.cc:654] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.901301  8949 raft_consensus.cc:359] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.902280  8949 raft_consensus.cc:385] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.902603  8949 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.891672  8982 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:23.891503  8798 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:09:23.907810  8799 leader_election.cc:343] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.907899  8725 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:23.909183  9003 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.909608  9003 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.910002  9003 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.912657  8950 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:23.914124  9175 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.920857  9175 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.920898  8950 ts_tablet_manager.cc:1403] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.003s
I20260709 12:09:23.921406  9175 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.921883  9133 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.903440  8949 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.936101  9133 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:23.929983  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:23.928557  8951 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.931478  8949 ts_tablet_manager.cc:1434] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:09:23.937144  8951 ts_tablet_manager.cc:1403] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.012s
I20260709 12:09:23.937067  8757 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.937783  8949 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:23.923933  8950 raft_consensus.cc:359] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.939939  8950 raft_consensus.cc:385] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.940271  8950 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.940066  8951 raft_consensus.cc:359] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.940889  8951 raft_consensus.cc:385] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.941206  8951 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.941943  8951 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.909814  8834 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:23.947292  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.944272  8951 ts_tablet_manager.cc:1434] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:09:23.948837  8951 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:23.949245  8950 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.945250  8949 tablet_bootstrap.cc:654] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.950525  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:23.954061  9003 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.956900  8951 tablet_bootstrap.cc:654] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.958467  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:23.961354  9133 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.961884  9133 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:23.963176  8950 ts_tablet_manager.cc:1434] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:09:23.962881  9133 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.964207  8950 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
W20260709 12:09:23.964521  8874 leader_election.cc:343] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.956408  9003 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.971143  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:09:23.980175  8724 leader_election.cc:343] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.982080  8757 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:23.987702  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.992031  9192 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.992774  9039 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.993261  9039 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.994356  8951 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:23.994872  8951 ts_tablet_manager.cc:1403] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.021s
I20260709 12:09:23.955861  9175 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:23.997545  8832 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:23.999907  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:24.000322  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:23.992558  9192 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:09:24.001720  8799 leader_election.cc:343] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.002429  9192 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.003986  9175 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:23.997722  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.007851  8833 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
W20260709 12:09:24.005744  8724 leader_election.cc:343] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.006734  8725 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:23.995353  9039 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.015973  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.017235  9176 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.017670  9176 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.018023  9176 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.012698  9039 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.012403  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:24.021096  8757 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:24.020197  8654 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.022178  8798 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.024977  9175 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.029300  8949 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.029951  8949 ts_tablet_manager.cc:1403] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.013s
I20260709 12:09:24.033484  8949 raft_consensus.cc:359] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.034274  8949 raft_consensus.cc:385] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.034605  8949 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.035470  8949 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.035795  9003 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.038416  8949 ts_tablet_manager.cc:1434] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:24.041033  8949 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.041218  8950 tablet_bootstrap.cc:654] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.040822  8951 raft_consensus.cc:359] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.041667  8951 raft_consensus.cc:385] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.041966  8951 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.042760  8951 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.045011  8951 ts_tablet_manager.cc:1434] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.018s
I20260709 12:09:24.046012  8951 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.052147  9176 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.056167  8951 tablet_bootstrap.cc:654] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.056933  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:24.057607  8835 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.062553  8951 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:24.063056  8951 ts_tablet_manager.cc:1403] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 12:09:24.066023  8951 raft_consensus.cc:359] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.066670  8951 raft_consensus.cc:385] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.066946  8951 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.067533  8951 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.069653  8951 ts_tablet_manager.cc:1434] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:09:24.067330  8658 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.070530  8951 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.070327  9003 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.077936  8950 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:24.078379  8950 ts_tablet_manager.cc:1403] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.007s
I20260709 12:09:24.078550  8951 tablet_bootstrap.cc:654] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.081779  8950 raft_consensus.cc:359] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.082691  8950 raft_consensus.cc:385] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.085256  8949 tablet_bootstrap.cc:654] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.091868  8982 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.092428  8982 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.094501  8982 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.095636  9192 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.096084  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.096235  9192 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:24.097645  8799 leader_election.cc:343] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.098656  9192 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.099867  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.100333  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.100844  8951 tablet_bootstrap.cc:492] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
W20260709 12:09:24.101183  8874 leader_election.cc:343] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.101356  8951 ts_tablet_manager.cc:1403] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
W20260709 12:09:24.101899  8872 leader_election.cc:343] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.102360  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:24.102420  8950 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.103324  8950 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.104326  9133 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.104588  8951 raft_consensus.cc:359] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.105370  8951 raft_consensus.cc:385] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.105475  8950 ts_tablet_manager.cc:1434] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:09:24.105669  8951 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.106137  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.106312  8951 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.106388  8950 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
W20260709 12:09:24.107864  8798 leader_election.cc:343] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.107900  9127 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.108595  8951 ts_tablet_manager.cc:1434] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:09:24.108515  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.109572  8951 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.109704  8982 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.130921  9176 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.132838  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:24.156728  8951 tablet_bootstrap.cc:654] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.159565  8724 leader_election.cc:343] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.160852  9192 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.161300  8835 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:24.161567  9192 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.165469  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.166581  8950 tablet_bootstrap.cc:654] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.167338  9192 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.165889  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.168556  8758 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:24.168780  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.170176  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:24.169721  8832 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:24.172943  9192 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.168249  9176 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.173341  9192 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.173767  9176 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:24.175908  9060 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.176705  9176 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.173784  9192 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.183542  8949 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.184073  8949 ts_tablet_manager.cc:1403] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.143s	user 0.006s	sys 0.028s
I20260709 12:09:24.187211  8949 raft_consensus.cc:359] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.187878  8949 raft_consensus.cc:385] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.188118  8949 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.188301  9192 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.191857  8949 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.194607  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:24.195295  8758 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.197656  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:24.197978  8949 ts_tablet_manager.cc:1434] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:09:24.198268  8832 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.198999  8949 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.203114  8950 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:24.202867  8758 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:24.205560  9192 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.205941  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:24.206413  8950 ts_tablet_manager.cc:1403] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.014s
I20260709 12:09:24.206532  8951 tablet_bootstrap.cc:492] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:24.207597  8951 ts_tablet_manager.cc:1403] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.005s
I20260709 12:09:24.208325  8832 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:24.209465  8950 raft_consensus.cc:359] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.210180  8950 raft_consensus.cc:385] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.210503  9133 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.211373  9133 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:24.212445  8949 tablet_bootstrap.cc:654] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.210497  8951 raft_consensus.cc:359] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.212206  9133 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.212839  8951 raft_consensus.cc:385] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.213195  8951 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.214077  8951 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.210493  8950 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.216416  8950 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.219412  8951 ts_tablet_manager.cc:1434] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:24.220762  8951 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.229205  8950 ts_tablet_manager.cc:1434] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:24.230186  8950 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:24.236621  8950 tablet_bootstrap.cc:654] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.239217  8949 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.239792  8949 ts_tablet_manager.cc:1403] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260709 12:09:24.242285  8951 tablet_bootstrap.cc:654] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.244963  8656 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.249619  8949 raft_consensus.cc:359] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.250388  8949 raft_consensus.cc:385] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.250676  8949 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.251375  8949 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.256492  8949 ts_tablet_manager.cc:1434] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:09:24.257534  8949 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.263576  8654 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.268289  8949 tablet_bootstrap.cc:654] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.271620  8951 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:24.272120  8951 ts_tablet_manager.cc:1403] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.052s	user 0.003s	sys 0.021s
I20260709 12:09:24.273134  9176 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.273808  9176 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.274648  8951 raft_consensus.cc:359] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.275396  8951 raft_consensus.cc:385] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.275666  8951 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.276444  8951 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.280207  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.281011  8832 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:24.281771  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.282864  9176 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.283949  8949 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.284507  8949 ts_tablet_manager.cc:1403] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.006s
I20260709 12:09:24.285372  8724 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:24.287820  8951 ts_tablet_manager.cc:1434] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:09:24.287851  8949 raft_consensus.cc:359] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.288951  8949 raft_consensus.cc:385] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.289111  8951 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.289878  8949 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.290818  8949 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.291724  9176 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.295657  8951 tablet_bootstrap.cc:654] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.298766  9176 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.299259  8949 ts_tablet_manager.cc:1434] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:24.300280  8949 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.306591  8949 tablet_bootstrap.cc:654] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.307861  9175 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.308647  9175 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.310253  9127 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.310742  9127 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.312415  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.312868  9127 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.313374  8758 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:24.316089  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.317085  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.318984  8832 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:24.320261  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:24.321103  9176 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.321465  9176 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.321831  9176 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.318986  8907 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:24.318005  8798 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:24.330658  9176 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.333020  8982 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.333448  8949 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.334067  8949 ts_tablet_manager.cc:1403] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 12:09:24.333477  8982 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.336863  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:24.342087  8832 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.342911  8976 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.343429  8976 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.344821  8982 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.345651  8976 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.346885  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:24.348067  8798 leader_election.cc:343] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.349165  9175 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.337255  8949 raft_consensus.cc:359] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.353067  8949 raft_consensus.cc:385] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.353389  8949 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.356281  8950 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:24.338061  9176 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.341046  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:24.357216  8905 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.357311  8949 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.358946  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.359921  8949 ts_tablet_manager.cc:1434] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:09:24.360991  8949 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.356856  8950 ts_tablet_manager.cc:1403] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.008s
I20260709 12:09:24.367290  8949 tablet_bootstrap.cc:654] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.368947  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:24.370389  8799 leader_election.cc:343] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.370839  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.371479  8951 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:24.371995  8951 ts_tablet_manager.cc:1403] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.083s	user 0.035s	sys 0.041s
I20260709 12:09:24.372347  8976 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.374378  8950 raft_consensus.cc:359] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.375159  8950 raft_consensus.cc:385] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.374749  8951 raft_consensus.cc:359] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.375471  8950 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.375687  8951 raft_consensus.cc:385] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.364787  8905 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:24.376598  8950 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.377154  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:24.378098  9127 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.378557  9127 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:24.379236  8950 ts_tablet_manager.cc:1434] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 12:09:24.379644  9060 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.379312  9127 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.380069  9060 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.380506  8950 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:24.382205  9060 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.359951  8906 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:24.384161  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.385093  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:24.385536  8724 leader_election.cc:343] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.383232  8951 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
W20260709 12:09:24.386606  8725 leader_election.cc:343] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.387077  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:24.388520  9060 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.390283  8951 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.391186  8950 tablet_bootstrap.cc:654] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.394917  8951 ts_tablet_manager.cc:1434] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:09:24.397163  8951 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.399580  8832 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:24.407581  8951 tablet_bootstrap.cc:654] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.410987  9133 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.411692  9133 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.418032  9133 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.419672  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.420701  8835 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:24.435395  8835 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.460120  9133 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.465555  9197 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.466298  9197 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.474704  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.523277  8950 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
W20260709 12:09:24.523588  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48992.1us
I20260709 12:09:24.523875  8950 ts_tablet_manager.cc:1403] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.023s
I20260709 12:09:24.524955  8758 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:24.527246  8949 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.534809  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.537041  8949 ts_tablet_manager.cc:1403] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.176s	user 0.010s	sys 0.027s
I20260709 12:09:24.532078  9197 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.541368  8982 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.545605  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:24.545749  8949 raft_consensus.cc:359] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.546571  8757 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.546813  8949 raft_consensus.cc:385] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.547287  8949 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.548313  8949 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.550823  8949 ts_tablet_manager.cc:1434] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:09:24.552249  8949 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
W20260709 12:09:24.559439  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 77220.3us
I20260709 12:09:24.560990  8656 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.562037  8950 raft_consensus.cc:359] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.562822  8950 raft_consensus.cc:385] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.563133  8950 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.563800  8950 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.567560  9093 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.569331  8949 tablet_bootstrap.cc:654] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.569816  9003 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.571234  9003 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.573881  9003 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.581163  9060 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.581548  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.582281  8835 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:24.581907  9060 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.583247  8949 tablet_bootstrap.cc:492] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:24.583753  8949 ts_tablet_manager.cc:1403] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 12:09:24.585151  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.585814  8905 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:24.586705  8949 raft_consensus.cc:359] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.587463  8949 raft_consensus.cc:385] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.587733  8949 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.588997  9060 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.594288  8949 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.594873  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:24.597673  8949 ts_tablet_manager.cc:1434] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:09:24.598642  8949 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:24.600529  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.604877  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.611565  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:24.610095  9003 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.628337  8951 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:24.636475  8951 ts_tablet_manager.cc:1403] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.239s	user 0.062s	sys 0.123s
I20260709 12:09:24.619342  8982 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.638926  9230 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.607702  8832 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:24.636637  9003 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.642498  8757 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:24.643082  9176 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.647064  8949 tablet_bootstrap.cc:654] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.657127  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 45721.1us
I20260709 12:09:24.657652  8950 ts_tablet_manager.cc:1434] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.133s	user 0.033s	sys 0.018s
I20260709 12:09:24.715291  8950 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:24.654170  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.721477  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:24.720678  8798 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:24.711246  9039 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.721815  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:24.679318  9093 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.714208  9003 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.729024  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:24.729274  9039 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.730273  9060 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.730710  9060 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.731081  9060 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.731760  9039 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.728550  9093 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.735363  9093 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.736919  8982 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.689464  9230 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.718143  9133 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.729704  8906 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.746505  8951 raft_consensus.cc:359] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.747468  8951 raft_consensus.cc:385] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.747793  8951 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.752619  9133 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.754551  8951 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.755146  9133 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:24.766716  8951 ts_tablet_manager.cc:1434] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 12:09:24.773306  8951 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:24.780833  8950 tablet_bootstrap.cc:654] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.773965  8982 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:24.785718  8982 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.790982  9192 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.799878  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.800805  8832 raft_consensus.cc:2393] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:24.806622  9060 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.771416  9175 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:24.815716  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:24.817096  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:24.817888  8831 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:24.787320  9003 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:24.821008  9003 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.824903  9133 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.830008  8906 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
W20260709 12:09:24.848272  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 126837us
W20260709 12:09:24.862691  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 82518.3us
I20260709 12:09:24.908877  8872 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:24.999500  8949 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:25.000137  8949 ts_tablet_manager.cc:1403] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.402s	user 0.016s	sys 0.016s
W20260709 12:09:24.999998  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 91337us
I20260709 12:09:25.002718  8951 tablet_bootstrap.cc:654] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.852396  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 132965us
I20260709 12:09:25.010221  9232 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.833496  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:25.006248  9039 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.022141  9039 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.024281  9039 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:24.867110  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:25.026255  9133 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.026551  9233 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.026631  8758 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:25.027298  9233 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.027822  9233 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.031108  9232 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.020406  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 186962us
W20260709 12:09:25.031038  8724 leader_election.cc:343] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.853679  9192 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.183s
I20260709 12:09:25.038913  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:25.039561  8909 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.040836  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:24.929427  9060 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.044437  8658 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.090391  9241 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.098699  9241 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.115208  8949 raft_consensus.cc:359] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.116250  8949 raft_consensus.cc:385] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.100256  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:25.116597  8949 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.119858  8949 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.120965  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:25.106076  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:25.135759  8949 ts_tablet_manager.cc:1434] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.135s	user 0.009s	sys 0.000s
I20260709 12:09:25.136587  8949 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:25.126852  8832 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:25.143155  8950 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:25.145494  8950 ts_tablet_manager.cc:1403] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.430s	user 0.014s	sys 0.020s
I20260709 12:09:25.150033  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:25.151175  8829 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.157752  9241 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.158939  8950 raft_consensus.cc:359] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:25.156348  8724 leader_election.cc:343] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.159727  8950 raft_consensus.cc:385] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.160089  8950 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
W20260709 12:09:25.160611  8724 leader_election.cc:343] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.166636  9246 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.168397  8951 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:25.168959  8951 ts_tablet_manager.cc:1403] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.396s	user 0.019s	sys 0.008s
I20260709 12:09:25.173627  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:25.172129  8909 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:25.230336  8724 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:25.233263  8950 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:25.235114  9244 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.233s	user 0.001s	sys 0.003s
I20260709 12:09:25.235622  8950 ts_tablet_manager.cc:1434] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.090s	user 0.018s	sys 0.054s
I20260709 12:09:25.236672  8950 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:25.247740  8951 raft_consensus.cc:359] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.248298  8951 raft_consensus.cc:385] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:25.214051  8799 leader_election.cc:343] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.248469  8951 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.249913  8951 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.238361  9246 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.255314  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:25.260497  8951 ts_tablet_manager.cc:1434] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 12:09:25.261349  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:25.262075  8758 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:25.262756  9246 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:09:25.272324  9249 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:09:25.274313  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:25.275061  8830 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.290028  8829 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:25.291909  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:25.292793  8982 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.293161  8982 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.293505  8982 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.302192  8982 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.304610  8982 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.297241  9246 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.305928  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:25.310452  9060 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.310739  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:25.311494  8757 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.310873  9060 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.313067  9060 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.321532  8725 leader_election.cc:343] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.321975  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:25.276262  9233 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.348587  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:25.356244  8908 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:25.356771  9238 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:09:25.356946  9252 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.368484  8982 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.359360  9003 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:25.398538  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:25.406124  9060 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.410055  9060 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.408994  9260 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.418533  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:25.419159  8835 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.425922  8799 leader_election.cc:343] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.426797  8982 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.427213  9233 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:25.424117  9260 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:25.438350  9260 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.447618  8835 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:25.449172  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:25.456207  8757 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:25.459223  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:25.460934  8982 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.461551  8982 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:25.469894  9003 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.472009  9003 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:25.472934  9003 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.474509  8949 tablet_bootstrap.cc:654] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.462602  8982 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:25.481449  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.485672  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:25.492951  8830 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:25.505638  8951 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
W20260709 12:09:25.613428  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 259778us
W20260709 12:09:25.616684  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44512.4us
I20260709 12:09:25.618402  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:25.628726  9272 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.650899  8950 tablet_bootstrap.cc:654] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.652685  8830 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:25.644317  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:25.653766  8905 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:25.658681  9272 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.661589  9258 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.697342  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:25.702951  9272 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.706115  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:25.718428  8798 leader_election.cc:343] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.662431  9258 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.708010  9230 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.720299  9003 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:25.721869  9256 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.060s	user 0.008s	sys 0.003s
I20260709 12:09:25.759656  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:25.751202  9003 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.846422  8902 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:25.855271  9003 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:25.858269  9275 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:09:25.866400  8951 tablet_bootstrap.cc:654] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.871443  8799 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:25.873565  8982 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.874152  8982 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.874571  8982 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.889884  9258 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:25.891847  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:25.884281  8949 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:25.907281  8949 ts_tablet_manager.cc:1403] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.771s	user 0.031s	sys 0.022s
W20260709 12:09:25.909154  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53754.1us
W20260709 12:09:25.915014  8725 leader_election.cc:343] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.921032  9252 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.925349  8982 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.922045  9252 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:25.934729  9274 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.081s	user 0.003s	sys 0.004s
I20260709 12:09:25.945360  9060 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:25.948985  8654 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.952834  8950 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:25.953583  8950 ts_tablet_manager.cc:1403] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.717s	user 0.043s	sys 0.016s
I20260709 12:09:25.946611  8982 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.954226  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:25.956912  8834 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:25.965629  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:25.972746  9252 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:25.973351  8950 raft_consensus.cc:359] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.974156  8949 raft_consensus.cc:359] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.975052  8949 raft_consensus.cc:385] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.975410  8949 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.975667  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:25.976312  8949 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:25.974704  8950 raft_consensus.cc:385] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.978034  8950 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.980715  8950 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:25.982005  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 56847.8us
I20260709 12:09:25.999068  8949 ts_tablet_manager.cc:1434] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.005s
W20260709 12:09:25.999581  8798 leader_election.cc:343] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.000165  8949 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
W20260709 12:09:26.016062  8872 leader_election.cc:343] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.016808  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.017669  8950 ts_tablet_manager.cc:1434] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 12:09:26.014401  9270 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:26.027621  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:26.028851  8829 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:09:26.047516  9271 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.271s	user 0.012s	sys 0.021s
W20260709 12:09:26.043211  9277 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 12:09:26.029419  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.063788  8951 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:26.064342  8951 ts_tablet_manager.cc:1403] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.559s	user 0.015s	sys 0.026s
W20260709 12:09:26.031260  8799 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.031867  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:26.030596  9192 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.099095  8950 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:26.101347  8951 raft_consensus.cc:359] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.102228  8951 raft_consensus.cc:385] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.102614  8951 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.103389  8951 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.107849  9252 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.108559  9252 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:26.113545  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 78795.9us
I20260709 12:09:26.119367  8725 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:26.120275  9039 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:26.119922  8951 ts_tablet_manager.cc:1434] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 12:09:26.122707  9039 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.123338  9039 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:26.123692  8951 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:26.114580  9252 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.140175  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:26.142306  8725 leader_election.cc:343] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.142866  8949 tablet_bootstrap.cc:654] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.145762  9283 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.149688  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:26.166571  8724 leader_election.cc:343] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.168649  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.169334  9003 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.155840  9283 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:26.152416  9261 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:09:26.181161  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.182785  8902 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:26.199501  9039 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:26.202086  8724 leader_election.cc:343] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.202664  8724 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.206681  8949 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:26.207217  8949 ts_tablet_manager.cc:1403] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.012s
I20260709 12:09:26.209221  8950 tablet_bootstrap.cc:654] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.213160  9261 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.218225  8949 raft_consensus.cc:359] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.218788  9192 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.219111  8949 raft_consensus.cc:385] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.219400  8949 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.220034  8951 tablet_bootstrap.cc:654] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.222577  8724 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.223336  9261 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.225272  8949 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.227563  8949 ts_tablet_manager.cc:1434] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:09:26.228276  9039 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.228480  8949 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:26.229971  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:26.235615  8906 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:26.238385  8826 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:26.241523  8799 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:26.242797  9270 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.243284  9270 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:26.244459  9270 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.249583  8826 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:26.251209  8725 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:26.259646  8656 catalog_manager.cc:5697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.261292  8656 catalog_manager.cc:5697] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.263383  8656 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.270825  9272 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.272003  9272 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.274210  9272 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.277518  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:26.278178  8760 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:26.279161  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:26.261897  9261 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:26.279793  9283 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.281332  9197 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.283779  9197 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.283758  9283 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.284556  9197 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.286296  9283 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.290200  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.291932  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:26.289808  9261 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:09:26.295161  8725 leader_election.cc:343] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.312660  8799 leader_election.cc:343] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.294313  9261 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.332079  9197 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.335325  9232 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.336953  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:26.337551  8760 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.335986  9232 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.333354  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.348093  9197 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:09:26.350952  8724 leader_election.cc:343] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.351528  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.353084  9176 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.353466  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:26.354146  8758 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:26.354892  8949 tablet_bootstrap.cc:654] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.356388  8760 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:26.357568  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:26.358680  9197 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.359233  9197 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:26.360168  9197 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.360549  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:26.371470  9232 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:26.362710  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:26.374019  8906 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:26.374260  9192 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.374703  9192 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.374879  8951 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:26.375823  8951 ts_tablet_manager.cc:1403] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.252s	user 0.019s	sys 0.033s
I20260709 12:09:26.367811  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:26.374949  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:26.378561  8874 leader_election.cc:343] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.375061  9192 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.381932  8951 raft_consensus.cc:359] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.382529  8951 raft_consensus.cc:385] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.382747  8951 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
W20260709 12:09:26.383531  8799 leader_election.cc:343] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.383306  8951 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.391125  8951 ts_tablet_manager.cc:1434] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:09:26.393514  8656 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.408118  8950 tablet_bootstrap.cc:492] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:26.408561  8950 ts_tablet_manager.cc:1403] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.310s	user 0.017s	sys 0.014s
W20260709 12:09:26.407496  9298 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:09:26.426843  9192 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.422529  8950 raft_consensus.cc:359] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.433925  8950 raft_consensus.cc:385] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.434471  8950 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.435743  8950 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.441388  8951 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:26.448946  8950 ts_tablet_manager.cc:1434] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:09:26.457063  8906 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:26.460754  9192 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:26.464375  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:26.464470  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:26.465426  8760 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.468906  8950 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
W20260709 12:09:26.478483  8874 leader_election.cc:343] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.487550  8949 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:26.488109  8949 ts_tablet_manager.cc:1403] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.260s	user 0.018s	sys 0.004s
I20260709 12:09:26.494097  8949 raft_consensus.cc:359] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.494609  8949 raft_consensus.cc:385] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.494872  8949 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.495007  8951 tablet_bootstrap.cc:654] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.495510  8949 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.497613  8949 ts_tablet_manager.cc:1434] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:26.498596  8949 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:26.500208  8951 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:26.500746  8951 ts_tablet_manager.cc:1403] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 12:09:26.501834  8950 tablet_bootstrap.cc:654] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.503904  8951 raft_consensus.cc:359] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.504652  8951 raft_consensus.cc:385] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.504990  8951 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.558008  8903 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.571630  8949 tablet_bootstrap.cc:654] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.559219  8658 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 2, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.604158  9240 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.605304  9240 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.505904  8951 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.643379  8951 ts_tablet_manager.cc:1434] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.142s	user 0.009s	sys 0.000s
W20260709 12:09:26.619554  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 65444.1us
I20260709 12:09:26.661229  9230 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:09:26.671084  9230 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.702323  8951 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:26.710403  9240 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.718521  8950 tablet_bootstrap.cc:492] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:26.719444  8950 ts_tablet_manager.cc:1403] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.269s	user 0.007s	sys 0.009s
I20260709 12:09:26.725857  9003 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.726963  9003 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.749475  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:26.751235  9003 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.751392  8758 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:26.763559  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.764073  8760 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
W20260709 12:09:26.765952  8724 leader_election.cc:343] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.772974  8950 raft_consensus.cc:359] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.774080  8950 raft_consensus.cc:385] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.780427  8909 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:26.778043  8950 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.784346  9238 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:26.797016  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:26.798231  9270 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.798338  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:26.798677  9270 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.799322  9270 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.807598  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.811566  9230 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:26.813829  8798 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.817209  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:26.820149  9232 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.825671  9232 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:26.826963  9232 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.828948  8834 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:26.830019  8656 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.824164  8950 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.838968  8950 ts_tablet_manager.cc:1434] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.013s
W20260709 12:09:26.839743  8725 leader_election.cc:343] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.840587  8950 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:26.840410  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.841549  9237 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:26.856891  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49629.7us
I20260709 12:09:26.856369  9039 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:26.863999  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:26.864027  8949 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:26.865429  8949 ts_tablet_manager.cc:1403] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.367s	user 0.024s	sys 0.006s
I20260709 12:09:26.864192  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:26.873348  9305 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.874136  9305 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:26.881985  8799 leader_election.cc:343] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.887208  8982 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.874390  9270 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.901566  8951 tablet_bootstrap.cc:654] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.907083  8874 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:26.915171  8903 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.917124  8949 raft_consensus.cc:359] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.917966  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:26.919422  8798 leader_election.cc:343] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.919590  9270 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.921618  9305 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:26.922426  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:26.923096  8757 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.918105  8949 raft_consensus.cc:385] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.931957  8949 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.933035  8949 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:26.934849  8949 ts_tablet_manager.cc:1434] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
I20260709 12:09:26.935807  9230 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:26.936223  8949 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:26.938773  8658 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:27.022615  9309 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:09:27.049695  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:27.051450  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:27.058456  8799 leader_election.cc:343] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.060186  8799 leader_election.cc:343] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.044445  8757 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:27.060783  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.065574  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.073668  8951 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.075954  9296 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:27.069120  9272 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.089622  8951 ts_tablet_manager.cc:1403] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.388s	user 0.039s	sys 0.027s
I20260709 12:09:27.095798  9270 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.099164  9270 raft_consensus.cc:697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:27.100144  9270 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.112543  8949 tablet_bootstrap.cc:654] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.118989  8951 raft_consensus.cc:359] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.119868  8951 raft_consensus.cc:385] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.120162  8951 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.121121  8951 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.122975  8951 ts_tablet_manager.cc:1434] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.032s	user 0.000s	sys 0.006s
I20260709 12:09:27.124375  8951 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.134603  9176 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.139484  9176 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.145831  9176 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.146629  8950 tablet_bootstrap.cc:654] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.152458  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:27.158666  8725 leader_election.cc:343] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.175622  9232 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.176203  9232 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:27.175837  9311 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:09:27.193311  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:27.217257  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.222365  8949 tablet_bootstrap.cc:492] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.222901  8949 ts_tablet_manager.cc:1403] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.287s	user 0.011s	sys 0.051s
I20260709 12:09:27.220237  9197 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:27.238030  9232 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:27.249526  8724 leader_election.cc:343] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.250185  8724 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:27.265288  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:27.261051  9306 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.269479  9306 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.271989  9306 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.272331  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:27.261507  9039 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.285669  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:27.288367  8799 leader_election.cc:343] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.287683  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:27.293506  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:27.295745  8950 tablet_bootstrap.cc:492] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.299561  8951 tablet_bootstrap.cc:654] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.300773  8950 ts_tablet_manager.cc:1403] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.461s	user 0.033s	sys 0.026s
I20260709 12:09:27.304708  8656 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.321412  8950 raft_consensus.cc:359] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.322137  8950 raft_consensus.cc:385] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.322403  8950 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.323006  8950 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.327028  8907 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.328783  8798 leader_election.cc:343] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.329465  8798 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.330466  9240 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.332974  8949 raft_consensus.cc:359] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.333732  8949 raft_consensus.cc:385] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.334017  8949 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.334724  8949 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.340775  9316 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:27.345276  8950 ts_tablet_manager.cc:1434] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:09:27.347446  8950 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.350014  8949 ts_tablet_manager.cc:1434] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.000s
I20260709 12:09:27.352210  8949 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.353120  8950 tablet_bootstrap.cc:654] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.368593  8949 tablet_bootstrap.cc:654] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.382740  8949 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.383473  8949 ts_tablet_manager.cc:1403] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 12:09:27.384857  8951 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.385435  8951 ts_tablet_manager.cc:1403] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.261s	user 0.022s	sys 0.001s
I20260709 12:09:27.388046  8949 raft_consensus.cc:359] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.389215  8949 raft_consensus.cc:385] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.389633  8949 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.390822  8949 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.393132  8949 ts_tablet_manager.cc:1434] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:27.395196  8951 raft_consensus.cc:359] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.395970  8951 raft_consensus.cc:385] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.396248  8951 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.396926  8951 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.398463  8949 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.401109  8951 ts_tablet_manager.cc:1434] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:27.402289  8951 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.417060  9316 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.417425  8949 tablet_bootstrap.cc:654] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.417203  8950 tablet_bootstrap.cc:492] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.421182  8950 ts_tablet_manager.cc:1403] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.074s	user 0.043s	sys 0.024s
I20260709 12:09:27.424149  8950 raft_consensus.cc:359] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.424965  8950 raft_consensus.cc:385] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.425206  8950 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.425956  8950 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.428193  8950 ts_tablet_manager.cc:1434] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:09:27.429870  8874 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.430367  8950 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.431308  8951 tablet_bootstrap.cc:654] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.444242  8950 tablet_bootstrap.cc:654] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.447880  8949 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.454504  8949 ts_tablet_manager.cc:1403] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.000s
I20260709 12:09:27.459679  8949 raft_consensus.cc:359] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.460739  8949 raft_consensus.cc:385] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.461073  8949 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.476419  8949 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.479183  8949 ts_tablet_manager.cc:1434] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:09:27.480269  8949 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.482542  8950 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.483111  8950 ts_tablet_manager.cc:1403] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.004s
I20260709 12:09:27.485924  8951 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.486405  8951 ts_tablet_manager.cc:1403] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.021s
I20260709 12:09:27.486436  8950 raft_consensus.cc:359] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.487305  8950 raft_consensus.cc:385] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.487592  8950 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.488291  8950 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.489235  8951 raft_consensus.cc:359] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.489943  8951 raft_consensus.cc:385] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.490231  8951 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.490973  8951 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.493340  8951 ts_tablet_manager.cc:1434] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:27.494355  8949 tablet_bootstrap.cc:654] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.495836  8950 ts_tablet_manager.cc:1434] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:27.497051  8950 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.498606  8951 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.499169  9306 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.499639  9306 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.502038  9306 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.503027  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.503614  8907 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:27.505005  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:27.506059  9306 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.506518  9306 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.510413  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:27.511268  8760 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:27.506938  9306 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.516004  8950 tablet_bootstrap.cc:654] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.518769  8951 tablet_bootstrap.cc:654] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.556782  9240 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.587337  9306 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.593487  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:27.594089  8907 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.596570  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:27.597476  8760 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.605420  8907 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:27.606763  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:27.607592  9240 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.608072  9240 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:27.609714  9240 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.597113  9306 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.614908  8760 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:27.620082  8950 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.620476  8949 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.621137  8949 ts_tablet_manager.cc:1403] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.141s	user 0.046s	sys 0.056s
I20260709 12:09:27.624861  8949 raft_consensus.cc:359] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.625274  8950 ts_tablet_manager.cc:1403] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.040s
I20260709 12:09:27.625568  8949 raft_consensus.cc:385] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.625890  8949 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.626575  8949 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.627173  8907 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.624287  8951 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.628749  8951 ts_tablet_manager.cc:1403] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.130s	user 0.019s	sys 0.008s
I20260709 12:09:27.629567  8949 ts_tablet_manager.cc:1434] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:09:27.630704  8949 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.636612  8949 tablet_bootstrap.cc:654] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.636286  8951 raft_consensus.cc:359] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.637001  8951 raft_consensus.cc:385] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.637265  8951 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.638012  8951 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.640583  8951 ts_tablet_manager.cc:1434] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:09:27.641819  8951 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.641649  8950 raft_consensus.cc:359] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.642663  8656 catalog_manager.cc:5697] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.653052  8950 raft_consensus.cc:385] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.653414  8950 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.654070  8950 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.652127  8949 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.655113  8949 ts_tablet_manager.cc:1403] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:09:27.656239  8950 ts_tablet_manager.cc:1434] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:09:27.657298  8950 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.658903  9306 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.668442  9039 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.669086  9039 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.671768  9039 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.679299  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.697299  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:27.698026  8832 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:27.699421  8951 tablet_bootstrap.cc:654] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.699226  8725 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:27.700840  9127 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.701332  9127 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.701706  9127 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.696058  8949 raft_consensus.cc:359] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.711549  8949 raft_consensus.cc:385] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.711896  8949 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.712245  8724 leader_election.cc:343] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.712781  8949 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.721256  8949 ts_tablet_manager.cc:1434] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.002s
I20260709 12:09:27.722301  8950 tablet_bootstrap.cc:654] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.722951  8949 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.726397  9127 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.729781  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:27.730374  8832 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.738096  8949 tablet_bootstrap.cc:654] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.752095  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:09:27.753489  8724 leader_election.cc:343] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.753360  8832 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:27.754773  9039 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.755271  9039 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.757323  8951 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.757845  8951 ts_tablet_manager.cc:1403] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.116s	user 0.030s	sys 0.045s
I20260709 12:09:27.757827  9039 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.759795  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:27.760444  8829 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:27.760743  8950 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.761191  8950 ts_tablet_manager.cc:1403] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.000s
I20260709 12:09:27.761878  8951 raft_consensus.cc:359] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.762607  8951 raft_consensus.cc:385] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.762869  8951 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.763489  8951 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.763885  8725 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:27.764010  8950 raft_consensus.cc:359] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.764688  8950 raft_consensus.cc:385] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.764993  8950 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.765369  9176 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.765750  9176 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.765683  8950 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.766240  9176 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.767330  8949 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.767841  8949 ts_tablet_manager.cc:1403] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.012s
I20260709 12:09:27.770723  8949 raft_consensus.cc:359] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.771391  8949 raft_consensus.cc:385] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.771705  8949 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.771991  8760 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.772322  8949 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.774587  8949 ts_tablet_manager.cc:1434] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:09:27.775070  9176 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.775653  8949 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.765784  8951 ts_tablet_manager.cc:1434] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:27.777721  8951 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.778070  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:27.778666  8826 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.754012  9127 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.787154  8949 tablet_bootstrap.cc:654] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.789937  8725 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.791668  9039 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.792165  9039 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:27.792439  8951 tablet_bootstrap.cc:654] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.793375  8950 ts_tablet_manager.cc:1434] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:09:27.794299  9240 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.794857  9240 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.799187  9240 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.800047  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:27.801190  8949 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.806850  8949 ts_tablet_manager.cc:1403] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 12:09:27.807730  9003 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.808442  9003 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.810540  9003 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.810645  8949 raft_consensus.cc:359] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.814286  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:27.815331  8829 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:27.816329  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.811466  8949 raft_consensus.cc:385] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.820288  8949 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.820554  8724 leader_election.cc:343] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.812530  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.821086  8949 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.822886  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:27.824611  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.824985  8799 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.825543  9238 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.825757  9306 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.825960  9238 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:27.826236  8724 leader_election.cc:343] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.826324  9238 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.826817  8949 ts_tablet_manager.cc:1434] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 12:09:27.827863  8949 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.829073  9039 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.834015  8950 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.835736  9238 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.838977  8826 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:27.841930  8949 tablet_bootstrap.cc:654] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.875082  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:27.843647  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:27.845559  9176 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.855592  8951 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.842401  8950 tablet_bootstrap.cc:654] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.877522  8951 ts_tablet_manager.cc:1403] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.009s
W20260709 12:09:27.877612  8724 leader_election.cc:343] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.878351  8724 leader_election.cc:343] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.878803  9238 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.881065  8951 raft_consensus.cc:359] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.882006  8951 raft_consensus.cc:385] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.882345  8951 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.883211  8951 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.886143  8951 ts_tablet_manager.cc:1434] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:27.887485  8951 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.889539  8725 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.894606  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:27.895358  8832 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.896000  8951 tablet_bootstrap.cc:654] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.906194  8950 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.906706  8950 ts_tablet_manager.cc:1403] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.010s
I20260709 12:09:27.905954  8656 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.898887  9039 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.903192  8949 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.908236  9039 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:27.908543  8949 ts_tablet_manager.cc:1403] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.008s
I20260709 12:09:27.909250  9039 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.911443  8826 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.911356  8949 raft_consensus.cc:359] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.912143  8949 raft_consensus.cc:385] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.912434  8949 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.913103  8949 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.915819  8950 raft_consensus.cc:359] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.916512  8950 raft_consensus.cc:385] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.916805  8950 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.922483  8949 ts_tablet_manager.cc:1434] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:27.923627  8949 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:27.917462  8950 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.926131  8950 ts_tablet_manager.cc:1434] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:27.927083  8950 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:27.927914  8832 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:27.933626  8949 tablet_bootstrap.cc:654] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.934171  8951 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:27.934670  8951 ts_tablet_manager.cc:1403] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 12:09:27.938167  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.939285  9039 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.940158  9039 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:27.941227  9039 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.955379  8951 raft_consensus.cc:359] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.957947  8951 raft_consensus.cc:385] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.958246  8951 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.958905  8951 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.961869  8949 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:27.962594  8949 ts_tablet_manager.cc:1403] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 12:09:27.963096  8951 ts_tablet_manager.cc:1434] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.002s
I20260709 12:09:27.965068  8951 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:27.967474  8950 tablet_bootstrap.cc:654] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.973878  9039 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.974489  9039 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.980786  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:27.982481  8724 leader_election.cc:343] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.983996  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:27.983533  8658 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.984812  8826 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:27.985229  9039 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:27.986138  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:27.986939  9127 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.987322  9127 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.987668  9127 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.993726  8950 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:27.993832  9127 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.994940  8949 raft_consensus.cc:359] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:27.997117  8949 raft_consensus.cc:385] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.996971  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:27.997411  8949 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.998327  8724 leader_election.cc:343] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.998832  9127 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.000111  8951 tablet_bootstrap.cc:654] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.000350  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:27.994376  8950 ts_tablet_manager.cc:1403] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.011s
I20260709 12:09:28.001003  8832 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.003990  8950 raft_consensus.cc:359] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.004820  8950 raft_consensus.cc:385] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.005148  8950 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.005074  8658 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.006139  8950 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.011363  8949 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.013854  8949 ts_tablet_manager.cc:1434] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:09:28.015064  8949 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:28.019287  8950 ts_tablet_manager.cc:1434] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 12:09:28.020493  8950 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:28.023921  8949 tablet_bootstrap.cc:654] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.027364  8950 tablet_bootstrap.cc:654] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.027513  9315 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.028191  9315 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.034515  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.035449  8760 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:28.041904  9315 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.051813  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:28.057121  8874 leader_election.cc:343] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.060425  9240 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.063051  9039 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.063670  9039 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.065903  9039 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.066018  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.067955  9039 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.068439  9039 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.069478  9316 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.069923  9316 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.070362  9316 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.071192  9039 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.085841  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:28.087106  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:28.088433  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.092483  8951 tablet_bootstrap.cc:492] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:28.093071  8951 ts_tablet_manager.cc:1403] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.004s
I20260709 12:09:28.095044  8950 tablet_bootstrap.cc:492] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:28.096921  8951 raft_consensus.cc:359] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.097616  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.098320  8951 raft_consensus.cc:385] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.098727  8951 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.099854  8949 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:28.099664  8951 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.098426  8950 ts_tablet_manager.cc:1403] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.035s
W20260709 12:09:28.100919  8725 leader_election.cc:343] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:28.102491  8725 leader_election.cc:343] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.099789  9358 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.103114  9358 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.104007  8949 ts_tablet_manager.cc:1403] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.020s
I20260709 12:09:28.105567  9358 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.106472  8950 raft_consensus.cc:359] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.108296  8950 raft_consensus.cc:385] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.108656  8950 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.108485  8949 raft_consensus.cc:359] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:28.109169  8724 leader_election.cc:343] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.108860  8951 ts_tablet_manager.cc:1434] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:28.110693  8951 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:28.109633  8724 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.109519  8949 raft_consensus.cc:385] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.114640  8949 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.114789  9039 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.115482  8949 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:28.115947  8724 leader_election.cc:343] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.116425  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.118003  8949 ts_tablet_manager.cc:1434] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:28.119234  8949 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:28.117955  9039 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.109652  8950 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.127117  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.128016  8826 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:28.122216  8951 tablet_bootstrap.cc:654] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.129179  8950 ts_tablet_manager.cc:1434] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:09:28.129228  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.130594  8950 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:28.141186  8874 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.143821  9230 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.157287  8832 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:28.158931  9316 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.163300  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:28.164167  9039 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.165009  9039 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:28.168072  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:28.168916  8826 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.169049  9362 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:28.174257  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:28.174535  9315 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.175001  8755 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.175026  9315 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.178001  9358 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.166136  9039 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.178453  9358 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.181679  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.182363  8831 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:28.183269  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.183879  8760 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:28.185005  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:28.164552  9316 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.185865  9315 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.237047  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.229462  9358 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.239938  9364 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.263286  9364 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.263652  9364 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.266821  8950 tablet_bootstrap.cc:654] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.282166  9360 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.285048  9360 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.295003  9360 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.298931  9230 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.303732  9272 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.304544  9272 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.305953  8949 tablet_bootstrap.cc:654] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.304303  8755 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:28.316988  8951 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:28.317509  8951 ts_tablet_manager.cc:1403] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.008s
I20260709 12:09:28.334219  9272 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.335544  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.345845  9283 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.346401  9283 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.353742  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:28.328806  8826 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
W20260709 12:09:28.361882  8724 leader_election.cc:343] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.336336  8833 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:28.348531  9283 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.368394  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:28.374606  9360 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.375074  9360 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.375442  9360 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.375805  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.377477  9283 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:28.379758  8725 leader_election.cc:343] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.380203  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.381932  9176 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.384225  9360 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.385138  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:28.386459  8909 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:09:28.401662  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:28.405790  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:28.408526  9230 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.409085  9230 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:28.368534  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.409729  8951 raft_consensus.cc:359] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.409957  9230 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.410331  8755 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
W20260709 12:09:28.412076  9363 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:09:28.412009  8798 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:28.416285  9270 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.416795  9270 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.417209  9270 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.410519  8951 raft_consensus.cc:385] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.421478  8951 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.422372  8951 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.424594  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.425789  8831 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:09:28.431532  8951 ts_tablet_manager.cc:1434] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.003s
I20260709 12:09:28.432205  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.432961  8755 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:28.435209  8951 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:28.458796  8950 tablet_bootstrap.cc:492] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:28.459327  8950 ts_tablet_manager.cc:1403] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.329s	user 0.035s	sys 0.027s
I20260709 12:09:28.461885  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:28.462766  8755 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.472534  8874 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.473495  9238 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.480798  9365 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.484910  9039 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.485436  9039 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.487061  8949 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:28.487555  8949 ts_tablet_manager.cc:1403] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.369s	user 0.023s	sys 0.025s
I20260709 12:09:28.489631  9039 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.445107  9270 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.510917  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.476234  9372 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
W20260709 12:09:28.515959  8725 leader_election.cc:343] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:28.516423  8724 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.528853  8950 raft_consensus.cc:359] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.529680  8950 raft_consensus.cc:385] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.529966  8950 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.536193  8950 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.507548  9364 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.519369  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:28.542436  9364 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:28.543149  8724 leader_election.cc:343] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.543633  8724 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.544584  9127 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.561882  9365 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.563182  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:28.569761  8758 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.537853  8755 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:28.573429  9361 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.573555  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:28.574272  8827 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.573984  9361 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.575939  8872 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:28.565389  9360 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.579392  9365 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.585271  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:28.586203  8831 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:28.603660  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:28.591277  9365 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:28.601699  9270 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.607125  8949 raft_consensus.cc:359] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.607911  8949 raft_consensus.cc:385] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.608170  8949 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.608423  9361 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.608829  8949 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.609936  9283 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.611065  8949 ts_tablet_manager.cc:1434] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.001s
I20260709 12:09:28.612241  8949 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Bootstrap starting.
I20260709 12:09:28.613027  8951 tablet_bootstrap.cc:654] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.613983  8758 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:28.616541  8950 ts_tablet_manager.cc:1434] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.157s	user 0.010s	sys 0.004s
I20260709 12:09:28.617396  8872 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:28.619867  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:28.622505  8799 leader_election.cc:343] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.619653  9315 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.625793  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:28.631197  8950 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:28.632288  9315 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:28.635432  9315 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.643142  8757 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 1: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:09:28.642359  8654 catalog_manager.cc:5697] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.651199  9230 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.659229  9230 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.653836  9283 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:28.662282  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.663075  8758 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:28.633754  8827 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:28.672780  8798 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:28.682694  9127 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.640806  9365 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.708221  9230 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:28.708490  8949 tablet_bootstrap.cc:654] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.696171  9362 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.729347  8951 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:28.729923  8951 ts_tablet_manager.cc:1403] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.295s	user 0.019s	sys 0.000s
I20260709 12:09:28.734082  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:28.738853  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:28.723040  9362 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.742491  9362 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.745159  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:28.750547  9367 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:28.779284  9382 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 12:09:28.794806  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:28.799120  9272 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.818019  8950 tablet_bootstrap.cc:654] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.799985  9362 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.825340  8951 raft_consensus.cc:359] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.826159  8951 raft_consensus.cc:385] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.826555  8951 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.828425  9362 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:28.827219  8951 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.830176  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:28.833459  8757 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.835006  8909 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.835227  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:28.898538  8951 ts_tablet_manager.cc:1434] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.168s	user 0.013s	sys 0.005s
I20260709 12:09:28.899813  8951 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:28.901602  8757 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:28.909895  8949 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: No bootstrap required, opened a new log
I20260709 12:09:28.910822  8949 ts_tablet_manager.cc:1403] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Time spent bootstrapping tablet: real 0.299s	user 0.023s	sys 0.012s
I20260709 12:09:28.914165  8950 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:28.914799  8950 ts_tablet_manager.cc:1403] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.285s	user 0.011s	sys 0.013s
I20260709 12:09:28.916769  9230 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:28.919937  8799 leader_election.cc:343] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.922883  8798 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:28.932472  9306 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.935258  9306 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:28.936568  9306 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.947237  8949 raft_consensus.cc:359] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.948235  8949 raft_consensus.cc:385] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.948483  8949 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.949055  8949 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.951097  8658 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.954608  8949 ts_tablet_manager.cc:1434] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 12:09:28.955746  8950 raft_consensus.cc:359] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.955526  8658 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.956466  8950 raft_consensus.cc:385] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.956827  8950 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.957605  8658 catalog_manager.cc:5697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.959389  8950 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:28.966979  8950 ts_tablet_manager.cc:1434] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:09:28.958627  9238 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:28.968178  8950 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:28.995540  9374 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:29.002192  8951 tablet_bootstrap.cc:654] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.009457  8950 tablet_bootstrap.cc:654] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.054425  8950 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:29.054530  8951 tablet_bootstrap.cc:492] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:29.054930  8951 ts_tablet_manager.cc:1403] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.004s
I20260709 12:09:29.054930  8950 ts_tablet_manager.cc:1403] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.016s
I20260709 12:09:29.056214  8656 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.057653  8951 raft_consensus.cc:359] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.058346  8951 raft_consensus.cc:385] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.058620  8951 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.058915  8950 raft_consensus.cc:359] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.059561  8950 raft_consensus.cc:385] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.059269  8951 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.059823  8950 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.061336  8951 ts_tablet_manager.cc:1434] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:29.062300  8951 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:29.066985  8950 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.068197  8951 tablet_bootstrap.cc:654] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.068857  8950 ts_tablet_manager.cc:1434] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:29.069907  8950 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:29.082073  8950 tablet_bootstrap.cc:654] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.085940  8951 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:29.086411  8951 ts_tablet_manager.cc:1403] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 12:09:29.089471  8951 raft_consensus.cc:359] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.090142  8951 raft_consensus.cc:385] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.090421  8951 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.091238  8951 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.093668  8951 ts_tablet_manager.cc:1434] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:29.098065  8951 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:29.103902  8951 tablet_bootstrap.cc:654] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.115217  8950 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:29.115788  8950 ts_tablet_manager.cc:1403] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:09:29.117918  9374 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.118474  9374 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.120519  9374 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:29.120574  8950 raft_consensus.cc:359] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.121309  8950 raft_consensus.cc:385] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.121582  8950 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.122195  8950 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.124585  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.125103  8950 ts_tablet_manager.cc:1434] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:09:29.125279  8757 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:29.125139  8951 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:29.126137  8950 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:29.127139  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:29.127709  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:29.127714  8835 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:29.126147  8951 ts_tablet_manager.cc:1403] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:09:29.129271  9306 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.129786  9306 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.131279  9230 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.131691  9230 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.132055  9230 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.132880  8950 tablet_bootstrap.cc:654] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.132879  8951 raft_consensus.cc:359] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.133772  8951 raft_consensus.cc:385] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.134044  8951 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.134936  8951 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.138038  8951 ts_tablet_manager.cc:1434] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:29.139287  8951 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Bootstrap starting.
I20260709 12:09:29.140311  9306 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:29.140218  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.141431  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
I20260709 12:09:29.142971  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:29.145284  9361 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.145676  9361 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.146034  9361 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.147145  8951 tablet_bootstrap.cc:654] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.150166  9365 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.156477  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:29.158455  9374 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:29.158830  8799 leader_election.cc:343] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.159194  8951 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: No bootstrap required, opened a new log
I20260709 12:09:29.159731  8951 ts_tablet_manager.cc:1403] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:09:29.162539  8951 raft_consensus.cc:359] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.163285  8951 raft_consensus.cc:385] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.163563  8951 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.164232  8951 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.166911  8951 ts_tablet_manager.cc:1434] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:29.193085  9361 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.199759  9230 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.203068  9230 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:29.204859  9361 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:29.208393  8950 tablet_bootstrap.cc:492] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:29.209276  8950 ts_tablet_manager.cc:1403] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.044s
I20260709 12:09:29.209589  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:29.210182  8757 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.213382  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:29.213449  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:29.213984  8835 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.214183  8759 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.214483  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:29.216604  8950 raft_consensus.cc:359] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.217250  8950 raft_consensus.cc:385] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.217495  8950 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.218044  8950 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.220059  8950 ts_tablet_manager.cc:1434] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.000s
W20260709 12:09:29.221537  8799 leader_election.cc:343] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.228794  8950 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:29.232528  8759 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:29.236197  8835 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:29.237325  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:29.238152  9230 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.238811  9230 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:29.239639  9230 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.242025  9374 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.243145  9365 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.243686  9365 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.249522  9365 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:29.249907  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:29.252074  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:29.253192  9362 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.253685  9362 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:29.254274  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:29.254510  9362 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.254912  8835 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:29.255661  8950 tablet_bootstrap.cc:654] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.256311  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:29.256541  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.257227  8760 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 0.
I20260709 12:09:29.257467  9365 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.257992  9365 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.258505  9365 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.264699  8950 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:29.265672  8950 ts_tablet_manager.cc:1403] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:09:29.268203  8950 raft_consensus.cc:359] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.268901  8950 raft_consensus.cc:385] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.269155  8950 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.269742  8950 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.278363  9238 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.278901  9238 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.279620  8658 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.281137  9238 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:29.282121  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:29.283106  8827 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:29.286041  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:29.288508  9372 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.289111  9372 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.289559  9372 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.303968  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:29.304879  8950 ts_tablet_manager.cc:1434] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:09:29.306757  8950 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:29.307017  9365 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.309095  9365 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:29.316783  8950 tablet_bootstrap.cc:654] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.305088  8909 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 0.
I20260709 12:09:29.319459  9374 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.324121  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:29.324882  8831 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.326170  9372 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.328933  9372 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:29.329444  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:29.330111  8757 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.335175  9358 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.335731  9358 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.335587  8658 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.337250  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:29.337857  8907 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.338121  9358 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:29.360347  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.366472  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:29.496311  8950 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
I20260709 12:09:29.497092  8950 ts_tablet_manager.cc:1403] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.191s	user 0.026s	sys 0.050s
I20260709 12:09:29.500898  8950 raft_consensus.cc:359] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.501919  8950 raft_consensus.cc:385] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.502293  8950 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.503150  8950 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.508195  8907 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:09:29.509961  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 141349us
I20260709 12:09:29.527318  8950 ts_tablet_manager.cc:1434] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.005s
I20260709 12:09:29.564752  8950 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Bootstrap starting.
I20260709 12:09:29.522825  9367 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.516997  8757 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:29.586686  8724 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:29.594353  9039 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.594909  9039 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:29.596052  9039 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.578203  9367 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.639592  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:29.640381  8835 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.630106  9370 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.654798  9370 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.659607  8831 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:09:29.662416  9370 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:29.662629  9367 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:29.679097  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 81043.4us
I20260709 12:09:29.681718  8950 tablet_bootstrap.cc:654] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.672439  8835 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:09:29.688604  8874 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:29.696235  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:29.690776  9358 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.700138  9358 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.700695  9358 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:29.701503  9358 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:29.718298  8706 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:29.723649  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:29.729854  8909 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.778029  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:29.781559  8902 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.798826  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.827945  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:29.828702  8759 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 0.
W20260709 12:09:29.844842  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45749.2us
I20260709 12:09:29.848764  8757 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 1: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:09:29.856048  8658 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.860778  8950 tablet_bootstrap.cc:492] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: No bootstrap required, opened a new log
W20260709 12:09:29.861335  8799 leader_election.cc:343] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.861660  8950 ts_tablet_manager.cc:1403] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent bootstrapping tablet: real 0.297s	user 0.018s	sys 0.017s
I20260709 12:09:29.874073  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:29.892805  9412 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.909523  8907 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.916061  8654 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.921954  9419 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.878356  9306 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:09:29.914760  9412 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.943945  8872 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:09:29.950995  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 74043.6us
I20260709 12:09:29.942015  9412 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.960778  9374 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.973910  9425 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.957016  8950 raft_consensus.cc:359] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.976464  8950 raft_consensus.cc:385] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.976795  8950 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.977429  8950 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.981377  9418 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.989606  8950 ts_tablet_manager.cc:1434] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.000s
W20260709 12:09:30.008579  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 84142.4us
I20260709 12:09:29.994421  9419 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.022480  9419 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:29.993350  9418 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:09:30.088892  9272 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.089529  9412 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:30.087325  9419 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:30.148309  9432 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.154145  9412 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:30.159395  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:30.160336  8755 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:30.180022  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 140122us
I20260709 12:09:30.198937  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:30.223471  8755 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:09:30.231495  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:30.255298  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:30.264621  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:30.265309  8909 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.275130  9433 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:30.272957  9444 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.309172  9444 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:30.310156  9444 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:30.351549  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71425.8us
W20260709 12:09:30.354652  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 54536.6us
I20260709 12:09:30.422964  8909 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
W20260709 12:09:30.426811  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74292.5us
I20260709 12:09:30.428867  8874 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:09:30.465806  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 86352.6us
I20260709 12:09:30.440780  9424 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:30.517953  9456 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:09:30.519241  9452 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:09:30.536923  9424 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.574049  9419 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:30.713587  8658 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.726052  9440 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.750479  9444 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:32.514092  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:32.521734  9478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:32.525339  7578 server_base.cc:1061] running on GCE node
W20260709 12:09:32.526649  9481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:32.526899  9479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:32.530987  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:32.531255  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:32.531422  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783598972531407 us; error 0 us; skew 500 ppm
I20260709 12:09:32.532023  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:32.536187  7578 webserver.cc:533] Webserver started at http://127.7.102.132:45731/ using document root <none> and password file <none>
I20260709 12:09:32.537029  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:32.537350  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:32.537838  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:32.539928  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-3-root/instance:
uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
format_stamp: "Formatted at 2026-07-09 12:09:32 on dist-test-slave-p7fg"
I20260709 12:09:32.547354  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:09:32.552428  9486 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.553604  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:32.554028  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
format_stamp: "Formatted at 2026-07-09 12:09:32 on dist-test-slave-p7fg"
I20260709 12:09:32.554437  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:32.579857  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:32.581414  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:32.583153  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:32.585724  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:32.585908  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.586280  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:32.586447  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.657684  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.132:32899
I20260709 12:09:32.657859  9549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.132:32899 every 8 connection(s)
I20260709 12:09:32.662210  7578 auto_leader_rebalancer-test.cc:439] add a tserver: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:32.685985  9550 heartbeater.cc:344] Connected to a master server at 127.7.102.190:46065
I20260709 12:09:32.687467  9550 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:32.688525  9550 heartbeater.cc:507] Master 127.7.102.190:46065 requested a full tablet report, sending...
I20260709 12:09:32.690779  8658 ts_manager.cc:194] Registered new tserver with Master: eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:32.692683  8658 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44342
I20260709 12:09:33.035813  8900 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.043634  8757 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.044087  8828 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.045754  9554 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.046849  9367 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.062027  9476 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.068696  8757 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.072664  8828 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:33.078240  8875 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59b21cd8e1b445658842748734f3cc01. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.110157  8658 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.125205  8828 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.137398  8906 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.140949  9413 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.151994  8752 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.154325  9440 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.173352  9413 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:33.188077  8801 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63977b2ac46b48f0ba26c573aeeb69fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.197191  8906 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.206761  8752 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.216552  8658 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.231949  8752 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.242331  8900 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.244035  9039 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.244644  8828 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.246454  9491 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.255802  9491 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.258010  8900 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.267496  8832 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.275403  8906 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.280725  8656 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.293841  8752 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:33.295961  8875 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a82912909b984cbb88197808b3d66347. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.296541  9476 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.298969  8832 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.301451  9476 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:33.306803  8726 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d58802311724215aa71fccdaeca35f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.318958  9554 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.320955  8757 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.324586  8832 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:33.343303  8654 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.472448  9582 ts_tablet_manager.cc:933] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:33.478385  9582 tablet_copy_client.cc:323] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:33.503347  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet 59b21cd8e1b445658842748734f3cc01 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:33.504006  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet 59b21cd8e1b445658842748734f3cc01 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-59b21cd8e1b445658842748734f3cc01
I20260709 12:09:33.517978  8919 tablet_copy_source_session.cc:215] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.522507  9582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b21cd8e1b445658842748734f3cc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.543537  9582 tablet_copy_client.cc:806] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.544342  9582 tablet_copy_client.cc:670] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.549399  9582 tablet_copy_client.cc:538] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.559991  9582 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:33.582275  9582 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.583233  9582 tablet_bootstrap.cc:492] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:33.583922  9582 ts_tablet_manager.cc:1403] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:09:33.587221  9582 raft_consensus.cc:359] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.587883  9582 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:33.588460  9582 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.591754  9550 heartbeater.cc:499] Master 127.7.102.190:46065 was elected leader, sending a full tablet report...
I20260709 12:09:33.592278  9582 ts_tablet_manager.cc:1434] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:09:33.594286  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-59b21cd8e1b445658842748734f3cc01 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:33.594820  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-59b21cd8e1b445658842748734f3cc01 on tablet 59b21cd8e1b445658842748734f3cc01 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:33.630694  9582 ts_tablet_manager.cc:933] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:33.634986  9582 tablet_copy_client.cc:323] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:33.650671  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 63977b2ac46b48f0ba26c573aeeb69fc from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:33.651302  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 63977b2ac46b48f0ba26c573aeeb69fc from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-63977b2ac46b48f0ba26c573aeeb69fc
I20260709 12:09:33.661305  8845 tablet_copy_source_session.cc:215] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.666128  9582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63977b2ac46b48f0ba26c573aeeb69fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.682538  9582 tablet_copy_client.cc:806] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.683244  9582 tablet_copy_client.cc:670] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.690989  9582 tablet_copy_client.cc:538] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.700305  9582 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:33.721422  9582 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.722503  9582 tablet_bootstrap.cc:492] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:33.723218  9582 ts_tablet_manager.cc:1403] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.004s
I20260709 12:09:33.726030  9582 raft_consensus.cc:359] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.726872  9582 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:33.727523  9582 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.729754  9582 ts_tablet_manager.cc:1434] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:33.731858  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-63977b2ac46b48f0ba26c573aeeb69fc received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:33.732287  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-63977b2ac46b48f0ba26c573aeeb69fc on tablet 63977b2ac46b48f0ba26c573aeeb69fc with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:33.783747  9582 ts_tablet_manager.cc:933] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:33.786988  9582 tablet_copy_client.cc:323] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:33.798539  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 3d58802311724215aa71fccdaeca35f7 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:33.799082  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 3d58802311724215aa71fccdaeca35f7 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-3d58802311724215aa71fccdaeca35f7
I20260709 12:09:33.807966  8770 tablet_copy_source_session.cc:215] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.813495  9582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d58802311724215aa71fccdaeca35f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.817178  9592 ts_tablet_manager.cc:933] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:33.824442  9592 tablet_copy_client.cc:323] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:33.826372  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet a82912909b984cbb88197808b3d66347 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:33.826977  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet a82912909b984cbb88197808b3d66347 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-a82912909b984cbb88197808b3d66347
I20260709 12:09:33.834082  8919 tablet_copy_source_session.cc:215] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.834399  9582 tablet_copy_client.cc:806] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.835788  9582 tablet_copy_client.cc:670] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.837847  9592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82912909b984cbb88197808b3d66347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.841204  9582 tablet_copy_client.cc:538] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.850160  9582 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:33.868197  9582 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.868350  9592 tablet_copy_client.cc:806] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.869135  9592 tablet_copy_client.cc:670] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.869237  9582 tablet_bootstrap.cc:492] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:33.870049  9582 ts_tablet_manager.cc:1403] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:09:33.872299  9582 raft_consensus.cc:359] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.873144  9582 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:33.873771  9592 tablet_copy_client.cc:538] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.874275  9582 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.877729  9582 ts_tablet_manager.cc:1434] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:33.880307  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-3d58802311724215aa71fccdaeca35f7 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:33.880774  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-3d58802311724215aa71fccdaeca35f7 on tablet 3d58802311724215aa71fccdaeca35f7 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:33.887727  9592 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:33.913305  9592 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.914155  9592 tablet_bootstrap.cc:492] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:33.914853  9592 ts_tablet_manager.cc:1403] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 12:09:33.918664  9592 raft_consensus.cc:359] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.919514  9592 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:33.920186  9592 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:33.929598  9592 ts_tablet_manager.cc:1434] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:09:33.932060  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a82912909b984cbb88197808b3d66347 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:33.932528  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a82912909b984cbb88197808b3d66347 on tablet a82912909b984cbb88197808b3d66347 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:34.021683  9525 raft_consensus.cc:1217] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.221046  9525 raft_consensus.cc:1217] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.234724  9525 raft_consensus.cc:1217] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.384371  9525 raft_consensus.cc:1217] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.567806  9367 raft_consensus.cc:1064] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:34.569842  9367 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.577662  9525 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.577677  8832 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.579674  9476 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.580677  9596 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.583455  8752 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.584867  9476 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.599516  9367 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.604424  8828 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.605192  8752 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.626348  8658 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:34.624228  9525 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.673417  9413 raft_consensus.cc:1064] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:34.675915  9413 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.682991  8906 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.708479  8828 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.708465  9525 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.710718  9367 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.711565  9601 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.712277  8900 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.713191  9525 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.714731  9572 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.715874  8757 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.719259  9413 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.720700  9572 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.726500  9596 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.737826  9525 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.753051  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59b21cd8e1b445658842748734f3cc01 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.752132  8828 raft_consensus.cc:2955] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.767215  8657 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:34.788062  9598 raft_consensus.cc:1064] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:34.790716  9598 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.795871  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b21cd8e1b445658842748734f3cc01 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:34.817492  9572 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.821038  9524 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.847257  8905 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.853129  9523 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.854460  9614 tablet_replica.cc:333] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:34.855635  9614 raft_consensus.cc:2243] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.855528  9039 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.856530  9614 raft_consensus.cc:2272] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.858740  8757 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:34.863945  8906 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.866773  8657 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:34.868506  9614 ts_tablet_manager.cc:1916] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.876778  9599 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.879989  8831 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.883873  9598 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.886453  9596 raft_consensus.cc:1064] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:34.890061  9596 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.946272  9524 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.948235  9367 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.959993  9614 ts_tablet_manager.cc:1929] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.980388  8832 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:34.960611  9614 log.cc:1199] T 59b21cd8e1b445658842748734f3cc01 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/59b21cd8e1b445658842748734f3cc01
I20260709 12:09:35.001866  8757 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.004525  9616 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.001917  9524 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.009430  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 59b21cd8e1b445658842748734f3cc01 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:35.011023  9572 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.019688  8756 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.022938  9596 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.023424  9611 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.032761  8832 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.040692  9476 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.041771  8757 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.047166  9524 raft_consensus.cc:2955] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.053404  9599 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.063551  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63977b2ac46b48f0ba26c573aeeb69fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.070315  8658 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.074290  8832 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.077421  9523 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.070835  9367 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.088254  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 63977b2ac46b48f0ba26c573aeeb69fc with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:35.092372  8757 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.154036  9625 tablet_replica.cc:333] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:35.157393  9625 raft_consensus.cc:2243] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.158365  9625 raft_consensus.cc:2272] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:35.160745  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 86660.2us
I20260709 12:09:35.166601  9524 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.172593  8831 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.190066  8656 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.180533  8658 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.198944  9625 ts_tablet_manager.cc:1916] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.199373  8907 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.323053  8906 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:35.334340  9524 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.342465  9626 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.345889  8757 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.347500  9626 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.366264  8757 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:35.365839  9596 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.370148  9524 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.373639  9625 ts_tablet_manager.cc:1929] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.380841  9523 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.380937  9625 log.cc:1199] T 63977b2ac46b48f0ba26c573aeeb69fc P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/63977b2ac46b48f0ba26c573aeeb69fc
I20260709 12:09:35.383945  9491 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.386060  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 63977b2ac46b48f0ba26c573aeeb69fc (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:35.387130  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a82912909b984cbb88197808b3d66347 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.373762  8752 raft_consensus.cc:2955] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.394083  8900 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.396991  9598 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.402189  9525 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.405642  9039 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:35.412230  8643 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet a82912909b984cbb88197808b3d66347 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:35.416827  8656 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.432950  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet a82912909b984cbb88197808b3d66347 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:35.442250  8900 raft_consensus.cc:2955] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.453872  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d58802311724215aa71fccdaeca35f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.462811  8656 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:35.476707  9630 tablet_replica.cc:333] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:35.477857  9630 raft_consensus.cc:2243] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.478600  9630 raft_consensus.cc:2272] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.483583  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d58802311724215aa71fccdaeca35f7 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:35.484100  9630 ts_tablet_manager.cc:1916] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.502663  9630 ts_tablet_manager.cc:1929] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.503084  9630 log.cc:1199] T a82912909b984cbb88197808b3d66347 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/a82912909b984cbb88197808b3d66347
I20260709 12:09:35.505254  9630 tablet_replica.cc:333] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:35.505152  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet a82912909b984cbb88197808b3d66347 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:35.506186  9630 raft_consensus.cc:2243] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.506912  9630 raft_consensus.cc:2272] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.510571  9630 ts_tablet_manager.cc:1916] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.527734  9630 ts_tablet_manager.cc:1929] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.528216  9630 log.cc:1199] T 3d58802311724215aa71fccdaeca35f7 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/3d58802311724215aa71fccdaeca35f7
I20260709 12:09:35.529778  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet 3d58802311724215aa71fccdaeca35f7 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:36.564502  8828 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:36.571111  8756 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.571259  8907 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:36.571419  8801 consensus_peers.cc:597] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10825d3a2b3b4d21bb372d5172d112eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.572746  9633 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.573729  9616 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.581773  9616 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.583387  8907 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.583796  8756 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.598233  8756 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:36.598979  8654 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:36.611114  8726 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 883fe3a6d9a747ed8f95a683702eb669. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.611754  8828 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.611754  8907 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.614516  9039 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.616431  9631 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.634963  9631 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.638491  8828 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.645154  8907 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.670905  8757 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:36.680346  8907 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.683161  9491 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.685097  8828 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:36.729135  8726 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57327b790014487690d5754a4e058fae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.742307  8656 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.732712  9491 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:36.815920  9631 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.820995  8828 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.826503  8907 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.867554  8656 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.869882  8831 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:36.897743  8801 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78cfd04e1cc248b9b904175f207f3f40. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.904040  8900 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.904101  8757 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.905697  9572 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.907178  9633 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.949088  9572 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.954067  8900 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:36.976475  8658 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:37.004532  8757 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:37.026835  9655 ts_tablet_manager.cc:933] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:37.031431  9655 tablet_copy_client.cc:323] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:37.034325  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 10825d3a2b3b4d21bb372d5172d112eb from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:37.034925  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 10825d3a2b3b4d21bb372d5172d112eb from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-10825d3a2b3b4d21bb372d5172d112eb
I20260709 12:09:37.041780  8845 tablet_copy_source_session.cc:215] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.046216  9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10825d3a2b3b4d21bb372d5172d112eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.062543  9655 tablet_copy_client.cc:806] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.063354  9655 tablet_copy_client.cc:670] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.068145  9655 tablet_copy_client.cc:538] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.077803  9655 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:37.102221  9655 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.103477  9655 tablet_bootstrap.cc:492] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:37.104344  9655 ts_tablet_manager.cc:1403] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.001s
I20260709 12:09:37.107776  9655 raft_consensus.cc:359] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.108429  9655 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:37.109196  9655 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.113183  9655 ts_tablet_manager.cc:1434] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:09:37.116600  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-10825d3a2b3b4d21bb372d5172d112eb received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:37.117215  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-10825d3a2b3b4d21bb372d5172d112eb on tablet 10825d3a2b3b4d21bb372d5172d112eb with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:37.121688  9659 ts_tablet_manager.cc:933] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:37.123732  9659 tablet_copy_client.cc:323] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:37.125957  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 883fe3a6d9a747ed8f95a683702eb669 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:37.126518  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 883fe3a6d9a747ed8f95a683702eb669 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-883fe3a6d9a747ed8f95a683702eb669
I20260709 12:09:37.138756  8770 tablet_copy_source_session.cc:215] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.142277  9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883fe3a6d9a747ed8f95a683702eb669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.161254  9659 tablet_copy_client.cc:806] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.161855  9659 tablet_copy_client.cc:670] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.166137  9659 tablet_copy_client.cc:538] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.173334  9659 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:37.192713  9659 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.193827  9659 tablet_bootstrap.cc:492] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:37.194631  9659 ts_tablet_manager.cc:1403] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 12:09:37.197659  9659 raft_consensus.cc:359] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.198488  9659 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:37.199049  9659 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.201272  9659 ts_tablet_manager.cc:1434] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:37.203219  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-883fe3a6d9a747ed8f95a683702eb669 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:37.203742  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-883fe3a6d9a747ed8f95a683702eb669 on tablet 883fe3a6d9a747ed8f95a683702eb669 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:37.221601  9659 ts_tablet_manager.cc:933] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:37.223472  9659 tablet_copy_client.cc:323] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:37.225411  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 57327b790014487690d5754a4e058fae from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:37.225994  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 57327b790014487690d5754a4e058fae from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-57327b790014487690d5754a4e058fae
I20260709 12:09:37.235138  8770 tablet_copy_source_session.cc:215] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.253667  9659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57327b790014487690d5754a4e058fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.271700  9659 tablet_copy_client.cc:806] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.272359  9659 tablet_copy_client.cc:670] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.276163  9655 ts_tablet_manager.cc:933] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:37.283577  9655 tablet_copy_client.cc:323] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:37.284446  9659 tablet_copy_client.cc:538] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.285779  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 78cfd04e1cc248b9b904175f207f3f40 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:37.286475  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 78cfd04e1cc248b9b904175f207f3f40 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-78cfd04e1cc248b9b904175f207f3f40
I20260709 12:09:37.302942  9659 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:37.320150  8845 tablet_copy_source_session.cc:215] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.323993  9655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cfd04e1cc248b9b904175f207f3f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.330092  9659 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.331257  9659 tablet_bootstrap.cc:492] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:37.332046  9659 ts_tablet_manager.cc:1403] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.008s
I20260709 12:09:37.336150  9659 raft_consensus.cc:359] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.337127  9659 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:37.337889  9659 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.341810  9655 tablet_copy_client.cc:806] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.342383  9655 tablet_copy_client.cc:670] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.343118  9659 ts_tablet_manager.cc:1434] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:37.345439  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-57327b790014487690d5754a4e058fae received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:37.345912  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-57327b790014487690d5754a4e058fae on tablet 57327b790014487690d5754a4e058fae with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:37.347136  9655 tablet_copy_client.cc:538] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.356132  9655 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:37.385196  9655 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.386293  9655 tablet_bootstrap.cc:492] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:37.387082  9655 ts_tablet_manager.cc:1403] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.018s
I20260709 12:09:37.389626  9655 raft_consensus.cc:359] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.390288  9655 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:37.390820  9655 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:37.392810  9655 ts_tablet_manager.cc:1434] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:09:37.397253  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-78cfd04e1cc248b9b904175f207f3f40 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:37.397687  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-78cfd04e1cc248b9b904175f207f3f40 on tablet 78cfd04e1cc248b9b904175f207f3f40 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:37.524207  9525 raft_consensus.cc:1217] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.600749  9525 raft_consensus.cc:1217] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.610894  9523 raft_consensus.cc:1217] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.760705  9525 raft_consensus.cc:1217] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.999787  9631 raft_consensus.cc:1064] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:38.002756  9631 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.013538  9525 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.013581  8900 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.015250  9631 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.016258  8828 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.019474  9649 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.022655  9631 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.040324  9649 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.043475  8828 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.045995  9525 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.063537  8907 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.069082  8656 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.123160  9616 raft_consensus.cc:1064] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:38.139112  9616 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.152030  9525 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.152128  8907 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.154747  8757 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.154867  9653 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.160305  9653 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.161705  8756 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.165041  9616 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.181195  9523 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.183259  9491 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.185009  8833 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.187858  9491 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.191560  9572 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.197106  9670 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.199079  9522 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.198573  8752 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.206377  8833 raft_consensus.cc:2955] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.209079  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 883fe3a6d9a747ed8f95a683702eb669 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.233290  9523 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.240017  9672 raft_consensus.cc:1064] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:38.242910  8654 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.245893  8657 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.254738  8900 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.274996  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 883fe3a6d9a747ed8f95a683702eb669 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:38.250483  9672 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.304564  9682 tablet_replica.cc:333] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:38.306963  9525 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.310696  8900 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.314232  9682 raft_consensus.cc:2243] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.311834  8833 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.315265  9682 raft_consensus.cc:2272] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.314904  9672 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:38.317060  9670 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.319053  9631 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.365876  9682 ts_tablet_manager.cc:1916] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.379940  9631 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.386087  9677 raft_consensus.cc:1064] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:38.389201  9677 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.394814  8900 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.397076  9523 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.400566  8828 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.412263  8657 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.428318  8831 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.440045  9523 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.441797  9616 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.447113  8756 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:38.449765  8905 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.457751  9616 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.461236  9522 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.463703  9631 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.450495  9523 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.467036  9616 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.467303  9681 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.470549  8900 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.453291  9682 ts_tablet_manager.cc:1929] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.473798  8905 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.474349  9682 log.cc:1199] T 883fe3a6d9a747ed8f95a683702eb669 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/883fe3a6d9a747ed8f95a683702eb669
I20260709 12:09:38.476253  9522 raft_consensus.cc:2955] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.479449  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 883fe3a6d9a747ed8f95a683702eb669 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:38.480865  9491 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.485589  9491 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.493671  9523 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.494040  8905 raft_consensus.cc:2955] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.507320  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57327b790014487690d5754a4e058fae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.513175  8907 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.515348  9572 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.521441  8756 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.528556  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10825d3a2b3b4d21bb372d5172d112eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.531100  9653 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.531535  8656 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:38.535346  9688 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:09:38.543661  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet 57327b790014487690d5754a4e058fae with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:38.561487  8658 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.561240  9653 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.569337  9691 tablet_replica.cc:333] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:38.569996  8905 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.570925  9691 raft_consensus.cc:2243] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.572389  9691 raft_consensus.cc:2272] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.576126  8757 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.581243  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 10825d3a2b3b4d21bb372d5172d112eb with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:38.589517  9522 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.593011  9693 tablet_replica.cc:333] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:38.594269  9693 raft_consensus.cc:2243] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.594967  9693 raft_consensus.cc:2272] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.598984  9691 ts_tablet_manager.cc:1916] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.603549  9693 ts_tablet_manager.cc:1916] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.607581  8657 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.629359  9693 ts_tablet_manager.cc:1929] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.629967  9693 log.cc:1199] T 10825d3a2b3b4d21bb372d5172d112eb P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/10825d3a2b3b4d21bb372d5172d112eb
I20260709 12:09:38.634145  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 10825d3a2b3b4d21bb372d5172d112eb (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:38.640610  8828 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:38.641913  9616 consensus_queue.cc:1175] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 12:09:38.652856  9691 ts_tablet_manager.cc:1929] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.654551  9691 log.cc:1199] T 57327b790014487690d5754a4e058fae P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/57327b790014487690d5754a4e058fae
I20260709 12:09:38.655014  9522 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.656985  9653 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.658136  8905 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.660074  9616 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.660326  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet 57327b790014487690d5754a4e058fae (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:38.666016  9681 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.668828  9522 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.681849  8656 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.685314  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78cfd04e1cc248b9b904175f207f3f40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.692051  8905 raft_consensus.cc:2955] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:38.703217  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 78cfd04e1cc248b9b904175f207f3f40 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:38.704294  9693 tablet_replica.cc:333] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:38.712765  9693 raft_consensus.cc:2243] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.713598  9693 raft_consensus.cc:2272] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.718590  9693 ts_tablet_manager.cc:1916] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.733712  9693 ts_tablet_manager.cc:1929] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.734203  9693 log.cc:1199] T 78cfd04e1cc248b9b904175f207f3f40 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/78cfd04e1cc248b9b904175f207f3f40
I20260709 12:09:38.735816  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 78cfd04e1cc248b9b904175f207f3f40 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:39.826720  8757 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:39.830470  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60867.8us
I20260709 12:09:39.869441  8905 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:39.871102  8726 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13bb8ebab2aa4ea6b0a85f0aac706c35. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.871856  9670 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.874313  8828 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.882999  9670 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:39.913545  9702 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:39.915431  8905 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:39.918540  8833 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:39.931432  8900 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:39.935644  8656 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:39.959619  8875 consensus_peers.cc:597] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7127014b11f244fc9da3cde4600ec6a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.960806  8757 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.961220  8833 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.962548  9694 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:39.965102  9695 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.977890  9695 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:39.983417  8752 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:39.984558  8833 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.003465  8658 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.009392  8757 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:40.025120  8726 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69ecd2fc45134ac8a031c2a6f90284d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.026082  8905 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.027298  9702 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.028685  8833 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.030370  9702 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.037088  9696 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.039096  8900 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.043550  8833 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.061998  8757 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.063898  8656 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.072764  8833 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.073139  8905 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:40.073843  8726 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36d20759d6564b039af8cca0f84b0eb5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.075030  9702 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.076027  9670 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.086184  9702 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.089969  8828 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.097901  8905 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.114148  8656 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:40.260897  9718 ts_tablet_manager.cc:933] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:40.263636  9718 tablet_copy_client.cc:323] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:40.265822  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:40.266444  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-13bb8ebab2aa4ea6b0a85f0aac706c35
I20260709 12:09:40.274808  8770 tablet_copy_source_session.cc:215] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.279290  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.296115  9718 tablet_copy_client.cc:806] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.296862  9718 tablet_copy_client.cc:670] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.301273  9718 tablet_copy_client.cc:538] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.310461  9718 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:40.332609  9718 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.333556  9718 tablet_bootstrap.cc:492] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:40.334336  9718 ts_tablet_manager.cc:1403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.008s
I20260709 12:09:40.337935  9718 raft_consensus.cc:359] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.338598  9718 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:40.339195  9718 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.342303  9718 ts_tablet_manager.cc:1434] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:40.344776  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-13bb8ebab2aa4ea6b0a85f0aac706c35 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:40.345283  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-13bb8ebab2aa4ea6b0a85f0aac706c35 on tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:40.449414  9718 ts_tablet_manager.cc:933] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:40.452229  9718 tablet_copy_client.cc:323] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:40.454264  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet 7127014b11f244fc9da3cde4600ec6a6 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:40.454885  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet 7127014b11f244fc9da3cde4600ec6a6 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-7127014b11f244fc9da3cde4600ec6a6
I20260709 12:09:40.462952  8919 tablet_copy_source_session.cc:215] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.466514  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7127014b11f244fc9da3cde4600ec6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.488094  9718 tablet_copy_client.cc:806] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.488786  9718 tablet_copy_client.cc:670] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.498409  9718 tablet_copy_client.cc:538] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.509912  9718 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:40.532030  9718 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.532972  9718 tablet_bootstrap.cc:492] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:40.533655  9718 ts_tablet_manager.cc:1403] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 12:09:40.536552  9718 raft_consensus.cc:359] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.537497  9718 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:40.539233  9718 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.542080  9718 ts_tablet_manager.cc:1434] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:40.545042  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-7127014b11f244fc9da3cde4600ec6a6 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:40.545621  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-7127014b11f244fc9da3cde4600ec6a6 on tablet 7127014b11f244fc9da3cde4600ec6a6 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:40.577800  9718 ts_tablet_manager.cc:933] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:40.579617  9718 tablet_copy_client.cc:323] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:40.581501  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 36d20759d6564b039af8cca0f84b0eb5 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:40.582139  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 36d20759d6564b039af8cca0f84b0eb5 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-36d20759d6564b039af8cca0f84b0eb5
I20260709 12:09:40.590472  8770 tablet_copy_source_session.cc:215] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.593721  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d20759d6564b039af8cca0f84b0eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.605170  9718 tablet_copy_client.cc:806] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.605746  9718 tablet_copy_client.cc:670] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.609366  9718 tablet_copy_client.cc:538] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.617029  9725 ts_tablet_manager.cc:933] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:40.620946  9718 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:40.638497  9725 tablet_copy_client.cc:323] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:40.643621  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 69ecd2fc45134ac8a031c2a6f90284d7 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:40.644176  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 69ecd2fc45134ac8a031c2a6f90284d7 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-69ecd2fc45134ac8a031c2a6f90284d7
I20260709 12:09:40.671356  8770 tablet_copy_source_session.cc:215] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.675135  9718 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.676004  9725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecd2fc45134ac8a031c2a6f90284d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.680327  9718 tablet_bootstrap.cc:492] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:40.681160  9718 ts_tablet_manager.cc:1403] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.014s
I20260709 12:09:40.684373  9718 raft_consensus.cc:359] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.685338  9718 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:40.686072  9718 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.693550  9718 ts_tablet_manager.cc:1434] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:40.695549  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-36d20759d6564b039af8cca0f84b0eb5 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:40.696117  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-36d20759d6564b039af8cca0f84b0eb5 on tablet 36d20759d6564b039af8cca0f84b0eb5 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:40.697600  9725 tablet_copy_client.cc:806] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.698369  9725 tablet_copy_client.cc:670] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.702483  9725 tablet_copy_client.cc:538] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.715597  9725 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:40.737296  9725 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.738401  9725 tablet_bootstrap.cc:492] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:40.739192  9725 ts_tablet_manager.cc:1403] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 12:09:40.742102  9725 raft_consensus.cc:359] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.742797  9725 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:40.743351  9725 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:40.745412  9725 ts_tablet_manager.cc:1434] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:40.748370  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-69ecd2fc45134ac8a031c2a6f90284d7 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:40.748833  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-69ecd2fc45134ac8a031c2a6f90284d7 on tablet 69ecd2fc45134ac8a031c2a6f90284d7 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:40.832311  9523 raft_consensus.cc:1217] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.010848  9523 raft_consensus.cc:1217] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.061484  9523 raft_consensus.cc:1217] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.076169  9523 raft_consensus.cc:1217] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.454208  9729 raft_consensus.cc:1064] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:41.457103  9729 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:41.464522  9522 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.464879  8905 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.466238  9729 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.468355  9696 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.484778  8833 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.484984  9694 raft_consensus.cc:1064] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:41.489416  9731 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.495239  9732 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:41.503312  8905 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:41.616087  8658 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:41.619527  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44088.7us
I20260709 12:09:41.511224  9694 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:41.700579  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 183528us
I20260709 12:09:41.727645  9746 raft_consensus.cc:1064] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:41.731405  8828 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:41.745597  9746 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:41.780380  9750 raft_consensus.cc:1064] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
W20260709 12:09:41.787961  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48613us
I20260709 12:09:41.813616  8826 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.819470  9522 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:41.823133  9750 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:41.823829  9523 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.826264  9596 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.840992  8757 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.850777  9525 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.858207  8826 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.857718  9743 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.862432  9596 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.870158  9742 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.885195  8900 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.911610  9696 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:09:42.005897  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101962us
I20260709 12:09:42.025916  8905 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.046761  8830 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.048173  9754 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.053608  9746 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.056838  8757 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:42.060370  9523 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:42.082655  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 75838.4us
I20260709 12:09:42.091923  8831 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.096453  9754 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.127429  9524 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.107102  9764 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:09:42.154222  9743 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.062947  9744 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:09:42.164917  9524 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.136422  9694 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.206332  9754 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.208438  9523 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.213940  8831 raft_consensus.cc:2955] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.251678  8656 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.331684  8833 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.340480  8905 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.346055  9670 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.351164  9523 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.369140  8831 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.377992  9739 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.359335  8657 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.403389  8900 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:42.427294  9774 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:09:42.430928  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:42.443547  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.441481  8827 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.403653  8755 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.454370  8833 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.455456  9525 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.455993  9694 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.457350  9764 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.433167  8656 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.464212  9761 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.465265  8832 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.469740  9523 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.484318  8903 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.497829  9521 raft_consensus.cc:2955] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.505916  9777 tablet_replica.cc:333] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:42.514045  9777 raft_consensus.cc:2243] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.517161  9777 raft_consensus.cc:2272] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.522186  9777 ts_tablet_manager.cc:1916] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.525866  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7127014b11f244fc9da3cde4600ec6a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.542729  8752 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:42.569079  8827 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.571040  9744 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.569108  9523 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.576120  9757 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.591717  9744 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.593209  8656 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.599596  8833 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.600963  9777 ts_tablet_manager.cc:1929] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.601408  9777 log.cc:1199] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/13bb8ebab2aa4ea6b0a85f0aac706c35
I20260709 12:09:42.609760  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 13bb8ebab2aa4ea6b0a85f0aac706c35 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:42.616591  8654 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.617799  9523 raft_consensus.cc:2955] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.629914  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69ecd2fc45134ac8a031c2a6f90284d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.635141  8752 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:42.640838  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 7127014b11f244fc9da3cde4600ec6a6 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:42.654807  8658 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.660221  9523 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.660878  8905 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.659889  9779 tablet_replica.cc:333] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:42.662489  9744 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.663692  9754 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.673993  9739 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.680564  8903 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.692173  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ecd2fc45134ac8a031c2a6f90284d7 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:42.693753  9777 tablet_replica.cc:333] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:42.693342  9523 raft_consensus.cc:2955] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.694895  9777 raft_consensus.cc:2243] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.695709  9777 raft_consensus.cc:2272] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.702260  9779 raft_consensus.cc:2243] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.703025  9779 raft_consensus.cc:2272] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.712001  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36d20759d6564b039af8cca0f84b0eb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.718990  9779 ts_tablet_manager.cc:1916] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.727912  9777 ts_tablet_manager.cc:1916] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.736503  8657 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:42.763522  9777 ts_tablet_manager.cc:1929] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.764052  9777 log.cc:1199] T 69ecd2fc45134ac8a031c2a6f90284d7 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/69ecd2fc45134ac8a031c2a6f90284d7
I20260709 12:09:42.767944  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet 36d20759d6564b039af8cca0f84b0eb5 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:42.771569  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 69ecd2fc45134ac8a031c2a6f90284d7 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:42.793903  9780 tablet_replica.cc:333] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:42.794824  9780 raft_consensus.cc:2243] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.795849  9780 raft_consensus.cc:2272] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.799324  9780 ts_tablet_manager.cc:1916] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.801239  9779 ts_tablet_manager.cc:1929] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.801671  9779 log.cc:1199] T 7127014b11f244fc9da3cde4600ec6a6 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/7127014b11f244fc9da3cde4600ec6a6
I20260709 12:09:42.803303  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 7127014b11f244fc9da3cde4600ec6a6 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:42.821870  9780 ts_tablet_manager.cc:1929] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.822374  9780 log.cc:1199] T 36d20759d6564b039af8cca0f84b0eb5 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/36d20759d6564b039af8cca0f84b0eb5
I20260709 12:09:42.824417  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet 36d20759d6564b039af8cca0f84b0eb5 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:43.845979  8827 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:43.852983  8755 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:43.853147  8801 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73c6f055a4f7416ab87d6ba45b619ef8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.853646  8905 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.854481  9730 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.855484  9786 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.868251  9730 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.870064  8752 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.871215  8905 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.883389  8757 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:43.889721  8658 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.898514  8905 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.899580  8827 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.900343  9784 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.901418  9757 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:43.910205  8726 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfd13939e80e4c668025684b9dbc3f54. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.929021  8827 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.924535  9784 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.935195  8905 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.948575  8833 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:43.957446  8801 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a342b86867884bfaa83a903e1502daaa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.961886  8757 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.964706  9740 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.967559  8905 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.970554  9740 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.971794  8656 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.993206  9786 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:43.996037  8903 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.017508  8752 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.021564  8905 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.026311  8656 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.043108  8833 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.043236  8875 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e45c621a9c684915a4c110e0801e4efa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.044857  9694 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.048409  8752 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.050776  9782 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.062119  9694 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.064188  8833 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.076234  8757 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:44.089068  8656 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.313685  9803 ts_tablet_manager.cc:933] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:44.332142  9803 tablet_copy_client.cc:323] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:44.334143  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet cfd13939e80e4c668025684b9dbc3f54 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:44.334764  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet cfd13939e80e4c668025684b9dbc3f54 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-cfd13939e80e4c668025684b9dbc3f54
I20260709 12:09:44.342505  8770 tablet_copy_source_session.cc:215] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.346138  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd13939e80e4c668025684b9dbc3f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.359934  9803 tablet_copy_client.cc:806] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.360697  9803 tablet_copy_client.cc:670] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.364804  9803 tablet_copy_client.cc:538] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.372668  9803 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:44.399691  9803 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.401079  9803 tablet_bootstrap.cc:492] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:44.401441  9806 ts_tablet_manager.cc:933] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:44.401875  9803 ts_tablet_manager.cc:1403] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.007s
I20260709 12:09:44.404471  9806 tablet_copy_client.cc:323] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:44.406123  9803 raft_consensus.cc:359] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.407164  9803 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:44.406636  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 73c6f055a4f7416ab87d6ba45b619ef8 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:44.407804  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 73c6f055a4f7416ab87d6ba45b619ef8 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-73c6f055a4f7416ab87d6ba45b619ef8
I20260709 12:09:44.407956  9803 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.414608  9803 ts_tablet_manager.cc:1434] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:09:44.417815  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-cfd13939e80e4c668025684b9dbc3f54 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:44.418309  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-cfd13939e80e4c668025684b9dbc3f54 on tablet cfd13939e80e4c668025684b9dbc3f54 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:44.422854  8845 tablet_copy_source_session.cc:215] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.426537  9806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6f055a4f7416ab87d6ba45b619ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.457360  9806 tablet_copy_client.cc:806] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.458503  9806 tablet_copy_client.cc:670] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.463405  9806 tablet_copy_client.cc:538] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.482270  9806 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:44.514990  9806 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.515892  9806 tablet_bootstrap.cc:492] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:44.516534  9806 ts_tablet_manager.cc:1403] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.011s
I20260709 12:09:44.520077  9806 raft_consensus.cc:359] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.521020  9806 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:44.521731  9806 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.524394  9806 ts_tablet_manager.cc:1434] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:44.528106  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-73c6f055a4f7416ab87d6ba45b619ef8 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:44.528563  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-73c6f055a4f7416ab87d6ba45b619ef8 on tablet 73c6f055a4f7416ab87d6ba45b619ef8 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:44.559890  9806 ts_tablet_manager.cc:933] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:44.561583  9806 tablet_copy_client.cc:323] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:44.563248  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet a342b86867884bfaa83a903e1502daaa from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:44.563776  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet a342b86867884bfaa83a903e1502daaa from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-a342b86867884bfaa83a903e1502daaa
I20260709 12:09:44.572017  8845 tablet_copy_source_session.cc:215] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.575181  9806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a342b86867884bfaa83a903e1502daaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.594305  9806 tablet_copy_client.cc:806] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.595053  9806 tablet_copy_client.cc:670] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.595166  9803 ts_tablet_manager.cc:933] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:44.597105  9803 tablet_copy_client.cc:323] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:44.598915  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet e45c621a9c684915a4c110e0801e4efa from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:44.599447  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet e45c621a9c684915a4c110e0801e4efa from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-e45c621a9c684915a4c110e0801e4efa
I20260709 12:09:44.610697  8919 tablet_copy_source_session.cc:215] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.614156  9806 tablet_copy_client.cc:538] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.614500  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45c621a9c684915a4c110e0801e4efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.624853  9806 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:44.641691  9803 tablet_copy_client.cc:806] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.642505  9803 tablet_copy_client.cc:670] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.647025  9803 tablet_copy_client.cc:538] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.650741  9806 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.651592  9806 tablet_bootstrap.cc:492] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:44.652500  9806 ts_tablet_manager.cc:1403] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.004s
I20260709 12:09:44.655143  9806 raft_consensus.cc:359] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.655829  9806 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:44.656472  9806 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.658659  9803 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:44.661345  9806 ts_tablet_manager.cc:1434] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:44.666652  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a342b86867884bfaa83a903e1502daaa received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:44.667146  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a342b86867884bfaa83a903e1502daaa on tablet a342b86867884bfaa83a903e1502daaa with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:44.690142  9803 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.692780  9803 tablet_bootstrap.cc:492] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:44.693480  9803 ts_tablet_manager.cc:1403] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.007s
I20260709 12:09:44.698675  9803 raft_consensus.cc:359] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.699509  9803 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:44.700150  9803 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:44.702453  9803 ts_tablet_manager.cc:1434] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:44.705480  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-e45c621a9c684915a4c110e0801e4efa received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:44.706053  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-e45c621a9c684915a4c110e0801e4efa on tablet e45c621a9c684915a4c110e0801e4efa with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:44.827296  9523 raft_consensus.cc:1217] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.882077  9523 raft_consensus.cc:1217] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.113742  9523 raft_consensus.cc:1217] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.139532  9523 raft_consensus.cc:1217] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.332118  9809 raft_consensus.cc:1064] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:45.334550  9809 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.343190  8905 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.343210  8752 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.345002  9809 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.347318  9786 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.349745  9815 raft_consensus.cc:1064] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:45.363910  9815 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.369529  9786 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.371232  8900 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.387825  8752 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.394728  8656 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.397151  9521 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.401989  9786 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.408553  9523 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.410348  9754 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.412457  8827 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.414986  9754 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.420882  8903 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.447564  9754 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.456852  9754 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.460302  9521 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.473835  8827 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.477027  8900 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.459534  9523 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.499249  8654 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.580780  9817 raft_consensus.cc:1064] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:45.583114  9817 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.593933  9523 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.596076  9816 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.596652  9809 raft_consensus.cc:1064] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:45.599927  9809 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.606640  8827 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.607203  8752 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.613169  9752 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.615056  9521 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.618782  9809 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.628799  8757 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.630313  9752 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.631632  9786 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.635318  8903 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.650249  9786 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.651882  8752 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.663676  9525 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.667892  9819 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.679680  9757 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:45.682514  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 45911.9us
W20260709 12:09:45.686535  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 49374.8us
I20260709 12:09:45.693876  9522 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.698698  9752 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:45.706182  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 49564.6us
I20260709 12:09:45.710280  8903 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.715353  9523 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.720110  9815 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.725492  8757 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.734170  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfd13939e80e4c668025684b9dbc3f54 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.737552  9786 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.739593  8905 raft_consensus.cc:2955] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.740751  8903 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.739202  8654 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.761083  8833 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.769750  8656 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.795490  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet cfd13939e80e4c668025684b9dbc3f54 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:45.802791  9842 tablet_replica.cc:333] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:45.812705  9842 raft_consensus.cc:2243] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.813515  9842 raft_consensus.cc:2272] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.813261  8903 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.799937  9522 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.834463  9842 ts_tablet_manager.cc:1916] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.833345  8752 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.855021  9522 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.857470  9782 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.858383  8833 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.867173  9842 ts_tablet_manager.cc:1929] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.867799  9842 log.cc:1199] T cfd13939e80e4c668025684b9dbc3f54 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/cfd13939e80e4c668025684b9dbc3f54
I20260709 12:09:45.866964  9816 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.870142  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet cfd13939e80e4c668025684b9dbc3f54 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:45.869891  8658 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.877928  9521 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.885628  9817 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.888250  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e45c621a9c684915a4c110e0801e4efa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.892098  8831 raft_consensus.cc:2955] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.896433  8827 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:45.909650  8752 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.912358  8657 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.915635  9522 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.917235  9786 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.920486  9786 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.930333  9837 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.935038  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet e45c621a9c684915a4c110e0801e4efa with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:45.937412  9522 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.944166  9843 tablet_replica.cc:333] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:45.946971  9843 raft_consensus.cc:2243] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.948760  9843 raft_consensus.cc:2272] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.952978  9843 ts_tablet_manager.cc:1916] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.959290  8752 raft_consensus.cc:2955] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.963584  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a342b86867884bfaa83a903e1502daaa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.970417  8657 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:45.996443  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet a342b86867884bfaa83a903e1502daaa with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:46.000646  9843 ts_tablet_manager.cc:1929] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.001255  9843 log.cc:1199] T e45c621a9c684915a4c110e0801e4efa P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/e45c621a9c684915a4c110e0801e4efa
I20260709 12:09:46.003732  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet e45c621a9c684915a4c110e0801e4efa (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:46.015105  9844 tablet_replica.cc:333] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:46.021950  9844 raft_consensus.cc:2243] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.022661  9844 raft_consensus.cc:2272] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.026715  9844 ts_tablet_manager.cc:1916] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.028229  8831 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:46.035768  9522 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.036801  8905 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.037257  9837 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.038272  9809 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.050786  9844 ts_tablet_manager.cc:1929] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.051505  9844 log.cc:1199] T a342b86867884bfaa83a903e1502daaa P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/a342b86867884bfaa83a903e1502daaa
I20260709 12:09:46.050855  9836 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:46.054677  8900 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:46.058059  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet a342b86867884bfaa83a903e1502daaa (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:46.074746  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73c6f055a4f7416ab87d6ba45b619ef8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.083294  8654 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.088289  9522 raft_consensus.cc:2955] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:46.097208  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 73c6f055a4f7416ab87d6ba45b619ef8 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:46.098368  9843 tablet_replica.cc:333] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:46.099443  9843 raft_consensus.cc:2243] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.100265  9843 raft_consensus.cc:2272] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.106578  9843 ts_tablet_manager.cc:1916] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.122916  9843 ts_tablet_manager.cc:1929] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.123359  9843 log.cc:1199] T 73c6f055a4f7416ab87d6ba45b619ef8 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/73c6f055a4f7416ab87d6ba45b619ef8
I20260709 12:09:46.125427  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 73c6f055a4f7416ab87d6ba45b619ef8 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:47.189172  8755 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:47.196771  8827 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.196973  8726 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7cbe23065834283bc7d53543908a219. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.198944  8905 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.199357  9754 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.200484  9846 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.210194  9846 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.213301  8827 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.217979  8905 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.234597  8654 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.248971  8755 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:47.263746  8726 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a047cca1ee434f14ac79b5f67b7aac73. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.264070  8905 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.265657  9846 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.272891  8827 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.274762  9757 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.285765  9757 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.289827  8831 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.292618  8900 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.319726  8657 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.330477  8831 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:47.345801  8801 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ff15d7fa845498ba3ccd1874ce63ad6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.346215  8752 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.347800  9837 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.348263  8905 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.349985  9860 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.356469  9837 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.367897  8752 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.377228  8905 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.390463  8755 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:47.407567  8654 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.422303  8905 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:47.422848  8726 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9173a010c254f6b9fac3f924e38f957. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.423761  8831 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:47.425729  9757 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.436810  9846 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.444476  9847 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.451476  8831 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.458695  8900 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:47.464067  8654 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.799944  9867 ts_tablet_manager.cc:933] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:47.858561  9867 tablet_copy_client.cc:323] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:47.862327  9869 ts_tablet_manager.cc:933] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:47.864966  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet d7cbe23065834283bc7d53543908a219 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:47.865747  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet d7cbe23065834283bc7d53543908a219 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-d7cbe23065834283bc7d53543908a219
I20260709 12:09:47.873126  8770 tablet_copy_source_session.cc:215] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.878702  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7cbe23065834283bc7d53543908a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.897293  9869 tablet_copy_client.cc:323] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:47.899072  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet a047cca1ee434f14ac79b5f67b7aac73 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:47.899724  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet a047cca1ee434f14ac79b5f67b7aac73 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-a047cca1ee434f14ac79b5f67b7aac73
I20260709 12:09:47.904486  9867 tablet_copy_client.cc:806] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.905224  9867 tablet_copy_client.cc:670] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.911604  9867 tablet_copy_client.cc:538] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.913950  8770 tablet_copy_source_session.cc:215] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.916939  9869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a047cca1ee434f14ac79b5f67b7aac73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.921612  9867 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:47.937227  9869 tablet_copy_client.cc:806] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.937877  9869 tablet_copy_client.cc:670] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.942708  9869 tablet_copy_client.cc:538] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.949506  9867 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.950611  9867 tablet_bootstrap.cc:492] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:47.951423  9867 ts_tablet_manager.cc:1403] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.000s
I20260709 12:09:47.953043  9869 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:47.970342  9867 raft_consensus.cc:359] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:47.971577  9875 ts_tablet_manager.cc:933] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:47.971601  9867 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:47.973465  9867 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:47.976449  9875 tablet_copy_client.cc:323] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:47.991839  9869 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.993263  9867 ts_tablet_manager.cc:1434] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.041s	user 0.015s	sys 0.004s
I20260709 12:09:47.994774  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:47.995286  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-d7cbe23065834283bc7d53543908a219 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:47.995417  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 6ff15d7fa845498ba3ccd1874ce63ad6 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-6ff15d7fa845498ba3ccd1874ce63ad6
I20260709 12:09:47.995944  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-d7cbe23065834283bc7d53543908a219 on tablet d7cbe23065834283bc7d53543908a219 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:47.998112  9869 tablet_bootstrap.cc:492] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:47.998973  9869 ts_tablet_manager.cc:1403] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.009s
I20260709 12:09:48.006317  9869 raft_consensus.cc:359] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.007400  9869 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:48.008195  9869 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.011101  9869 ts_tablet_manager.cc:1434] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:48.013366  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a047cca1ee434f14ac79b5f67b7aac73 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:48.013813  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a047cca1ee434f14ac79b5f67b7aac73 on tablet a047cca1ee434f14ac79b5f67b7aac73 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:48.027590  8845 tablet_copy_source_session.cc:215] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.033228  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff15d7fa845498ba3ccd1874ce63ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.035091  9869 ts_tablet_manager.cc:933] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:48.048501  9869 tablet_copy_client.cc:323] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:48.050539  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet a9173a010c254f6b9fac3f924e38f957 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:48.051177  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet a9173a010c254f6b9fac3f924e38f957 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-a9173a010c254f6b9fac3f924e38f957
I20260709 12:09:48.057521  9875 tablet_copy_client.cc:806] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.058429  9875 tablet_copy_client.cc:670] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.061614  8770 tablet_copy_source_session.cc:215] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.067898  9869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9173a010c254f6b9fac3f924e38f957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.071815  9875 tablet_copy_client.cc:538] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.082466  9875 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:48.091101  9869 tablet_copy_client.cc:806] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.091856  9869 tablet_copy_client.cc:670] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.097930  9869 tablet_copy_client.cc:538] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.110571  9869 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:48.128618  9875 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.129879  9875 tablet_bootstrap.cc:492] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:48.130648  9875 ts_tablet_manager.cc:1403] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.015s
I20260709 12:09:48.134130  9869 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.135123  9869 tablet_bootstrap.cc:492] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:48.135763  9869 ts_tablet_manager.cc:1403] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.013s
I20260709 12:09:48.138582  9875 raft_consensus.cc:359] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.139513  9875 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:48.140100  9869 raft_consensus.cc:359] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.141314  9869 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:48.140194  9875 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.145318  9875 ts_tablet_manager.cc:1434] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:09:48.147652  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-6ff15d7fa845498ba3ccd1874ce63ad6 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:48.148125  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-6ff15d7fa845498ba3ccd1874ce63ad6 on tablet 6ff15d7fa845498ba3ccd1874ce63ad6 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:48.141978  9869 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:48.155742  9869 ts_tablet_manager.cc:1434] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 12:09:48.157528  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a9173a010c254f6b9fac3f924e38f957 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:48.157961  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-a9173a010c254f6b9fac3f924e38f957 on tablet a9173a010c254f6b9fac3f924e38f957 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:48.259974  9523 raft_consensus.cc:1217] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.345875  9523 raft_consensus.cc:1217] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.356271  9523 raft_consensus.cc:1217] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.456584  9523 raft_consensus.cc:1217] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:48.846742  9882 raft_consensus.cc:1064] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:48.849645  9882 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:48.865203  9522 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.865825  8907 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.865854  8831 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.867189  9882 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.868772  9847 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.870577  9846 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.905040  9887 raft_consensus.cc:1064] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:48.905369  9754 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:48.907881  9887 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:48.909476  9523 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:48.940128  8831 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:48.950289  8907 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:48.957973  9837 raft_consensus.cc:1064] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:48.965183  9522 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.966151  9837 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:48.967082  9754 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.989687  8831 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.004863  9888 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.006475  8658 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.015050  8900 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.026537  9888 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.049789  9888 raft_consensus.cc:1064] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:49.052284  9888 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:49.057562  8757 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.061331  9882 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.064798  8900 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.066248  9837 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.068022  9809 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.078430  9523 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:49.079298  8900 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:49.080116  9847 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.081173  9887 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.098263  8832 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:49.101181  8831 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.103286  8900 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.127522  9523 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.141717  9522 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.144251  9888 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.157397  9837 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.180470  8907 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.191121  8658 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:49.223464  9900 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:09:49.228394  8752 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:49.230660  9847 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.244813  8905 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:49.188244  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 47358.6us
I20260709 12:09:49.306316  9523 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.309979  9846 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.332134  8755 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:49.330329  8656 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.304486  9908 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 12:09:49.368336  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 76111.1us
W20260709 12:09:49.420027  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 77316.7us
W20260709 12:09:49.426646  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 51524.5us
I20260709 12:09:49.445501  8654 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.445600  9887 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:49.449463  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 67332.3us
I20260709 12:09:49.454373  9521 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:09:49.455305  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 50830.2us
I20260709 12:09:49.456836  9522 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.460423  8907 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.465700  9523 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.498741  9521 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.510737  9912 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.521449  9846 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.522104  8755 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.535818  8827 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.539999  8654 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.542110  9525 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.546769  8757 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:49.547466  8832 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.554670  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a047cca1ee434f14ac79b5f67b7aac73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.555179  9916 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:49.540036  9847 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.565250  8905 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:49.565511  9523 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:49.568745  8905 raft_consensus.cc:2955] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.604516  9887 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.609351  9912 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.611470  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet a047cca1ee434f14ac79b5f67b7aac73 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:49.620771  8658 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.629912  9914 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.634025  9523 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.630255  8832 raft_consensus.cc:2955] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.644797  9920 tablet_replica.cc:333] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:49.647629  9920 raft_consensus.cc:2243] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.648517  9920 raft_consensus.cc:2272] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.654122  9920 ts_tablet_manager.cc:1916] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.657498  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet d7cbe23065834283bc7d53543908a219 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:49.668583  8657 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.673700  9921 tablet_replica.cc:333] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:49.682513  9920 ts_tablet_manager.cc:1929] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.685153  9920 log.cc:1199] T a047cca1ee434f14ac79b5f67b7aac73 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/a047cca1ee434f14ac79b5f67b7aac73
I20260709 12:09:49.688316  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet a047cca1ee434f14ac79b5f67b7aac73 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:49.692257  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9173a010c254f6b9fac3f924e38f957 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.695354  8903 raft_consensus.cc:2955] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.704317  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet a9173a010c254f6b9fac3f924e38f957 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:49.712596  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7cbe23065834283bc7d53543908a219 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.724151  9921 raft_consensus.cc:2243] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.725065  9921 raft_consensus.cc:2272] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.729918  9921 ts_tablet_manager.cc:1916] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.744740  9921 ts_tablet_manager.cc:1929] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.745143  9921 log.cc:1199] T d7cbe23065834283bc7d53543908a219 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/d7cbe23065834283bc7d53543908a219
I20260709 12:09:49.746888  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet d7cbe23065834283bc7d53543908a219 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:49.747586  9921 tablet_replica.cc:333] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:49.749086  9921 raft_consensus.cc:2243] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.749861  9921 raft_consensus.cc:2272] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.754104  9921 ts_tablet_manager.cc:1916] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.769093  9921 ts_tablet_manager.cc:1929] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:49.769495  9921 log.cc:1199] T a9173a010c254f6b9fac3f924e38f957 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/a9173a010c254f6b9fac3f924e38f957
I20260709 12:09:49.770937  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet a9173a010c254f6b9fac3f924e38f957 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:49.924865  8831 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:49.933620  9523 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.935140  9915 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.935563  8757 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.937016  9908 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.944835  9863 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.950373  8757 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.955122  9523 raft_consensus.cc:2955] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.971176  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.970155  8657 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:49.986901  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff15d7fa845498ba3ccd1874ce63ad6 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:49.987920  9920 tablet_replica.cc:333] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:50.000065  9920 raft_consensus.cc:2243] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:50.001183  9920 raft_consensus.cc:2272] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:50.010581  9920 ts_tablet_manager.cc:1916] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:50.029699  9920 ts_tablet_manager.cc:1929] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:50.030129  9920 log.cc:1199] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/6ff15d7fa845498ba3ccd1874ce63ad6
I20260709 12:09:50.031669  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 6ff15d7fa845498ba3ccd1874ce63ad6 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:51.081385  8905 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.089316  8831 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.089692  8757 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:51.090380  8875 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0982edf61b2c41e6b7c3414f279d4f31. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.091111  9872 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.092310  9918 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.102550  9918 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.103909  8832 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.120033  8827 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.124302  8654 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.128845  8760 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:51.144793  8801 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98ff6a40f13a4be9b4a05ca797f8fd52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.147707  8905 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.148775  8760 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.149760  9922 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.151213  9908 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.183905  9922 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.185305  8905 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.205278  8760 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.213742  8657 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.221884  8755 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:51.237841  8726 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c18b8defabce4ce7a420d8548c885e28. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.242604  8905 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.244588  8831 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.244828  9935 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.246157  9923 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.255620  9935 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.257709  8903 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.258670  8831 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.278321  8905 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.278976  8656 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:51.288511  8875 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f12377056e86440fb6f80fe02bb59fe1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.290081  8831 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.291081  8755 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.292603  9926 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.293733  9925 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.306506  9926 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.310745  8831 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.317792  8760 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.340368  8656 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:51.647677  9950 ts_tablet_manager.cc:933] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:51.649945  9950 tablet_copy_client.cc:323] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:51.651623  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:51.652236  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 98ff6a40f13a4be9b4a05ca797f8fd52 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-98ff6a40f13a4be9b4a05ca797f8fd52
I20260709 12:09:51.661026  8845 tablet_copy_source_session.cc:215] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.673485  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ff6a40f13a4be9b4a05ca797f8fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.677704  9952 ts_tablet_manager.cc:933] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:51.703805  9952 tablet_copy_client.cc:323] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:51.706034  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet 0982edf61b2c41e6b7c3414f279d4f31 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:51.706636  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet 0982edf61b2c41e6b7c3414f279d4f31 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-0982edf61b2c41e6b7c3414f279d4f31
I20260709 12:09:51.716859  8919 tablet_copy_source_session.cc:215] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.720492  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0982edf61b2c41e6b7c3414f279d4f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.723033  9950 tablet_copy_client.cc:806] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.723802  9950 tablet_copy_client.cc:670] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.731199  9950 tablet_copy_client.cc:538] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.731317  9954 ts_tablet_manager.cc:933] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:51.742431  9952 tablet_copy_client.cc:806] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.743157  9952 tablet_copy_client.cc:670] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.744474  9954 tablet_copy_client.cc:323] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:51.745024  9950 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:51.747117  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet c18b8defabce4ce7a420d8548c885e28 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:51.747694  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet c18b8defabce4ce7a420d8548c885e28 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-c18b8defabce4ce7a420d8548c885e28
I20260709 12:09:51.753070  9952 tablet_copy_client.cc:538] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.765973  9952 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:51.767452  8770 tablet_copy_source_session.cc:215] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.771993  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18b8defabce4ce7a420d8548c885e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.776103  9950 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.777174  9950 tablet_bootstrap.cc:492] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:51.777935  9950 ts_tablet_manager.cc:1403] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 12:09:51.781276  9950 raft_consensus.cc:359] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.782137  9950 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:51.782828  9950 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.792716  9950 ts_tablet_manager.cc:1434] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.014s	user 0.014s	sys 0.001s
I20260709 12:09:51.795085  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-98ff6a40f13a4be9b4a05ca797f8fd52 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:51.795567  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-98ff6a40f13a4be9b4a05ca797f8fd52 on tablet 98ff6a40f13a4be9b4a05ca797f8fd52 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:51.809675  9952 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.813727  9952 tablet_bootstrap.cc:492] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:51.814464  9952 ts_tablet_manager.cc:1403] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.017s
I20260709 12:09:51.818600  9952 raft_consensus.cc:359] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.819505  9952 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:51.820164  9952 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.822444  9954 tablet_copy_client.cc:806] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.823217  9954 tablet_copy_client.cc:670] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.825054  9952 ts_tablet_manager.cc:1434] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:51.826741  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-0982edf61b2c41e6b7c3414f279d4f31 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:51.827189  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-0982edf61b2c41e6b7c3414f279d4f31 on tablet 0982edf61b2c41e6b7c3414f279d4f31 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:51.829108  9954 tablet_copy_client.cc:538] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.840870  9954 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:51.858291  9954 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.859261  9954 tablet_bootstrap.cc:492] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:51.859879  9954 ts_tablet_manager.cc:1403] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.004s
I20260709 12:09:51.863348  9952 ts_tablet_manager.cc:933] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:51.864104  9954 raft_consensus.cc:359] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.864961  9954 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:51.865623  9954 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.868101  9954 ts_tablet_manager.cc:1434] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:51.869629  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-c18b8defabce4ce7a420d8548c885e28 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:51.870029  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-c18b8defabce4ce7a420d8548c885e28 on tablet c18b8defabce4ce7a420d8548c885e28 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:51.890709  9952 tablet_copy_client.cc:323] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:09:51.894415  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet f12377056e86440fb6f80fe02bb59fe1 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:09:51.894972  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet f12377056e86440fb6f80fe02bb59fe1 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-f12377056e86440fb6f80fe02bb59fe1
I20260709 12:09:51.907326  8919 tablet_copy_source_session.cc:215] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.910383  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12377056e86440fb6f80fe02bb59fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.928623  9952 tablet_copy_client.cc:806] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.929242  9952 tablet_copy_client.cc:670] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.936338  9952 tablet_copy_client.cc:538] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.951301  9952 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:51.983028  9952 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.984113  9952 tablet_bootstrap.cc:492] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:51.984833  9952 ts_tablet_manager.cc:1403] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.009s
I20260709 12:09:51.988178  9952 raft_consensus.cc:359] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.989079  9952 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:51.989727  9952 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:51.994071  9952 ts_tablet_manager.cc:1434] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:09:51.998198  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-f12377056e86440fb6f80fe02bb59fe1 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:51.998703  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-f12377056e86440fb6f80fe02bb59fe1 on tablet f12377056e86440fb6f80fe02bb59fe1 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:52.076790  9525 raft_consensus.cc:1217] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.185204  9525 raft_consensus.cc:1217] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.248014  9525 raft_consensus.cc:1217] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.341781  9525 raft_consensus.cc:1217] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.599118  9964 raft_consensus.cc:1064] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:52.601279  9964 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:52.609750  9525 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.611991  8827 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.612084  9925 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.613382  9963 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.618989  8755 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.620894  9963 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.638324  8755 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.635926  9925 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.657320  8827 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.660203  9525 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.664165  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.671833  8654 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.707644  9962 raft_consensus.cc:1064] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:52.715441  9962 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:52.746124  9525 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.747835  9908 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.748744  8907 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.750725  8755 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.750906  9908 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.754932  9922 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.811000  9964 raft_consensus.cc:1064] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:52.813956  9922 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.815289  9964 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:52.844571  8831 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.843748  9521 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.850023  9925 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.852270  9964 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.859136  8760 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.864571  9925 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.855753  8903 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:52.901942  8757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:52.902655  8757 raft_consensus.cc:606] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:52.913944  8907 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.923889  8827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:09:52.924717  8827 raft_consensus.cc:606] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:52.928283  8760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93afd25256e34a3b902813af41f349c9"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:52.928999  8760 raft_consensus.cc:606] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:09:52.933168  9935 raft_consensus.cc:993] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:52.933737  9847 raft_consensus.cc:1081] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:52.935595  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:52.936210  9523 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.936611  9523 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.938455  8755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:52.939153  8755 raft_consensus.cc:606] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:52.942066  8760 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.945310  8752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:52.945986  8752 raft_consensus.cc:606] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:52.949481  8752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7cbe23065834283bc7d53543908a219"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:52.950017  8752 raft_consensus.cc:606] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:52.954524  9923 raft_consensus.cc:1064] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:52.954638  9925 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.957454  9923 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:52.962177  9522 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.964442  9963 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.973501  9522 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.978523  9525 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.991768  8657 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:52.946254  9523 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.043009  8760 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.048750  9523 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:09:53.048831  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48082.2us
I20260709 12:09:53.055783  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:53.056481  8831 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.056537  9962 raft_consensus.cc:993] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:53.057242  9962 raft_consensus.cc:1081] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:53.058387  9964 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.062462  8827 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.065116  9935 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.067196  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35690
I20260709 12:09:53.068797  9523 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.068998  8900 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.069226  9523 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.071187  8658 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.073655  8900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:09:53.074293  8900 raft_consensus.cc:606] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:53.075771  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:09:53.076100  9986 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.077601  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.090445  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.097177  9521 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.096792  8832 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.098969  9524 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.106559  9519 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.108348  9922 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.112787  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:53.113555  8760 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.113858  8760 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:53.114631  8760 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.115998  8760 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.118738  8752 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.126951  8830 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.131076  9847 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:53.139792  9995 raft_consensus.cc:993] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:53.140305  9995 raft_consensus.cc:1081] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:53.149482  8827 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.155277  8658 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.139846  8831 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.164119  8760 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.170619  9489 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:53.171741  9958 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:53.177816  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 58657.1us
I20260709 12:09:53.166599  9908 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.193462  9523 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.201728  9523 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:53.250852  9522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7cbe23065834283bc7d53543908a219"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:53.251693  9522 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.252170  9522 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:53.257140  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 68562.3us
I20260709 12:09:53.198403  9922 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:09:53.264776  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:53.267136  9997 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:09:53.269593  8903 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.275921  9522 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:53.281538  9980 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:09:53.294945  8903 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.305459  9935 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.318534  9847 raft_consensus.cc:993] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:53.319159  9847 raft_consensus.cc:1081] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:53.333711  8900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38194
I20260709 12:09:53.334206  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:53.334569  8900 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.335279  8900 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.336437  8903 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.331386  8905 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.348680  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:53.354790  8833 raft_consensus.cc:3055] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.355096  8833 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:53.355805  8833 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.357518  8833 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.370074  8900 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:53.377712  8900 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:53.393944  9522 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:53.399748  8833 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.401053  9488 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:53.424464  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:53.425248  8758 raft_consensus.cc:3055] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.425565  8758 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:53.427700  8903 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.426366  8758 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:53.445899  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 260372us
I20260709 12:09:53.445325  8758 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.453016  8757 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:53.475171  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.493963  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:53.494726  8757 raft_consensus.cc:3055] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.495025  8757 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:53.503062  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 0982edf61b2c41e6b7c3414f279d4f31 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:53.507187  8833 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.497900  8757 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.515803  8757 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.521834  9994 raft_consensus.cc:993] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:09:53.522466  9935 raft_consensus.cc:1081] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:09:53.522264  8658 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.526603  8658 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.542256  8757 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:53.543179  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0982edf61b2c41e6b7c3414f279d4f31 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.545495  8758 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:09:53.533448  8830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93afd25256e34a3b902813af41f349c9"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52178
I20260709 12:09:53.577940  8872 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:53.594441  9487 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:09:53.580430  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 230344us
I20260709 12:09:53.600721  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:09:53.712862  9970 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:09:53.771852  8831 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:53.728873  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 242873us
I20260709 12:09:53.774399  8905 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:53.732882  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 183264us
I20260709 12:09:53.709924 10005 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.553370  9958 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:53.779863  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.950470  9522 raft_consensus.cc:2955] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:53.967080  8644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 188570us
I20260709 12:09:53.951773 10016 tablet_replica.cc:333] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:53.762794  8830 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.970883  8830 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.898686 10008 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.973577 10008 raft_consensus.cc:697] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:53.974537 10008 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.976300 10005 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:09:53.963570  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 190505us
I20260709 12:09:53.977299 10005 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:53.983807  9523 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.987654  9994 raft_consensus.cc:993] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:53.991909  9990 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:54.000399  9523 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.004076  8833 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:54.011132  9994 raft_consensus.cc:1081] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:54.035254  9964 raft_consensus.cc:993] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:54.035862  9964 raft_consensus.cc:1081] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:54.041141 10007 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.043273  8760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:09:54.043931  8760 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.044266  8760 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.048589  8828 raft_consensus.cc:2955] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.046144  9524 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:53.965101  9958 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:53.825861 10014 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.058977 10014 raft_consensus.cc:697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:54.059930 10014 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:54.067433 10021 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:09:54.068179  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52861us
I20260709 12:09:54.071202  8830 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:54.072468  8833 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.073199  8831 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:09:54.080039  8760 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:54.071957  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 81527.1us
I20260709 12:09:54.086620  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:54.092813  9523 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.095338  9523 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.106604 10016 raft_consensus.cc:2243] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:54.108557  8830 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:54.110163  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:54.110823  8903 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.122354  8903 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:09:54.125039  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ff6a40f13a4be9b4a05ca797f8fd52 with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:09:54.125339  8905 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.131485  8833 raft_consensus.cc:2955] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.136930  9523 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:54.138450  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:54.139297  9908 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.139571  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:54.139735  9908 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:54.140110  8758 raft_consensus.cc:3055] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.140390  8758 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:54.141052  9908 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:54.141999  9523 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:54.141065  8758 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:54.152752  8758 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.160463  8760 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:54.158545 10016 raft_consensus.cc:2272] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:54.201203  8758 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:54.202288  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:54.202700  9487 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:54.203141  8903 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.214399  8903 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:54.217950 10031 tablet_replica.cc:333] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:09:54.219501 10031 raft_consensus.cc:2243] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:54.220359 10031 raft_consensus.cc:2272] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:54.223379 10031 ts_tablet_manager.cc:1916] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:54.227512  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:54.199308 10020 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:09:54.229048  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:54.233884  8909 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.236577  8909 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:54.245443 10016 ts_tablet_manager.cc:1916] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:54.242895  9923 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.214685 10008 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.251685  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:54.260775  8828 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.237428  8909 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:54.271021  8828 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:54.273721  8752 raft_consensus.cc:3055] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.274104  8752 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:54.274878  8752 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:54.260763 10008 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:54.275799  8752 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.276219 10008 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:54.277838  8657 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.287611  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f12377056e86440fb6f80fe02bb59fe1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:54.292805  8658 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.299335  8758 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:54.297590  8658 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.302569  8909 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.312044  8752 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:09:54.319113 10020 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:09:54.326923  8903 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:54.330698 10000 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:54.333529  9524 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:54.336421 10002 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:54.341868  8909 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
W20260709 12:09:54.343147  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 101191us
W20260709 12:09:54.343636 10033 log.cc:927] Time spent T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:09:54.344375  8724 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:54.361155 10016 ts_tablet_manager.cc:1929] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:54.361850 10016 log.cc:1199] T 0982edf61b2c41e6b7c3414f279d4f31 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/0982edf61b2c41e6b7c3414f279d4f31
I20260709 12:09:54.374032  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 0982edf61b2c41e6b7c3414f279d4f31 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:54.374739 10000 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.363057 10020 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:54.381829 10032 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:09:54.396942 10020 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:54.377278  8909 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.388203  9524 raft_consensus.cc:2955] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.398036 10020 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:54.410781 10031 ts_tablet_manager.cc:1929] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:54.411319 10031 log.cc:1199] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/98ff6a40f13a4be9b4a05ca797f8fd52
I20260709 12:09:54.413213  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 98ff6a40f13a4be9b4a05ca797f8fd52 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:54.463609  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c18b8defabce4ce7a420d8548c885e28 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:54.469801  8656 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.481460  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet f12377056e86440fb6f80fe02bb59fe1 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:09:54.482537 10016 tablet_replica.cc:333] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:09:54.486222 10016 raft_consensus.cc:2243] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:54.486922 10016 raft_consensus.cc:2272] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:54.493615  8757 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.495666 10008 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.497130 10016 ts_tablet_manager.cc:1916] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:54.497280  8757 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.505707  9926 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:54.521703  8657 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.523682  8657 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.531280  8657 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:54.534979  8654 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.539201  8831 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.546802 10008 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.533491  8657 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.557087 10016 ts_tablet_manager.cc:1929] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:54.557662 10016 log.cc:1199] T f12377056e86440fb6f80fe02bb59fe1 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/f12377056e86440fb6f80fe02bb59fe1
I20260709 12:09:54.557730  8905 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.560349  9958 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.564805  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet f12377056e86440fb6f80fe02bb59fe1 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:54.583377  8909 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.584928  8828 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.585376  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet c18b8defabce4ce7a420d8548c885e28 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:09:54.586438  8760 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.587194  9926 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.589262  9958 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.593952  8909 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.595554  9908 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.597692  8833 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.603745  9958 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.613492 10014 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.690169  8760 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.710569  9992 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.736805 10045 tablet_replica.cc:333] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:09:54.737912 10045 raft_consensus.cc:2243] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:54.738724 10045 raft_consensus.cc:2272] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:54.743790 10045 ts_tablet_manager.cc:1916] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:54.787532  8758 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.789541 10014 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.801981  8905 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.803915  9958 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.805338 10045 ts_tablet_manager.cc:1929] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:54.805872 10045 log.cc:1199] T c18b8defabce4ce7a420d8548c885e28 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/c18b8defabce4ce7a420d8548c885e28
I20260709 12:09:54.808007  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet c18b8defabce4ce7a420d8548c885e28 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:09:54.875712  8828 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.878974  9993 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.892797  8905 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.894656 10035 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.137681  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.181550  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:55.186352  8758 raft_consensus.cc:606] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:55.192256  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:55.192957  8758 raft_consensus.cc:606] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:09:55.196359 10010 raft_consensus.cc:993] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:55.196868 10020 raft_consensus.cc:1081] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:55.198613  8905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38194
I20260709 12:09:55.199195  8905 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.199208  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:55.199635  8905 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.199869  8758 raft_consensus.cc:606] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:55.202845  8831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:09:55.203611  8831 raft_consensus.cc:606] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:55.207186  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:09:55.207729  8909 raft_consensus.cc:606] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:55.209347  8905 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.213686  8905 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:55.214385  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:55.215092  8758 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.215399  8758 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.216040  8752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:55.216092  8758 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.216717  8752 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:55.217171  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:55.217968  8831 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.218044  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:55.219329  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.220014  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.217620  8758 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.233181  8831 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:09:55.234856  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:55.235253  8758 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:09:55.235946 10005 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.236579 10005 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:55.237739 10005 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.272716  8654 catalog_manager.cc:5697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.316589  9993 raft_consensus.cc:993] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:09:55.317215 10035 raft_consensus.cc:1081] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:09:55.318810  8831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52178
I20260709 12:09:55.319315  8831 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.319674  8831 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.325227  8831 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.326963  8831 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:55.327958  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:55.328168  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:55.328675  8757 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.328866  8905 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.329025  8757 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.329775  8757 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.330843  8757 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.333806  8905 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:09:55.335325  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:55.336321  9908 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.337057  8757 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:09:55.339115  9908 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:55.340058  9908 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.341188 10004 raft_consensus.cc:993] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:55.341714 10004 raft_consensus.cc:1081] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:55.343554  8757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:09:55.347632  8757 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.348040  8757 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.355520  8757 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.356750  8656 catalog_manager.cc:5697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.357668  8757 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:55.358302  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:55.358784  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:55.359021  8831 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.359474  8905 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.359858  8905 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:55.360772  8905 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.362149  8905 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.367995  8831 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:55.368531  8905 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:55.369323  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:55.370328 10035 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.370811 10035 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.371659 10035 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.383474  8656 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.530026 10002 raft_consensus.cc:993] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:55.530582  9993 raft_consensus.cc:1081] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:55.535072 10002 raft_consensus.cc:993] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:55.536099  9993 raft_consensus.cc:1081] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:55.542972  9523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:55.543681  9523 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.544098  9523 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.546296  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:55.546905  9524 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.547263  9524 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.554315  9524 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.557377  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:55.558003  8758 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.558363  8758 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.559159  8758 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.560284  8758 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.567323  8758 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:55.567862  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:55.568580  9487 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:55.569162  8905 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.569504 10060 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.570084 10060 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:55.571033 10060 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.580655  8905 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:55.564138  9523 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.581249  9524 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:55.583909  9523 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:55.585883  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:55.586529  8758 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.586822  8758 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.585353  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:55.587745  8758 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.588268  8905 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.589581  8758 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.591965  8656 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.601424  8758 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:55.602813  9487 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:55.602947  8905 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:55.603660 10060 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.604324 10060 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:55.606602 10060 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:55.620258  8656 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.679291  9908 raft_consensus.cc:993] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:55.680193  9992 raft_consensus.cc:1081] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:55.681915  8757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43816
I20260709 12:09:55.682601  8757 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.682991  8757 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.690531  8757 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.692185  8757 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:55.692759  8758 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:55.693163  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:55.693392  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:55.694083  8828 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.694175  8905 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.694505  8828 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:55.695405  8828 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:55.696691  8828 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.704684  8828 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:55.706156  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:55.708474 10002 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.709463  8905 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:55.709645 10002 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:55.710866 10002 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:09:55.715271  8726 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f78b2d2f5154e388ca8e35799e1afeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.715857  8828 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.716256  8905 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.720881 10002 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.722252 10010 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.726429  8656 catalog_manager.cc:5697] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.733604 10010 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.734740  8828 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.740307  8905 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.752669  8757 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:55.758360  8656 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.764743  8828 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.767365 10002 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.771834  8905 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.773850  9992 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:55.775388  8726 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a4cb41ea20c4484bfefd8f68fcdc475. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.778254  8905 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.779524 10035 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.780226  8831 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.782444 10035 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.796056  8757 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.799650  9908 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.830274 10035 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.838945  8758 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.838071  8905 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.840549 10004 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.854514  8831 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.883343  8830 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:09:55.905591  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 90744.9us
I20260709 12:09:55.907658  8833 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.918818  8656 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:55.927014 10089 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.955427  8905 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:55.956202  8801 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec2ab93c6c3448edaa2bb2569cfd970b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.958011  9992 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.970803  8757 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.978814  8909 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.981391 10092 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.984583 10010 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.994042  9908 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:56.008139  8760 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:56.017966  8828 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.022367  8905 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.024938 10060 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.039768  8903 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:09:56.044499  8801 consensus_peers.cc:597] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16a04653cca743d0966d20df2225c35d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.046828  8758 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.048730  9992 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.049091  8907 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.061414  9922 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.053004  8656 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.083014  8760 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.086422 10060 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.149572  9922 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:56.152221  8757 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:56.173554  8905 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.177583 10105 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.181912 10106 ts_tablet_manager.cc:933] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:56.191522  8903 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.193116 10010 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.192399  8909 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:09:56.195600  8757 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.197121 10105 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.218623  8826 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.220288 10010 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.216725 10106 tablet_copy_client.cc:323] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:56.233984  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 4f78b2d2f5154e388ca8e35799e1afeb from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:56.234601  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 4f78b2d2f5154e388ca8e35799e1afeb from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-4f78b2d2f5154e388ca8e35799e1afeb
I20260709 12:09:56.250569  8770 tablet_copy_source_session.cc:215] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.187253  8658 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index -1 to 2, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.259512 10108 ts_tablet_manager.cc:933] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:09:56.277824 10106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f78b2d2f5154e388ca8e35799e1afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.279874  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.290759 10108 tablet_copy_client.cc:323] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:09:56.305346  8770 tablet_copy_service.cc:140] P 005ae7a1e140481db6cc04faeb268d9c: Received BeginTabletCopySession request for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:38804)
I20260709 12:09:56.306103  8770 tablet_copy_service.cc:161] P 005ae7a1e140481db6cc04faeb268d9c: Beginning new tablet copy session on tablet 0a4cb41ea20c4484bfefd8f68fcdc475 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:38804: session id = eaa6fbd6102948888c362ff1ea0b32e8-0a4cb41ea20c4484bfefd8f68fcdc475
I20260709 12:09:56.321022  8770 tablet_copy_source_session.cc:215] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.348208 10108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cb41ea20c4484bfefd8f68fcdc475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.373544 10108 tablet_copy_client.cc:806] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.374148 10108 tablet_copy_client.cc:670] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.353237 10106 tablet_copy_client.cc:806] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.375090 10106 tablet_copy_client.cc:670] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.379063 10108 tablet_copy_client.cc:538] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:56.386360 10106 tablet_copy_client.cc:538] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:56.391563 10115 ts_tablet_manager.cc:933] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:56.410305 10108 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:56.412664 10106 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:56.439738 10108 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:56.440759 10108 tablet_bootstrap.cc:492] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:56.441442 10108 ts_tablet_manager.cc:1403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 12:09:56.444486 10108 raft_consensus.cc:359] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.460593 10108 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:56.461338 10108 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.467862 10108 ts_tablet_manager.cc:1434] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:09:56.465193 10115 tablet_copy_client.cc:323] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:56.471252  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet ec2ab93c6c3448edaa2bb2569cfd970b from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:56.471633  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-0a4cb41ea20c4484bfefd8f68fcdc475 received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:56.471853  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet ec2ab93c6c3448edaa2bb2569cfd970b from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-ec2ab93c6c3448edaa2bb2569cfd970b
I20260709 12:09:56.472082  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-0a4cb41ea20c4484bfefd8f68fcdc475 on tablet 0a4cb41ea20c4484bfefd8f68fcdc475 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.478811  8903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:09:56.480460  8845 tablet_copy_source_session.cc:215] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.479535  8903 raft_consensus.cc:606] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.484798 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2ab93c6c3448edaa2bb2569cfd970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.486639 10108 ts_tablet_manager.cc:933] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:56.487800  8757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:56.488756  8757 raft_consensus.cc:606] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.496970  8757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:09:56.497695  8757 raft_consensus.cc:606] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.508810  8831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93afd25256e34a3b902813af41f349c9"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:09:56.509538  8831 raft_consensus.cc:606] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:56.521588 10106 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:56.522677 10106 tablet_bootstrap.cc:492] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:56.523430 10106 ts_tablet_manager.cc:1403] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.010s
I20260709 12:09:56.527489 10106 raft_consensus.cc:359] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.531386 10106 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:56.532192 10106 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.530979 10115 tablet_copy_client.cc:806] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.535027 10115 tablet_copy_client.cc:670] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.536938 10106 ts_tablet_manager.cc:1434] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:56.542728  8770 tablet_copy_service.cc:342] P 005ae7a1e140481db6cc04faeb268d9c: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-4f78b2d2f5154e388ca8e35799e1afeb received from {username='slave'} at 127.0.0.1:38804
I20260709 12:09:56.543175  8770 tablet_copy_service.cc:434] P 005ae7a1e140481db6cc04faeb268d9c: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-4f78b2d2f5154e388ca8e35799e1afeb on tablet 4f78b2d2f5154e388ca8e35799e1afeb with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.543610 10089 raft_consensus.cc:993] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.543659 10115 tablet_copy_client.cc:538] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:56.548936 10089 raft_consensus.cc:1081] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.546890  8903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:09:56.552268  8903 raft_consensus.cc:606] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:56.552544 10108 tablet_copy_client.cc:323] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:09:56.554086  9522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35686
I20260709 12:09:56.554659  9522 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.554997  9522 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.560917  8845 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 16a04653cca743d0966d20df2225c35d from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:09:56.561499  8845 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 16a04653cca743d0966d20df2225c35d from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-16a04653cca743d0966d20df2225c35d
I20260709 12:09:56.570856  8905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efe90059a90047969b785a597928a512"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:09:56.571604  8905 raft_consensus.cc:606] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:09:56.574347  9522 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.577268  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:56.577948  8826 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.583447  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:56.585320 10115 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:56.585541  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:56.586421  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.588547  9522 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:56.584760  8845 tablet_copy_source_session.cc:215] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.593758 10108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a04653cca743d0966d20df2225c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.599056  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:56.599810  8905 raft_consensus.cc:3055] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.600154  8905 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:56.619266  8905 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.621240  8905 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.621846 10035 raft_consensus.cc:993] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.622361 10035 raft_consensus.cc:1081] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.611212  9522 raft_consensus.cc:1217] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.616310 10108 tablet_copy_client.cc:806] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.632947 10108 tablet_copy_client.cc:670] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.636440  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:56.638823  9524 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.639238  9524 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.636171  8826 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.647209  8905 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.651298 10108 tablet_copy_client.cc:538] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:56.654311  9524 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.649784  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:56.656849  9524 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:56.658758 10114 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.659415 10114 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:56.660459 10114 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.673059  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:56.673863  8757 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.674201  8757 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:56.675122  8757 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.676467  8757 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.684496 10010 raft_consensus.cc:993] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.685330 10010 raft_consensus.cc:1081] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer eaa6fbd6102948888c362ff1ea0b32e8 to start an election
I20260709 12:09:56.697206  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:56.698050  8905 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.742255 10108 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:09:56.746853  9524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
 from {username='slave'} at 127.0.0.1:35706
I20260709 12:09:56.747558  9524 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.747998  9524 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.762348  9524 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.772044  9908 raft_consensus.cc:993] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:56.772526  9908 raft_consensus.cc:1081] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:09:56.773217  8905 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.774802  9522 raft_consensus.cc:1217] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.775082  9488 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:09:56.776511 10105 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.777032 10105 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:56.777927 10105 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.781402  8757 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.782811  9524 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:56.782944  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:56.783545  8758 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.783941  8758 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:56.784729  8758 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.785634  8758 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.800347  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:56.801034  8828 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.805022  8657 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.809731 10108 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:56.810940 10108 tablet_bootstrap.cc:492] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:56.811650 10108 ts_tablet_manager.cc:1403] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.012s
I20260709 12:09:56.812247  8828 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.814332  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:56.814987  8828 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.815238 10105 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.815765 10105 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:09:56.815948  8909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93afd25256e34a3b902813af41f349c9"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38210
I20260709 12:09:56.816690  8909 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.817098  8909 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.816943 10105 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:56.820377 10108 raft_consensus.cc:359] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.821373 10108 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:56.822021 10108 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.826683 10108 ts_tablet_manager.cc:1434] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:56.827557  8909 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:56.838035 10115 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:56.839124 10115 tablet_bootstrap.cc:492] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:09:56.839874 10115 ts_tablet_manager.cc:1403] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.263s	user 0.068s	sys 0.099s
I20260709 12:09:56.845904 10115 raft_consensus.cc:359] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.846814 10115 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:09:56.848031 10115 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:09:56.859879 10115 ts_tablet_manager.cc:1434] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:09:56.889513  9524 raft_consensus.cc:1217] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.796425  8758 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:09:56.893887  8845 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-16a04653cca743d0966d20df2225c35d received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:56.894388  8845 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-16a04653cca743d0966d20df2225c35d on tablet 16a04653cca743d0966d20df2225c35d with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.897135  8844 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-ec2ab93c6c3448edaa2bb2569cfd970b received from {username='slave'} at 127.0.0.1:35550
I20260709 12:09:56.897671  8844 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-ec2ab93c6c3448edaa2bb2569cfd970b on tablet ec2ab93c6c3448edaa2bb2569cfd970b with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:56.899001  8909 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:56.900882  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:56.901499  8833 raft_consensus.cc:3055] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.901801  8833 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:09:56.902554  8833 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:56.903740  8833 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.915272  8833 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:09:56.960945  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:09:56.962576  8758 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.973871  8758 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:09:57.033397  8658 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.039057  8874 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:57.050601 10089 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.051467 10089 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:57.051246  8658 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.055689 10089 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.141727  9523 raft_consensus.cc:1217] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:57.145123  8826 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.182824 10133 raft_consensus.cc:1064] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:57.187299 10114 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.247188  8905 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.256153 10060 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:09:57.282994 10133 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:57.301333 10004 raft_consensus.cc:993] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
W20260709 12:09:57.276829  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 66416.9us
I20260709 12:09:57.315105 10139 raft_consensus.cc:993] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:57.315943 10139 raft_consensus.cc:1081] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:57.320868  8755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:09:57.321834  8755 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.322314  8755 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.325384 10004 raft_consensus.cc:1081] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:09:57.328778 10132 raft_consensus.cc:1064] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:57.332578 10132 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:57.334092  8906 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.341446  8831 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.343326 10105 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.363143  9523 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.369539 10010 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.370352  8757 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.372283 10114 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.391929  8757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efe90059a90047969b785a597928a512"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:09:57.398758  8830 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.400534  9523 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.392784  8757 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.406225  8757 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.407804  8755 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.419716  8906 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.413151 10114 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:09:57.432134  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:57.437116  8831 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.436124  8755 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:57.438055 10131 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:09:57.457803  8905 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.462045 10035 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:09:57.459003  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:57.463052  8906 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.463502  8906 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:57.464430  8906 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.472952  8657 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 2 to 3, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:57.485765  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 127221us
I20260709 12:09:57.465989 10035 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:09:57.513581  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 127244us
I20260709 12:09:57.482172 10133 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:09:57.523372  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 104350us
W20260709 12:09:57.525882 10151 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:09:57.530952  8755 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:57.573194 10148 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
I20260709 12:09:57.599928  8832 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:57.624006  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61836.8us
I20260709 12:09:57.682526  8831 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:57.714942  8827 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.716511 10164 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 12:09:57.719321  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 54502.9us
I20260709 12:09:57.725075  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:09:57.731562 10144 raft_consensus.cc:1064] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:57.736510  8757 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.756434 10135 raft_consensus.cc:1064] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:09:57.760958  8757 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:57.747705 10010 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.775389 10010 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:57.776456 10010 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.783820  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:09:57.784462  8900 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.784821  8900 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:09:57.785681  8900 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:57.786650  8900 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.787667  8906 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.783558 10143 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.861079  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:57.866583  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 74246.1us
I20260709 12:09:57.883383  8906 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:57.764312 10135 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:57.903199  8900 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
W20260709 12:09:57.909715  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 158524us
I20260709 12:09:57.933488  8829 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.937172  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:09:57.938104  8834 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.940449 10144 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:09:57.942814  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 140094us
I20260709 12:09:57.949934  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:09:57.952414  8834 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:09:57.991252  9993 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.991866  9993 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:09:57.992868  9993 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:58.054706  9523 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.057224 10168 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.160444 10133 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:58.168285  9518 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:58.182917  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.182709 10181 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.196172  8900 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:58.206477  9922 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:09:58.235601  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.236758  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.316455  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52902.5us
W20260709 12:09:58.318990  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 61432.7us
W20260709 12:09:58.331637  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.334270  8902 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.336298  8904 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:58.341254 10191 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:09:58.350039 10181 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:09:58.351370 10181 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:58.353078  8754 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.354709  8760 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.363049  8757 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.364668  8753 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.371486  9523 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:58.369622  9922 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.378326  8900 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.378726 10172 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:09:58.389218 10186 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:09:58.390172 10186 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:58.430845 10181 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:58.451531 10002 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:58.456920 10171 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:09:58.457770  9993 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:58.473271  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:09:58.527055  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101088us
W20260709 12:09:58.543571  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 121589us
W20260709 12:09:58.544135  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 118575us
I20260709 12:09:58.528167 10186 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:09:58.598330  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.614236  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 216) took 1309 ms. Trace:
W20260709 12:09:58.624361  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 63160.7us
W20260709 12:09:58.610131 10195 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 12:09:58.689543  8835 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.693451  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:09:58.701313  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:09:58.714236  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71571.8us
W20260709 12:09:58.721853  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 79667us
I20260709 12:09:58.720398  8826 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:09:58.735520  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 57545.5us
I20260709 12:09:58.735706  8832 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.722740 10172 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:09:58.626595  8657 rpcz_store.cc:276] 0709 12:09:57.305106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.305250 (+   144us) service_pool.cc:224] Handling call
0709 12:09:58.614130 (+1308880us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:57.514859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:57.529242 (+ 14383us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:57.530039 (+   797us) write_op.cc:435] Acquired schema lock
0709 12:09:57.530064 (+    25us) tablet.cc:662] Decoding operations
0709 12:09:57.607495 (+ 77431us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:57.612466 (+  4971us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:57.616161 (+  3695us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:57.619649 (+  3488us) tablet.cc:701] Row locks acquired
0709 12:09:57.619671 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:09:57.619845 (+   174us) write_op.cc:270] Start()
0709 12:09:57.619993 (+   148us) write_op.cc:276] Timestamp: P: 1783598997619795 usec, L: 0
0709 12:09:57.620020 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:09:57.669537 (+ 49517us) log.cc:844] Serialized 541 byte log entry
0709 12:09:57.980984 (+311447us) op_driver.cc:464] REPLICATION: finished
0709 12:09:58.134501 (+153517us) write_op.cc:301] APPLY: starting
0709 12:09:58.138042 (+  3541us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:58.138194 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:58.138386 (+   192us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:58.138797 (+   411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:58.139018 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:58.139099 (+    81us) write_op.cc:312] APPLY: finished
0709 12:09:58.139392 (+   293us) log.cc:844] Serialized 23 byte log entry
0709 12:09:58.139606 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.139699 (+    93us) write_op.cc:454] Released schema lock
0709 12:09:58.139739 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:58.140148 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.140199 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":150311,"apply.run_cpu_time_us":2691,"apply.run_wall_time_us":5629,"num_ops":1,"prepare.queue_time_us":16305,"prepare.run_cpu_time_us":4024,"prepare.run_wall_time_us":174406,"replication_time_us":331499,"thread_start_us":129509,"threads_started":1}]]}
I20260709 12:09:58.731858 10156 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.732398 10157 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:09:58.752280 10146 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.756472  9992 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.746111 10172 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:58.751026 10157 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:58.749045 10156 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:58.771348  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:09:58.791105 10172 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:58.800976 10205 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:58.805447  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:58.808271 10134 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:58.827787 10157 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:09:58.833779 10156 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:58.844067  8724 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:58.852391 10181 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.300136  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 225) took 1294 ms. Trace:
I20260709 12:09:59.300520  8658 rpcz_store.cc:276] 0709 12:09:58.005543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.005802 (+   259us) service_pool.cc:224] Handling call
0709 12:09:58.140773 (+134971us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:09:59.300064 (+1159291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479239,"reported_tablets":1,"spinlock_wait_cycles":259709696}
I20260709 12:09:59.360147  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:59.374204  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 140) took 1231 ms. Trace:
I20260709 12:09:59.375030  8656 rpcz_store.cc:276] 0709 12:09:58.142552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.142830 (+   278us) service_pool.cc:224] Handling call
0709 12:09:59.373982 (+1231152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1220467,"reported_tablets":1}
I20260709 12:09:59.387601  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:09:59.388374  9993 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.394647  8904 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.396832 10132 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:59.427541  8755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.012s	sys 0.001s
W20260709 12:09:59.429240  8755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.004s
I20260709 12:09:59.433669  8907 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.619706 10181 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:09:59.620340 10181 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.622490 10181 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:59.641010  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:59.643606  8654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 231) took 1409 ms. Trace:
I20260709 12:09:59.644068  8654 rpcz_store.cc:276] 0709 12:09:58.233862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.234146 (+   284us) service_pool.cc:224] Handling call
0709 12:09:59.332773 (+1098627us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:09:59.643438 (+310665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38595,"reported_tablets":1,"spinlock_wait_cycles":16005888}
I20260709 12:09:59.646150  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:59.650949 10200 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:09:59.651722 10200 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.654819 10200 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:59.657581  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:09:59.663470  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:59.665921  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 68) took 1494 ms. Trace:
I20260709 12:09:59.667619  8909 rpcz_store.cc:276] 0709 12:09:58.171285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.173850 (+  2565us) service_pool.cc:224] Handling call
0709 12:09:58.174311 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:58.174831 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:58.174873 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:58.175453 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:09:58.423057 (+247604us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:58.431611 (+  8554us) log.cc:844] Serialized 14 byte log entry
0709 12:09:58.434837 (+  3226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.434939 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:58.921395 (+486456us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180035c800. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350242a6 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1
0709 12:09:59.656992 (+735597us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b180035c800. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:09:59.664758 (+  7766us) raft_consensus.cc:1685] finished
0709 12:09:59.664785 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:59.665277 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7615,"prepare.queue_time_us":8630,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":7925,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":12434,"spinlock_wait_cycles":40675968,"thread_start_us":247160,"threads_started":1,"wal-append.queue_time_us":278344}
I20260709 12:09:59.673979  9922 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:09:59.674665  9922 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:59.678507  9922 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:59.684742  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:59.684981 10167 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:09:59.685637 10167 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.687922 10167 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:59.688520 10176 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:09:59.689155 10176 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:09:59.693960  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:09:59.692945 10140 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.693800 10141 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.695775  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:59.698818 10176 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:59.699131  8835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:09:59.699880  8835 raft_consensus.cc:606] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:09:59.699572  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:09:59.700647 10143 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.712066 10154 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:09:59.709288  8755 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.712764  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:09:59.712930 10060 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:09:59.716784 10154 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.717324 10060 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.719756 10154 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:59.723167  8757 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.729427 10060 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:09:59.730472  9519 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.732609 10133 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:09:59.733235 10133 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:09:59.736014 10133 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:59.750962  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:09:59.753643  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 111063us
I20260709 12:09:59.777381  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:59.774825  8656 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:09:59.787423  8656 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:09:59.824127  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:09:59.758054  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:09:59.921619  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 159892us
W20260709 12:09:59.933336  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 177594us
I20260709 12:09:59.986815 10157 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.021991 10157 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.022950  8832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:00.024186  8832 raft_consensus.cc:606] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:00.026383  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 226082us
I20260709 12:09:59.989867 10176 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:09:59.990707 10215 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.028434 10157 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:09:59.824307 10225 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.031889 10165 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:09:59.999827 10222 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:00.001546  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 127465us
I20260709 12:10:00.002038 10002 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.005026  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.011317 10227 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.016462  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.017892  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:09:59.782047 10171 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.027701 10176 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.028869 10215 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.043663  9922 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.041513 10002 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.047112  9922 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.000396 10154 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.032706 10165 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.049990 10154 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.052356 10165 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.056068 10002 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.056284  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:00.056818 10176 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.057788 10229 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.058295  9922 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.037835 10222 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.073035 10222 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:00.081610  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:00.082639  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:00.082937  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 55512.5us
I20260709 12:10:00.083564  9922 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:00.084098  9922 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.088225  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:00.091383  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:00.092298  8757 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:00.059303 10224 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:00.089033  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44036.6us
I20260709 12:10:00.089016  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:00.094750  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:00.096900  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 51537.8us
I20260709 12:10:00.032445 10225 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.103739  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.105296  8900 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:00.115414  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:00.124104  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 64431.6us
I20260709 12:10:00.124260  9922 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.126371  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.081068 10141 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.094518 10154 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.104875 10200 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.160239 10228 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.061633 10171 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:00.170089  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 68924.7us
I20260709 12:10:00.042393 10227 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.123682  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:00.182283  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 83792.9us
I20260709 12:10:00.183185 10138 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.184494  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:00.159904 10200 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.158376 10215 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:00.198861  8724 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:00.198804 10200 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.185675 10168 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.190910 10060 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.172796 10141 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.244577  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:00.115475 10224 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.183934 10138 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.773622  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.768966  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.314610 10237 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.775302  8832 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:00.775660 10252 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.460728 10240 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.170482 10242 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.776813 10141 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.210105 10205 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:00.777279 10242 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.355073 10225 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.780416 10136 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:00.286518  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 78838.6us
I20260709 12:10:00.776350 10252 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.776928 10240 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:00.446417  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 260817us
I20260709 12:10:00.289645  8902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
W20260709 12:10:00.680548 10140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.005s	sys 0.034s
I20260709 12:10:00.413882 10204 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:00.313720 10233 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:10:00.255728  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 83211.7us
I20260709 12:10:00.788066  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.795185  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:00.352849  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 142535us
I20260709 12:10:00.778546 10205 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:00.288396  8930 debug-util.cc:398] Leaking SignalData structure 0x7b080016d160 after lost signal to thread 7581
I20260709 12:10:00.813488 10205 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.813925  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:00.814253  8930 debug-util.cc:398] Leaking SignalData structure 0x7b080016d840 after lost signal to thread 8692
W20260709 12:10:00.806391  8801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.028s	sys 0.025s
I20260709 12:10:00.809358  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.739152 10238 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.777642 10141 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.744051 10223 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.703186 10208 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.421761 10132 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.313253 10216 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.244882 10160 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.779999 10245 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:00.827077  8801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.029s	sys 0.025s
I20260709 12:10:00.311733 10207 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:00.778232 10251 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:00.688843 10227 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:00.275362 10168 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.890702  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.894800  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.935652  8833 raft_consensus.cc:2410] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:00.894448  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:00.460424 10241 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.818186  8902 raft_consensus.cc:606] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:00.822566  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:00.943768  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 121290us
I20260709 12:10:00.275596 10060 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.894580 10248 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.938841  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.887995 10140 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:00.950470 10224 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.951753 10142 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:00.952530 10242 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.957037 10171 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:00.958366  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:00.938189  8930 debug-util.cc:398] Leaking SignalData structure 0x7b08003695a0 after lost signal to thread 8784
I20260709 12:10:00.852555 10204 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.916005 10216 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.896255 10208 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.853214 10141 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:01.005344  8874 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 2.013s (SENT)
I20260709 12:10:00.888646 10238 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:01.005203  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 43938.4us
I20260709 12:10:00.973805 10222 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.009810  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:00.896047 10132 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.783221 10136 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.775678 10237 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.817852 10240 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:00.917095 10223 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:00.985245  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:00.983896 10140 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.023598 10168 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.023810  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.029269  8907 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:01.030287  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:00.993189 10224 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.034279 10252 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.038269  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:00.990518 10241 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:01.039848  8930 debug-util.cc:398] Leaking SignalData structure 0x7b080035cda0 after lost signal to thread 8859
I20260709 12:10:00.991204 10207 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.020164  9523 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:01.050786 10208 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.944501 10160 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.051750  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.053691 10249 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:01.055672  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.015019 10225 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:01.018463 10171 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.094303 10136 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.057076 10165 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:01.112285  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.153159  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.103333 10240 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.105569 10237 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.085546  8830 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:01.108249 10224 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.113979 10140 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.114027 10238 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.148790 10216 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:00.994941 10248 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.158056 10241 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.158138  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.165216 10132 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:00.979426 10245 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:01.153277  8930 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3100 after lost signal to thread 8933
I20260709 12:10:01.160990 10165 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.145051 10208 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:00.993913 10251 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.111492 10256 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:01.014506 10142 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.169037 10138 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.183434 10223 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.155736 10264 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:01.184243 10250 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
I20260709 12:10:01.157826 10171 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.170527 10225 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.157419 10249 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.257218 10165 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.257359 10132 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.203078 10176 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.257977 10132 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.270586 10060 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:01.263827  8930 debug-util.cc:398] Leaking SignalData structure 0x7b0800348740 after lost signal to thread 9549
I20260709 12:10:01.281081  9922 raft_consensus.cc:993] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:01.281852  9922 raft_consensus.cc:1081] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:01.240712 10208 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.235179 10256 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.300273 10256 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.313133 10224 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.313527 10142 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.314836 10251 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.286113 10254 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.266932 10176 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.247537 10264 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.280480 10207 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:01.334182 10253 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.336244 10249 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.348443 10208 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.287912 10160 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:01.349805  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 104) took 1168 ms. Trace:
I20260709 12:10:01.351130 10176 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.353251 10132 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.338310 10171 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.339811 10225 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.342338 10248 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.344558 10253 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.289160 10205 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.318684 10254 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.356523  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.357033 10141 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.350417  8754 rpcz_store.cc:276] 0709 12:10:00.181211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.182858 (+  1647us) service_pool.cc:224] Handling call
0709 12:10:00.183504 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.899384 (+715880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.914600 (+ 15216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.934588 (+ 19988us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:00.937816 (+  3228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.349402 (+411586us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54001caf54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:01.349479 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.349687 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484814080}
I20260709 12:10:01.369001 10204 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.377879 10264 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.382691  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 100) took 1340 ms. Trace:
I20260709 12:10:01.388054  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.379756  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 386) took 1669 ms. Trace:
I20260709 12:10:01.392654  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.385540  8752 rpcz_store.cc:276] 0709 12:10:00.042470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.068249 (+ 25779us) service_pool.cc:224] Handling call
0709 12:10:00.120181 (+ 51932us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:00.182963 (+ 62782us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:00.216167 (+ 33204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.778202 (+562035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.778240 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.778356 (+   116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:00.778388 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.382380 (+603992us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54000f78d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:01.382456 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.382611 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318753536}
I20260709 12:10:01.396521  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.392401  9519 rpcz_store.cc:276] 0709 12:09:59.709828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.711873 (+  2045us) service_pool.cc:224] Handling call
0709 12:09:59.712176 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:59.730230 (+ 18054us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:00.003403 (+273173us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.378678 (+375275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.415834 (+ 37156us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:00.424962 (+  9128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.378707 (+953745us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54006491d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:01.378774 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.379651 (+   877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27662,"raft.queue_time_us":39554,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":40955776,"thread_start_us":295773,"threads_started":2,"wal-append.queue_time_us":52617}
W20260709 12:10:01.398654 10200 consensus_meta.cc:287] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.179s	user 0.009s	sys 0.004s
I20260709 12:10:01.399192 10200 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.400435  8900 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:01.401995 10143 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.402560  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 1581) took 1276 ms. Trace:
I20260709 12:10:01.402947  8900 rpcz_store.cc:276] 0709 12:10:00.125929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.126088 (+   159us) service_pool.cc:224] Handling call
0709 12:10:01.402357 (+1276269us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540019b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:01.402485 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927911680}
I20260709 12:10:01.403764 10157 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.404140  8908 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.408655  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.385244  8833 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:01.396401 10167 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.412135 10167 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.414502 10167 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:01.402597 10143 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.421593  8901 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:01.357878 10245 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.424127 10200 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:01.404554 10157 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.436928 10254 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.444134  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.446769  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.448971  8900 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:01.451313  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.452672  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.453550  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:01.462072  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 370137us
W20260709 12:10:01.466717  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 433773us
W20260709 12:10:01.471688  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 69548.7us
I20260709 12:10:01.471903  8905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:01.474301  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:01.425691 10143 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.481842  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.472805  8905 raft_consensus.cc:606] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:01.477604  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.486531  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.499661  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.501443  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.506253  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.509945  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:01.507038  8752 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:01.519374  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.520538  8909 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:10:01.519531  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45313.5us
I20260709 12:10:01.523308  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.525511  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.526225  9524 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:01.528405  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.524767  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:01.555707  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 189079us
I20260709 12:10:01.504052  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.565591  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.450827  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.569522  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.529824 10259 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.516306 10205 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.583711  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.588524  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.529815 10215 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.594782 10215 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.590214  8759 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:01.557539  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.607908 10265 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.608217  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.608575 10265 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.610069  8754 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:01.590525 10181 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.621690 10181 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:01.598745  9518 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:01.583033  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:01.630633 10216 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.633024 10216 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.597308 10267 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.610816 10143 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.590624 10259 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.643693 10274 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:01.644407 10274 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.635752 10267 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:01.643186 10259 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.679675  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 118946us
I20260709 12:10:01.655682  8875 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:01.700127  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 74550.5us
W20260709 12:10:01.700898  8799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.013s	sys 0.088s
W20260709 12:10:01.701315  8799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.013s	sys 0.088s
I20260709 12:10:01.701388  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.702064  8755 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
W20260709 12:10:01.718999  8832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.012s
W20260709 12:10:01.719282  8798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.027s	sys 0.052s
I20260709 12:10:01.637176 10143 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:01.719945  8798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.028s	sys 0.052s
W20260709 12:10:01.738932  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 627332us
W20260709 12:10:01.719439  8832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.012s
W20260709 12:10:01.725071  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 103169us
I20260709 12:10:01.724587  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:01.725481  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 69892.7us
I20260709 12:10:01.744293  8875 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:01.726795  8725 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.747116  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.748593  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.750208  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.750743 10265 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:01.751168 10181 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:01.797299  8907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.048s	sys 0.049s
W20260709 12:10:01.797797  8907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.048s	sys 0.049s
I20260709 12:10:01.728961 10267 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:01.807572  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 63033.5us
I20260709 12:10:01.809360  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.809612  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:01.810985  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 68470.9us
I20260709 12:10:01.812217  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.738394 10171 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.736980 10273 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.751906 10205 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.834450  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.836701  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.836931  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.864876  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.837657  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.838167  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.841010  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.841156  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.841837  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.842778  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.843484  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:01.803977  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:01.849602 10133 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.832887 10226 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.969575  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.850744  9518 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:01.811487 10243 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.973863  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:01.962165  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 94465us
I20260709 12:10:01.971413  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.978178  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.989971  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:01.991669  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 157368us
I20260709 12:10:01.993285  9489 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:01.994582 10143 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.995424 10143 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.996786 10157 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:01.997491 10226 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:02.001045  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.001443  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:01.961218 10273 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:02.002822  8908 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:02.004690  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:01.991808  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.002030  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:02.011224  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.014781  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:01.970119 10222 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:02.023123 10279 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:10:02.031958 10255 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.965161 10171 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:01.969298 10265 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.970767 10215 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.051204  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:02.054895  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.057668  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 313359us
I20260709 12:10:02.059484  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.060355  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 319897us
I20260709 12:10:02.061126  8872 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:02.010993 10274 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.063078  8875 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:02.067658  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.068504 10278 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.053493 10171 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:02.069677 10226 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:02.070742  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.071699  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.072456  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.072706  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.074559  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.060868  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 67718.1us
I20260709 12:10:02.106549  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.078223  8872 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:02.109815 10274 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.078405 10289 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.086555  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1229) took 1283 ms. Trace:
I20260709 12:10:02.104475  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.115954  8907 rpcz_store.cc:276] 0709 12:10:00.802730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.803393 (+   663us) service_pool.cc:224] Handling call
0709 12:10:00.803713 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.029156 (+225443us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:01.263668 (+234512us) log.cc:844] Serialized 14 byte log entry
0709 12:10:01.975525 (+711857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:01.975572 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:01.975609 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.086179 (+110570us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000b2554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:02.086252 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.086467 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":197974,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":517922176,"thread_start_us":711432,"threads_started":2,"wal-append.queue_time_us":696761}
I20260709 12:10:02.115356 10289 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:02.117340 10226 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.136384 10289 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:02.121901  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58901us
I20260709 12:10:02.157254 10171 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.158632  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.138171  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:02.154567 10274 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.215900  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.212721 10284 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:10:02.229393  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.214223  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 107821us
I20260709 12:10:02.234639 10207 raft_consensus.cc:993] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:02.239552  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:02.242115  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 191049us
I20260709 12:10:02.243221  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.243600  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.216198 10273 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.225970 10133 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.219337 10274 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:02.218786 10171 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:02.250741  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.251152  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.251605  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.256242  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.255267  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.255472  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:02.259804  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:02.344820  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 90251.5us
I20260709 12:10:02.347710  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:02.275775  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.345855  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:02.281383  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.358651  8909 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:02.268345 10288 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:02.381448 10288 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:02.382421 10290 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:02.383049 10290 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:02.267170 10272 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:02.296988  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.372344  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.346423 10135 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.343743  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.350234 10200 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:02.253010 10253 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:02.360394  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.405928  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:02.441377  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 345707us
W20260709 12:10:02.541301  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 263700us
I20260709 12:10:02.543560  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:02.543947  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 198170us
I20260709 12:10:02.300968 10171 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:02.551265  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.544314  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.552567  8799 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:02.535079  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:02.418434  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.273447 10207 raft_consensus.cc:1081] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:02.519016  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.255095 10274 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.545991  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.450222  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.513655  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:02.832340  9518 consensus_meta.cc:287] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.000s
I20260709 12:10:02.429122 10252 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:02.849063 10259 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 1.163s	user 0.000s	sys 0.016s
I20260709 12:10:02.863106 10259 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:02.608124  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.863648  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:02.864468  8755 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:02.864712  9521 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.825100  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.556218  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.866217  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.866659  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:02.866771  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.867980  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:02.660779  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 303967us
I20260709 12:10:02.867827  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.901755  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1595) took 1196 ms. Trace:
W20260709 12:10:02.857118  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 305906us
W20260709 12:10:02.641223  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 89560.2us
I20260709 12:10:02.868508  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.698105  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.873683  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.857226  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:02.876731  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 324327us
I20260709 12:10:02.945966  8907 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:10:02.954483  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61104.9us
I20260709 12:10:02.384500 10288 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:02.471089 10282 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.411s	user 0.000s	sys 0.002s
I20260709 12:10:02.956017  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:02.959494  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:02.874034 10204 raft_consensus.cc:993] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:02.976915  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.965636  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.971045  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 276) took 1147 ms. Trace:
I20260709 12:10:02.950260  8905 rpcz_store.cc:276] 0709 12:10:01.705314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.724806 (+ 19492us) service_pool.cc:224] Handling call
0709 12:10:02.261115 (+536309us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b5800135398. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:02.261319 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.607642 (+346323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.607702 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.607759 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.607803 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.901395 (+293592us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400116f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:02.901469 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.901670 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902625408}
I20260709 12:10:02.606678 10236 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.961771  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:02.961706  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.965137  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38210
I20260709 12:10:02.606091 10229 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.449337  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.630823 10276 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.997984  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.869318  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:02.646200 10171 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.774165  8753 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:02.608119 10278 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:02.641192 10290 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:02.947691 10265 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.007826  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.582800 10272 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:02.647926 10216 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:02.960246 10002 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:03.038051 10002 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.011059 10142 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.040235 10002 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.001562 10286 raft_consensus.cc:1081] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:03.029842  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:02.560489 10200 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.035265 10272 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.035145  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1489) took 2240 ms. Trace:
I20260709 12:10:03.001679 10260 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.010835 10165 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.036515  8902 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:03.031811 10290 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.004388  9489 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.037458 10276 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.029330 10229 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.018224 10294 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.449513  8908 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:03.007714 10235 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.046900  8874 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.018566 10204 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.011058  9993 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:03.075317  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.023234 10133 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.043723  8832 rpcz_store.cc:276] 0709 12:10:00.794279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.794465 (+   186us) service_pool.cc:224] Handling call
0709 12:10:00.794991 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.057937 (+262946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.057967 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.095094 (+ 37127us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.739978 (+644884us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.740027 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.406872 (+666845us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001fe0d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:02.406943 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.034717 (+627774us) raft_consensus.cc:1685] finished
0709 12:10:03.034767 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.035041 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56653,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13085,"spinlock_wait_cycles":603855744,"thread_start_us":611839,"threads_started":1,"wal-append.queue_time_us":720665}
I20260709 12:10:03.106228  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:03.109392  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 148731us
W20260709 12:10:03.114055  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 152368us
I20260709 12:10:03.021459 10263 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:03.126519  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.066210 10142 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.138446  8909 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:03.139402  9993 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:02.992278  9518 rpcz_store.cc:276] 0709 12:10:01.823222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.828572 (+  5350us) service_pool.cc:224] Handling call
0709 12:10:01.850263 (+ 21691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.850574 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:02.861871 (+1011297us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.970654 (+108783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.970713 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:02.970766 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.970847 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.970983 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":97636,"threads_started":1}
I20260709 12:10:03.103785 10236 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.146571 10236 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.045141 10265 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.079218 10165 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.150326 10265 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.150837 10165 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.151048 10133 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.154211 10133 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.143693  9522 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
W20260709 12:10:03.141881  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 95066.1us
I20260709 12:10:03.157332 10235 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.111707 10269 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.045377 10278 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:03.165764  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 87638us
I20260709 12:10:03.173631  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:03.164922  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 211168us
I20260709 12:10:03.178499  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.179281  8759 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:03.133473 10204 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:03.186352  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 47655.4us
W20260709 12:10:03.186504  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 47299.8us
I20260709 12:10:03.191757 10306 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.176671 10272 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.192260  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.171729 10265 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.192554 10291 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:03.193023  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.193136 10265 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.194742  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.080194 10260 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.195962 10265 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.197592 10260 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.205613  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.207254  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:03.198074 10216 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.209616  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.114781 10276 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.172291 10299 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.219528  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:03.171343  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 196940us
W20260709 12:10:03.226341  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 174827us
I20260709 12:10:03.201273 10204 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.220875  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.228101  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.188479 10143 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.229161  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.221422 10236 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:10:03.216074 10216 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.227231 10306 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.211241 10165 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.192556 10272 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.235543 10235 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.188345 10301 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.217108 10142 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:03.238518  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 63844.6us
I20260709 12:10:03.203840 10259 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.216403 10290 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.278896 10276 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.285332  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.280838  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.227898 10299 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.279801  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.286664  8759 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.245005 10265 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.244902 10272 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.279595  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.245322 10143 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.219262 10252 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.375397 10252 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:03.375958 10299 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.376360 10252 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.377504 10252 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.379099  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.240240 10235 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.177551 10269 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.217715 10300 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.219494 10286 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.381098 10300 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.381286 10286 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.381558 10300 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.381701 10286 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.272070 10200 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.257495  8755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:10:03.383239  8755 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.383587  8755 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.285135 10278 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.218585 10287 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.286875  8726 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:03.389707  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 102929us
I20260709 12:10:03.390452 10269 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.279706  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.392565 10142 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.393242 10253 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.256450  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:03.396241  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 139855us
I20260709 12:10:03.398247  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:03.274369  9489 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:03.399514  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 125250us
I20260709 12:10:03.399309 10286 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.400038  8755 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.238015 10216 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.402132  8755 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.270601  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.287315  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.322520  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.325009  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.403443 10305 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:03.327322 10289 consensus_meta.cc:287] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.190s	user 0.007s	sys 0.010s
I20260709 12:10:03.404214 10289 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.406458 10289 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.330426 10294 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.407263 10294 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:03.407387 10300 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:03.331465  8753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1216) took 1747 ms (client timeout 1641 ms). Trace:
I20260709 12:10:03.332150  8760 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.334298  8756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
W20260709 12:10:03.409545  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 115444us
I20260709 12:10:03.410053  8756 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.410447  8756 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.258931 10165 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.269672  9993 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.282920  8907 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.421650  8907 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.422236  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.256968  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.281258  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:03.335047  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 109197us
I20260709 12:10:03.425175  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.262439  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.257542  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:03.332805 10274 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:03.344388  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 382685us
W20260709 12:10:03.351182  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50028.6us
I20260709 12:10:03.430131  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.431259  8798 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.352896  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 217) took 3708 ms. Trace:
W20260709 12:10:03.354990  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 116076us
I20260709 12:10:03.436393  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:03.436985  9524 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.439285  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.356812 10312 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.441232 10312 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.442423  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.443771 10312 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.362164 10204 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.443990  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.363354 10207 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.363443  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1236) took 1124 ms. Trace:
I20260709 12:10:03.240240  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.446168 10135 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:03.446717  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 207748us
I20260709 12:10:03.375021 10143 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.445874  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.372344  8834 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:03.448797 10265 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.449195 10265 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:03.449533 10265 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.387610  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.293792  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:03.403072  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 132595us
W20260709 12:10:03.408813  8753 rpcz_store.cc:269] 0709 12:10:01.700598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.724284 (+ 23686us) service_pool.cc:224] Handling call
0709 12:10:03.331219 (+1606935us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54002c29d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:03.331358 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866490240}
I20260709 12:10:03.457762 10204 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.413565  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.414117 10311 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.414856  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.415416 10272 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.415763 10278 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.462041 10278 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.416819  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.417261  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1265) took 1001 ms. Trace:
I20260709 12:10:03.408236 10294 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.420023  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.420750  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.420819 10246 consensus_queue.cc:1059] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.426767  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:03.475939  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.433907 10289 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.439565  8756 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.431253 10274 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.346926  8654 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:03.489214 10246 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.489624 10246 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:03.490507 10246 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.490621  8654 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:03.492053 10246 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.445727 10303 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.492434  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.445214  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.493512  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:03.493789  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48652.1us
I20260709 12:10:03.494182  8828 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:03.494688  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.432778  8656 rpcz_store.cc:276] 0709 12:09:59.643291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.643444 (+   153us) service_pool.cc:224] Handling call
0709 12:10:03.351974 (+3708530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:00.077517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:00.159715 (+ 82198us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:00.164179 (+  4464us) write_op.cc:435] Acquired schema lock
0709 12:10:00.165537 (+  1358us) tablet.cc:662] Decoding operations
0709 12:10:00.213683 (+ 48146us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:00.213766 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:00.213796 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:00.214080 (+   284us) tablet.cc:701] Row locks acquired
0709 12:10:00.214096 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:00.214246 (+   150us) write_op.cc:270] Start()
0709 12:10:00.214362 (+   116us) write_op.cc:276] Timestamp: P: 1783599000214205 usec, L: 0
0709 12:10:00.214395 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:00.215103 (+   708us) log.cc:844] Serialized 987 byte log entry
0709 12:10:01.975400 (+1760297us) op_driver.cc:464] REPLICATION: finished
0709 12:10:02.690511 (+715111us) write_op.cc:301] APPLY: starting
0709 12:10:02.712333 (+ 21822us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:02.757271 (+ 44938us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:02.857116 (+ 99845us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:02.929141 (+ 72025us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:02.972683 (+ 43542us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:02.972736 (+    53us) write_op.cc:312] APPLY: finished
0709 12:10:02.972950 (+   214us) log.cc:844] Serialized 29 byte log entry
0709 12:10:03.121293 (+148343us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.132862 (+ 11569us) write_op.cc:454] Released schema lock
0709 12:10:03.136346 (+  3484us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:03.211895 (+ 75549us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.217478 (+  5583us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":681877,"apply.run_cpu_time_us":19906,"apply.run_wall_time_us":486933,"num_ops":2,"prepare.queue_time_us":79843,"prepare.run_cpu_time_us":26840,"prepare.run_wall_time_us":447934,"raft.queue_time_us":557419,"raft.run_cpu_time_us":54623,"raft.run_wall_time_us":649946,"replication_time_us":1611774,"thread_start_us":1241061,"threads_started":5,"wal-append.queue_time_us":755147,"wal-append.run_cpu_time_us":17349,"wal-append.run_wall_time_us":1891905}]]}
I20260709 12:10:03.496469 10303 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.451866  8874 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:03.453095  9524 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:03.498100  9525 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.456485  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.450742  8827 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:03.457309 10207 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.459151  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.446169  8908 rpcz_store.cc:276] 0709 12:10:02.238676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.243357 (+  4681us) service_pool.cc:224] Handling call
0709 12:10:02.371719 (+128362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.417348 (+ 45629us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:03.271776 (+854428us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.363027 (+ 91251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.363089 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:03.363137 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.363237 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.363378 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2388,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":83950,"threads_started":1,"wal-append.queue_time_us":92313}
I20260709 12:10:03.500448  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.461504 10272 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.501318 10272 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:03.416514 10313 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:03.501780  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.500344  8724 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:03.504101  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52317.4us
I20260709 12:10:03.503388  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.460763  8907 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:03.468392  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.464958  8760 rpcz_store.cc:276] 0709 12:10:02.416265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.416439 (+   174us) service_pool.cc:224] Handling call
0709 12:10:03.331947 (+915508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.409555 (+ 77608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.417081 (+  7526us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002c29d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:03.417205 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104740096}
I20260709 12:10:03.507501  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.470124  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.474742  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.506651 10234 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.464664 10278 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.510206  8724 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.468164 10305 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.535141 10165 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:03.544602 10235 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.509320 10312 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.545437 10135 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.545872 10135 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:03.546798 10135 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.506556 10303 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.548401 10135 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.538861 10300 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.540820  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:03.541174 10143 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.561400 10294 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.562328  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.541360  8907 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.533432 10260 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.513161  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.564857 10290 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.554869  9525 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.555671  8724 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:03.518464  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48434.6us
I20260709 12:10:03.564970  8756 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.573670  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.574836  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.575930  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:03.576100  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.576894  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:03.577059  8755 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.581678  8908 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.581959 10286 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.562641 10305 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.583534  8908 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.576510  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:03.586349  8906 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.577412  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:03.587530  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.588200  8832 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.589600  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.590307  8904 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:03.590617  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:03.565652  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52610us
I20260709 12:10:03.496208 10289 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.592219 10289 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.593897  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.594249  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.594485  8831 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.505141 10308 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.509368 10207 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.594905 10305 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.595400 10207 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.595986 10207 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.596113  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.506917 10311 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.565055 10143 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:03.541572 10265 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.596407  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.609980  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.609988 10143 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.612514  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.613279  8902 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:03.614995 10272 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.616688  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.596819  8828 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.511445 10243 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.597056  8756 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.597813  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.598925  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:03.587476 10299 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.603518  8831 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:03.606071  8832 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:03.598601  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.639550  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.607985  9525 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:03.619314  8828 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:03.645944  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.647542  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.686970  8756 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:03.686427  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:03.648959  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 50449.9us
I20260709 12:10:03.655572  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.693167 10165 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.693676 10165 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.694061 10165 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.696430  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:03.690039  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.698594  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.699816  8907 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.636066 10299 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.706229 10299 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.634601 10243 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:03.711504  8834 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.713814  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:03.700944  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.687167  8828 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:03.702179  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46688.8us
I20260709 12:10:03.717522  9489 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.722374  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.685246 10303 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.728087  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.723064  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.648913 10290 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:10:03.702687 10143 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.733559 10143 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.734580  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.736073  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.737278  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:03.739900  8828 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.742838  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:03.743530  8905 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.743907  8905 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:03.701398  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.747551  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:03.752955  8909 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.753309  8909 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:10:03.754914  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.654245 10167 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.724848  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.748750  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.751068  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.718860 10302 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.769168  8872 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.724228 10314 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.734473 10269 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.653756 10311 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:10:03.747051 10301 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.725633 10260 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.760078 10167 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.794986 10307 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.795389 10216 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.796782 10167 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:03.773571  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 56188.6us
I20260709 12:10:03.725589 10243 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.750535 10236 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.750782 10142 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:03.785436  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.786614  8909 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.761843 10235 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.773936 10312 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.808784 10142 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.818408  8909 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.804095 10290 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:03.838848  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 90246.6us
I20260709 12:10:03.837416  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:03.822423 10142 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.768687 10287 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:03.872821  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.857810 10272 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:03.874821  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:03.858949 10265 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:03.878396  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.882229  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:03.882660 10253 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.863094 10307 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.917366  8909 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:03.917371  8828 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
W20260709 12:10:03.919586  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.931165 10143 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:03.885449 10234 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.934208 10234 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:03.934743 10234 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.876929 10310 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:03.941509  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 176626us
I20260709 12:10:03.944900  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:03.948513 10235 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.949175  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.949618 10235 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:03.950126 10287 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.950980 10235 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.954334 10305 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.954941 10305 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.959884 10278 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.973593  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:03.965807 10216 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:03.974604  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:03.976574  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 207495us
I20260709 12:10:03.981586  8872 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:03.981756  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 99724.6us
I20260709 12:10:03.978130  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.980422 10216 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:03.992147 10143 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.993119 10143 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:03.994180 10143 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:03.967793 10304 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.996253  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:03.997632  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:03.998755  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.000788  8756 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.001190  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.009279  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:04.010579  8725 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.011106 10243 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.011204 10265 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.013820  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.014477 10265 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.014778  8905 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.015516 10319 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.016330 10216 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:04.011844  8901 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.001260 10304 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.017628  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.018002  8904 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:04.018522 10304 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.019541 10265 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.994688 10305 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.019084  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:04.007583 10165 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.021011 10289 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.022467  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:04.022830 10165 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.023238  9489 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.023497  8908 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.023875 10265 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.024375 10305 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.019659 10304 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.024693 10265 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:04.026865  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:04.028080  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.033200  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:03.995716 10302 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:04.045194  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.050806  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:04.054543  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 329793us
I20260709 12:10:04.055464  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.035058 10321 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:04.056253 10165 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.057207  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:04.023123 10289 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:04.063539 10290 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.038877 10259 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.064935 10259 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:04.065341 10259 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.065442  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.063957 10207 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.069020  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.070151  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.073091  8833 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.085371 10287 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.087247 10287 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:04.088965  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:04.090093  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.064265 10142 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.034796 10299 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.047983 10278 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.095992  8909 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.096740  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.103048  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.066105 10243 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.074965 10165 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.094812 10260 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.094076 10287 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:04.117689  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47593.9us
I20260709 12:10:04.118381  8758 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:04.056414 10321 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.124445  8901 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.101046 10322 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:04.139631 10322 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.140091  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.142228 10322 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:04.143440 10299 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.076557 10324 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:04.144430  8757 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.144205 10324 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.147549  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.151731  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.148612  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:04.159874  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:04.108476 10302 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.168846  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:03.723312 10252 consensus_queue.cc:1175] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61fbd5afaa194845917d5b1b04571378" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:04.164285  8829 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:04.176169 10226 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:04.094450 10265 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.184818  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:04.185454  8907 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:04.195269  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 121310us
I20260709 12:10:04.196476  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.201208  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.134317 10321 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:04.207859  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:04.208912  9517 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:04.205681 10167 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.212621 10259 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.176779 10234 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.214036  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.214875 10157 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.215675  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.217552  9524 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.194974 10142 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:04.218356  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.219940 10157 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.221179  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.221885  8908 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.223804 10207 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:04.224371  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.188758 10324 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:04.172569  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.226980 10165 consensus_queue.cc:1059] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:04.227804 10165 consensus_queue.cc:1243] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:04.228340 10165 raft_consensus.cc:3055] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.228770 10165 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.229722 10165 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.230901 10165 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.216497 10234 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.232111 10303 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.232584 10303 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.233543 10303 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.235379  8753 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.236461  9487 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.236577  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.237298 10308 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.237366 10246 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.238674 10157 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.239982  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.240139  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.243194  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.246788  8832 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.249248 10303 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.253095  8832 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:04.265921  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 164640us
I20260709 12:10:04.269945 10335 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:04.290112  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 50042.6us
I20260709 12:10:04.291775  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.243647 10259 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.294121  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.297442  8909 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:04.295248  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.302662  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:04.306178  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.292600 10308 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.311010  8874 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.314502  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:04.277377 10278 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:04.306733 10326 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.320261  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.315888  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.323133  8760 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.323763  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.323884  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.324064  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.324430  8757 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.329049  8759 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.329663 10318 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.330070 10318 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:04.330156  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.309756 10142 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.331408  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.295782 10324 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:04.328014  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.325220  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.328548  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.330183  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:04.336452 10200 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:04.341670  8756 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.343667  8905 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.321044 10274 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:04.365362 10325 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.313s	user 0.013s	sys 0.002s
I20260709 12:10:04.331103 10318 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.365438 10330 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:04.368278 10330 raft_consensus.cc:3055] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.368673 10330 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:04.370326  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.371585 10246 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.373414 10246 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:04.377277 10246 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.382822 10276 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.383375 10276 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.383720 10157 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.383118 10133 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.385813 10253 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.386184 10318 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.386377 10236 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.386207 10253 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:04.375317  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.388447 10253 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.394795 10253 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.395747  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:04.390789  8905 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:04.395519  8908 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:04.405925 10330 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.407447 10330 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.409829  8906 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.393119 10133 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.386930 10236 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:04.384423 10276 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.401185  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.401635 10265 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.402532 10278 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.419478 10308 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:04.421877 10236 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.427567  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.438712 10308 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.439488 10276 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.430621  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:04.443540 10278 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.440260 10290 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.444803 10290 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.445740 10290 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.448033  8760 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.433056 10165 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.458850 10290 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.463220  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:04.459896 10236 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.469280  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.471803  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:04.479657  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.476748 10326 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.488734  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.473609 10246 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.497072 10246 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:04.500741 10332 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.502353 10308 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:04.482738 10278 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.506392  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:04.507107  8834 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:04.507848  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.493500 10135 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.489357 10165 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.511114  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:04.511914  9524 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:04.512135  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:04.513370  8902 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:04.520991  8833 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:04.525254  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.428787  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.534847 10286 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.536979 10135 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:04.551087 10165 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.551578 10165 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.553900 10165 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.555364 10165 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.555751  8654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 232) took 4864 ms. Trace:
I20260709 12:10:04.508883 10332 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.570875 10299 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.571426 10299 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:04.498085 10246 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.580782  8657 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.582896  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 141) took 4469 ms. Trace:
I20260709 12:10:04.587577  8658 rpcz_store.cc:276] 0709 12:10:00.150555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.165176 (+ 14621us) service_pool.cc:224] Handling call
0709 12:10:04.582812 (+4417636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154368,"reported_tablets":6}
I20260709 12:10:04.583937  8724 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:04.599347  8657 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 2 to 3, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.569730 10289 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:04.553912  8830 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:04.615875  8833 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.617586 10289 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.618049 10289 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:04.619230 10289 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.556201  8654 rpcz_store.cc:276] 0709 12:09:59.691390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.744543 (+ 53153us) service_pool.cc:224] Handling call
0709 12:10:04.555647 (+4811104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:03.847007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:03.915048 (+ 68041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:03.915101 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:10:03.915129 (+    28us) tablet.cc:662] Decoding operations
0709 12:10:03.915749 (+   620us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:03.915848 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:03.915908 (+    60us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:03.916267 (+   359us) tablet.cc:701] Row locks acquired
0709 12:10:03.916300 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:10:03.916471 (+   171us) write_op.cc:270] Start()
0709 12:10:03.916655 (+   184us) write_op.cc:276] Timestamp: P: 1783599003916414 usec, L: 0
0709 12:10:03.916688 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:03.917639 (+   951us) log.cc:844] Serialized 987 byte log entry
0709 12:10:04.167522 (+249883us) op_driver.cc:464] REPLICATION: finished
0709 12:10:04.332405 (+164883us) write_op.cc:301] APPLY: starting
0709 12:10:04.335026 (+  2621us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:04.350009 (+ 14983us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:04.353609 (+  3600us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:04.354027 (+   418us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:04.354190 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:04.354234 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:04.354437 (+   203us) log.cc:844] Serialized 29 byte log entry
0709 12:10:04.354599 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.354689 (+    90us) write_op.cc:454] Released schema lock
0709 12:10:04.354727 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:04.355801 (+  1074us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.355830 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57918,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":149155,"apply.run_cpu_time_us":2945,"apply.run_wall_time_us":29918,"num_ops":2,"prepare.queue_time_us":266902,"prepare.run_cpu_time_us":4453,"prepare.run_wall_time_us":104559,"replication_time_us":250660,"thread_start_us":271361,"threads_started":2}]]}
I20260709 12:10:04.624213  8833 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.620309  8751 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.629550 10207 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.572504 10299 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.620616 10289 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.614321 10319 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.652503  8758 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.663797  8756 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.672977 10167 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.710534 10236 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.711107 10236 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.713529 10236 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.717599  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.718288  8756 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:04.724268  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:04.721642  9487 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:04.683562 10307 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:10:04.745400  8828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:04.746225  8828 raft_consensus.cc:606] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.746673  8828 raft_consensus.cc:614] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:04.752128  8906 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.744702 10309 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.772166  9521 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.774513 10286 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.777303  8830 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.779755 10167 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:04.786906 10167 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.788923  8830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:04.793220  8830 raft_consensus.cc:606] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:04.762378 10309 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.798987  8906 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.800786 10167 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:04.803237  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:04.744148 10165 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:10:04.817493  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:04.836756  8758 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:04.837714  8906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:04.842779  8906 raft_consensus.cc:606] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:04.813167 10309 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.794636 10265 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:10:04.866541  8830 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.891752  9517 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.893926 10278 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.894495 10278 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:04.895689 10278 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.897678 10278 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.893879 10330 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:04.906708 10309 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:04.910565  9521 raft_consensus.cc:2368] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:04.910962 10299 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.902931 10319 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.923405  8875 leader_election.cc:400] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:04.923796  8875 leader_election.cc:403] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:04.924475 10314 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.933462  8906 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.933565  8829 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.935868 10246 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.952517  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:04.953388  8758 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.956357 10309 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:04.963367 10299 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.964215 10236 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.964720 10234 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:04.965330 10234 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:04.966737  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:04.967504  8760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efe90059a90047969b785a597928a512"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:04.969424  8760 raft_consensus.cc:606] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.951153  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:04.991504  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:04.994730  8900 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:04.976361 10265 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.983654  8901 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.991415 10259 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.992758 10234 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.014287  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:05.014297  8758 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:05.015763  9487 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:05.016309  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:05.017145  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.021981 10226 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.022578 10226 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:05.023456 10226 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.028116 10259 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.038776  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:05.039602  8834 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:05.053339  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:05.054131  8829 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.049373  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:05.055137 10234 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:05.055173  8901 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:05.005251 10308 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:05.062547 10308 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.063074 10308 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.012869 10265 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.073563 10265 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.006516 10319 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:05.099920  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.102169  8760 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.108927  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:05.109696  8751 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:05.115091 10288 raft_consensus.cc:993] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:05.115823 10302 raft_consensus.cc:1081] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
W20260709 12:10:05.119278  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 75868.3us
I20260709 12:10:05.043999 10259 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.125978  8751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:10:05.126727  8751 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.127111  8751 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.128847 10246 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.129302 10246 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.129643 10246 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.138762  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 96007.2us
I20260709 12:10:05.064256 10308 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.163682  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:05.165892 10308 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.154829 10309 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:05.174140  8909 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.178397 10319 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.178900 10319 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:05.179279 10319 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.135327 10314 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:05.142078  8751 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.250576  8751 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.265789 10327 raft_consensus.cc:993] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:05.266429 10327 raft_consensus.cc:1081] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:05.298027  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:05.299233  8833 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.214038 10309 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:05.319044  8751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43816
I20260709 12:10:05.319730  8751 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.320142  8751 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.325698 10335 raft_consensus.cc:993] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:05.326321 10335 raft_consensus.cc:1081] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:05.331367  8909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efe90059a90047969b785a597928a512"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38194
I20260709 12:10:05.361523  8909 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.362097  8909 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.378196 10265 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.387877  9517 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.342424  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:05.402714  8901 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.403049  8901 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:05.403863  8901 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.405957  8902 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:05.409623  8751 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.423151  8833 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.427959  8830 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:05.435068 10361 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:05.439625  8751 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:05.441569  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 226) took 3216 ms. Trace:
I20260709 12:10:05.441385  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:05.449450  9521 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.446821  8909 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.443326  8654 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.452292  8654 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.425021  8725 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.444707  8901 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.466189 10246 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.441999  8657 rpcz_store.cc:276] 0709 12:10:02.225653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.229773 (+  4120us) service_pool.cc:224] Handling call
0709 12:10:02.481583 (+251810us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:10:05.441491 (+2959908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:04.766763 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:04.779895 (+ 13132us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:04.790320 (+ 10425us) write_op.cc:435] Acquired schema lock
0709 12:10:04.793862 (+  3542us) tablet.cc:662] Decoding operations
0709 12:10:04.852902 (+ 59040us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:04.865006 (+ 12104us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:04.867671 (+  2665us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:04.878996 (+ 11325us) tablet.cc:701] Row locks acquired
0709 12:10:04.879640 (+   644us) write_op.cc:260] PREPARE: finished
0709 12:10:04.880819 (+  1179us) write_op.cc:270] Start()
0709 12:10:04.880985 (+   166us) write_op.cc:276] Timestamp: P: 1783599004880768 usec, L: 0
0709 12:10:04.881018 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:04.894501 (+ 13483us) log.cc:844] Serialized 1045 byte log entry
0709 12:10:05.126100 (+231599us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.227301 (+101201us) write_op.cc:301] APPLY: starting
0709 12:10:05.227415 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.227590 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.227786 (+   196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.228323 (+   537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.228554 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:05.228619 (+    65us) write_op.cc:312] APPLY: finished
0709 12:10:05.228904 (+   285us) log.cc:844] Serialized 29 byte log entry
0709 12:10:05.229147 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.229271 (+   124us) write_op.cc:454] Released schema lock
0709 12:10:05.229325 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:05.229808 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.229847 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12440,"reported_tablets":8,"spinlock_wait_cycles":495461632,"child_traces":[["op",{"apply.queue_time_us":100857,"apply.run_cpu_time_us":2490,"apply.run_wall_time_us":2490,"num_ops":2,"prepare.queue_time_us":134648,"prepare.run_cpu_time_us":4614,"prepare.run_wall_time_us":134028,"replication_time_us":244913,"thread_start_us":125570,"threads_started":2}]]}
I20260709 12:10:05.454694  8654 catalog_manager.cc:5697] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 2 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.474943  8760 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.476814 10236 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:05.517388 10330 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:05.518841  8644 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 16a04653cca743d0966d20df2225c35d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.518923  8833 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.524870  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:05.519527  8909 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:05.516302  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91359.5us
W20260709 12:10:05.523350  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 43777.4us
I20260709 12:10:05.521255  9521 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.531420  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:05.532128  8760 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.532433  8760 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.533222  8760 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.534132  8760 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.535563 10330 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.536834 10330 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.540297  8726 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:05.534132  8830 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.542474 10235 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.543016 10235 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.543960 10235 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.559456 10246 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.560736  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:05.561547  8751 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.540351  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:05.565699  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:05.566327  8828 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.569145  8909 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.553097  8901 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.565546  8834 raft_consensus.cc:3055] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.574084  8834 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:05.566165 10318 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.577013  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:05.539772 10319 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.578814  8900 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.580251 10318 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.580986 10234 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:05.594823  9524 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:05.603073  8900 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:05.575794  8834 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.606616  8828 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:05.609766  8900 raft_consensus.cc:2955] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.617551 10319 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.634563  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:05.634730  9489 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.635426  8909 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:05.635874 10236 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.608409 10327 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:05.636454 10236 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:05.639142 10236 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.645889  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:05.649907  8909 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.652834 10246 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:05.624471 10265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43806 (request call id 78) took 1041 ms. Trace:
I20260709 12:10:05.671700  8828 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.681309  8827 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.684273  8830 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:05.686932  8832 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.689661  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.687290 10302 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:05.718487  8760 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:05.698545 10167 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.721915 10167 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:05.722873 10167 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.732551 10302 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.733618  8834 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.674422 10265 rpcz_store.cc:276] 0709 12:10:04.583492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.595937 (+ 12445us) service_pool.cc:224] Handling call
0709 12:10:04.632239 (+ 36302us) log.cc:844] Serialized 501 byte log entry
0709 12:10:04.940758 (+308519us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b54002b6220. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380bc142 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634 0000000000388479 00007fce35056475
0709 12:10:05.624360 (+683602us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499,"raft.queue_time_us":13815,"raft.run_cpu_time_us":3557,"raft.run_wall_time_us":85989,"spinlock_wait_cycles":2371456,"thread_start_us":208724,"threads_started":1,"wal-append.queue_time_us":245959}
I20260709 12:10:05.741389  8902 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:05.742324  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.744694  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:05.743970 10332 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.749130  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:05.749734  8760 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:05.750988  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:05.750663 10307 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.755295 10330 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:05.758538 10324 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.765746 10302 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:05.768180 10324 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:05.768847 10324 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.774147 10307 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:05.774971 10318 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.775367 10307 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.786070  8834 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.753751 10278 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:10:05.797711  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:05.798434  8831 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.800791  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:05.801586  8834 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:05.779728  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:05.762789  8751 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:05.839560 10324 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.820838 10330 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.840857 10330 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.823259 10276 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:05.858475  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47369.5us
I20260709 12:10:05.859213  8725 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.878791  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:05.879508  8834 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.880860  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:05.893036  8903 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:05.857642 10165 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.855110 10327 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:05.918938  8654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 218) took 1156 ms. Trace:
I20260709 12:10:05.919575 10290 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.920037 10308 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:05.904973 10286 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.909245 10300 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.951964  8656 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.957809 10327 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:05.914078 10319 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.912822 10287 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:05.913776 10167 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.860539 10276 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.911476  8902 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:05.985221 10286 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.955041 10330 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:05.952531 10165 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.921239 10207 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:05.996820  8656 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:05.920760  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 118272us
I20260709 12:10:05.962338  8654 rpcz_store.cc:276] 0709 12:10:04.762894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.763058 (+   164us) service_pool.cc:224] Handling call
0709 12:10:05.918873 (+1155815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.591512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.592178 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.592212 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:05.592229 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:05.592932 (+   703us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.593039 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.593081 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:05.593518 (+   437us) tablet.cc:701] Row locks acquired
0709 12:10:05.593545 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:10:05.593732 (+   187us) write_op.cc:270] Start()
0709 12:10:05.593901 (+   169us) write_op.cc:276] Timestamp: P: 1783599005593673 usec, L: 0
0709 12:10:05.593931 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.594826 (+   895us) log.cc:844] Serialized 1312 byte log entry
0709 12:10:05.721051 (+126225us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b54002fc720. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce380ba6b8 00007fce380ba2fa 00007fce3813e965 00007fce3813ee09 00007fce3bb79581 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901
0709 12:10:05.725265 (+  4214us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.730641 (+  5376us) write_op.cc:301] APPLY: starting
0709 12:10:05.730742 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.730920 (+   178us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.730941 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.731456 (+   515us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.731691 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:05.731740 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:05.731963 (+   223us) log.cc:844] Serialized 35 byte log entry
0709 12:10:05.732131 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.732238 (+   107us) write_op.cc:454] Released schema lock
0709 12:10:05.732280 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:05.732718 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.732743 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184742,"reported_tablets":10,"spinlock_wait_cycles":11136,"child_traces":[["op",{"apply.queue_time_us":810,"apply.run_cpu_time_us":2001,"apply.run_wall_time_us":2003,"num_ops":3,"prepare.queue_time_us":76562,"prepare.run_cpu_time_us":7552,"prepare.run_wall_time_us":129822,"replication_time_us":131182,"spinlock_wait_cycles":17111424,"thread_start_us":50487,"threads_started":1}]]}
I20260709 12:10:06.038928  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:05.995353 10300 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.995968 10278 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:06.029346 10319 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.064119 10330 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.039002 10287 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.073402 10330 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:05.969659 10290 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.075223 10330 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:06.076296 10376 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:10:06.076694 10278 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:06.078926 10278 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:06.085005  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:06.085788  9521 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:06.087431  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:06.055377 10302 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:06.061225 10318 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.000264 10308 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.030444 10335 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.071466 10300 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.072235 10319 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.076431 10290 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.075223 10287 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.050738 10167 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.069154 10207 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.165879  8756 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:06.169521  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 49498.2us
I20260709 12:10:06.157655 10370 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:06.172783  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 117960us
I20260709 12:10:06.121132 10318 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.174916 10290 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.176499 10370 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:06.177042 10370 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.176708 10290 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.122397 10302 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.184777  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.185506  8756 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:06.185865 10286 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.186252  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:06.187005  8904 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
W20260709 12:10:06.189477 10377 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:06.190240 10308 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.193336 10207 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.177794 10226 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:06.195755  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.197242  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.198289  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:06.198424 10302 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.198853  8900 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:06.199656 10324 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.193367 10276 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.199831 10370 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:06.164036 10335 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:06.203572 10335 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:06.203961 10370 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:06.208525  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:06.209172 10290 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.210417  8751 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:06.214854  8756 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:06.215723  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:06.226794 10335 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.230201 10335 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.231401 10276 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:06.231678 10298 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:06.232643  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:06.233812  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.234624  8753 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:06.238971 10165 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.238396  9517 raft_consensus.cc:2955] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:06.241417 10167 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.242008 10335 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.243288 10318 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.231870 10276 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.258764 10276 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.276814 10287 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.277593 10287 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:06.298202 10382 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.337s	user 0.004s	sys 0.000s
I20260709 12:10:06.332136 10287 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.334858  9524 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:06.335078  9521 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:06.335791  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.335888  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.337683  8751 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:06.338153  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:06.339607 10393 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.340247  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.340330 10393 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:06.341589 10393 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:06.342618  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.344156 10319 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.345036  8753 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:06.345487  8752 raft_consensus.cc:2368] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:06.346202  8751 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:06.351504 10327 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:06.348869 10319 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.354354  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.355103  8754 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:06.358150  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:06.359026  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 233) took 1334 ms. Trace:
I20260709 12:10:06.361519  8658 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.362646  8872 leader_election.cc:400] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:06.362964  8872 leader_election.cc:403] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.363552 10314 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.363672  8658 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.359457  8656 rpcz_store.cc:276] 0709 12:10:05.025105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.025268 (+   163us) service_pool.cc:224] Handling call
0709 12:10:06.358964 (+1333696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:06.081336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:06.081854 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:06.081891 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:06.081908 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:06.082298 (+   390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:06.082348 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:06.082372 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:06.082685 (+   313us) tablet.cc:701] Row locks acquired
0709 12:10:06.082703 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:06.082856 (+   153us) write_op.cc:270] Start()
0709 12:10:06.082983 (+   127us) write_op.cc:276] Timestamp: P: 1783599006082797 usec, L: 0
0709 12:10:06.083006 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:06.158330 (+ 75324us) log.cc:844] Serialized 929 byte log entry
0709 12:10:06.233436 (+ 75106us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.329075 (+ 95639us) write_op.cc:301] APPLY: starting
0709 12:10:06.329161 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.329289 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.329401 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.329803 (+   402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.329975 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:06.330018 (+    43us) write_op.cc:312] APPLY: finished
0709 12:10:06.330217 (+   199us) log.cc:844] Serialized 29 byte log entry
0709 12:10:06.345608 (+ 15391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.345706 (+    98us) write_op.cc:454] Released schema lock
0709 12:10:06.345745 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":50,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":95397,"num_ops":2,"prepare.queue_time_us":8277,"prepare.run_cpu_time_us":3374,"prepare.run_wall_time_us":84435,"replication_time_us":150306,"thread_start_us":109935,"threads_started":1}]]}
I20260709 12:10:06.371220  8834 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:06.375051 10226 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:06.382607  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.383302  8829 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:06.385967 10276 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.388267 10276 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.390244  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.391094  8829 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:06.392510  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.393203  8829 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:06.394735  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.395490  8829 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:06.396610  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:06.396898  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:06.397418  8834 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:06.396948 10265 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.398355 10265 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.398706  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.399313  8834 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:06.400207  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:06.401049 10287 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.401449 10287 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.401795 10287 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.400421 10265 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.403219  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.403988  8834 raft_consensus.cc:2368] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3.
I20260709 12:10:06.339926 10300 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.405273  8758 raft_consensus.cc:2368] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:06.410228 10314 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:06.410773 10330 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.411023  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.411295 10330 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:06.415067  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 216852us
I20260709 12:10:06.416105  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 142) took 1562 ms. Trace:
I20260709 12:10:06.420835  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:06.428470  8909 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:06.429750  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:06.431102  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:06.431761  8906 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:06.431838  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.433965  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.434821  8834 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:06.436257  8872 leader_election.cc:400] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:06.436722  8872 leader_election.cc:403] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.437088  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:06.394819  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 362302us
W20260709 12:10:06.447649  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 77392.7us
I20260709 12:10:06.447793  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.449990  8903 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.447682  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:06.451763  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:06.452497  8757 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.448529  8834 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:06.449201  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:06.464519  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:06.464882  8834 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:06.465281  8907 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:06.426973 10330 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.467648  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:06.468317  8757 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:06.458395  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec2ab93c6c3448edaa2bb2569cfd970b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:06.458441  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:06.584800  8758 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:06.447203 10302 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.458917 10385 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.454453 10276 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:06.585207  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 137592us
I20260709 12:10:06.793112  8798 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:06.585319  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 149262us
W20260709 12:10:06.605506  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 142677us
I20260709 12:10:06.748685 10393 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.685782 10272 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.748685  8834 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.427744  8658 rpcz_store.cc:276] 0709 12:10:04.853799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.854123 (+   324us) service_pool.cc:224] Handling call
0709 12:10:06.416035 (+1561912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:06.366888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:06.367386 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:06.367415 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:10:06.367442 (+    27us) tablet.cc:662] Decoding operations
0709 12:10:06.367797 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:06.367852 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:06.367880 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:06.368199 (+   319us) tablet.cc:701] Row locks acquired
0709 12:10:06.368223 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:10:06.368360 (+   137us) write_op.cc:270] Start()
0709 12:10:06.368490 (+   130us) write_op.cc:276] Timestamp: P: 1783599006368316 usec, L: 0
0709 12:10:06.368509 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:06.377799 (+  9290us) log.cc:844] Serialized 919 byte log entry
0709 12:10:06.382017 (+  4218us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813ee28 00007fce3bb79581 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901 00007fce3bb7cb2d 0000000000388634 0000000000388479
0709 12:10:06.382517 (+   500us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.384152 (+  1635us) write_op.cc:301] APPLY: starting
0709 12:10:06.384228 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.384335 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.384355 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.384679 (+   324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.384834 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:06.384875 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:06.385074 (+   199us) log.cc:844] Serialized 29 byte log entry
0709 12:10:06.385766 (+   692us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.385859 (+    93us) write_op.cc:454] Released schema lock
0709 12:10:06.385911 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.387619 (+  1708us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.387651 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":1403,"apply.run_cpu_time_us":1529,"apply.run_wall_time_us":3433,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":5103,"prepare.run_wall_time_us":15276,"replication_time_us":13865,"spinlock_wait_cycles":8928640}]]}
I20260709 12:10:06.753450  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:06.759847 10370 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.463943 10322 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:06.458827 10314 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:06.447422 10399 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:10:06.471465 10319 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.783542  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:06.849982  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 66889us
I20260709 12:10:06.765282 10288 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.838141  8834 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.787551 10385 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.787038 10302 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.801725 10393 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:06.816027 10327 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:06.801020  8644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 342639us
I20260709 12:10:06.834146  8829 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.809016 10276 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.825242 10272 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.844286 10314 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.890533 10265 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:06.925086 10265 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:06.926388 10272 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.900089 10393 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.838584 10370 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.931377 10370 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.895722 10302 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.896694  8752 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:06.931942 10287 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:10:06.905122  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:06.899106  8644 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 16a04653cca743d0966d20df2225c35d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:06.872874 10385 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.969899  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.916970 10276 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:06.918111  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:06.863500 10319 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.864074 10308 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.945003  8834 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:06.947178  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:06.991335  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44264.1us
I20260709 12:10:06.993317  8874 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:06.949735  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.995981  8833 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:06.954175  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.957824  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.997255  8828 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:06.958184  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:06.998373  8831 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:06.945731 10314 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:06.961338  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:06.932504 10287 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:06.928304 10265 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:06.988011  8903 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:06.997255  8835 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:06.959236  8827 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:06.991788 10308 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:06.976732  8644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 77675.7us
I20260709 12:10:07.002220 10289 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.022750  8909 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:07.014917 10314 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:07.024322 10330 consensus_meta.cc:287] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 12:10:07.020394 10308 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.030733 10289 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:07.039780 10314 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:07.041705  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 189684us
I20260709 12:10:07.013414  8754 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:07.143275  8906 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.062327 10289 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.085063  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.089304  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.148670  8827 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:07.084152  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.095348  8725 leader_election.cc:400] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3.
I20260709 12:10:07.149992  8835 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.150112  8725 leader_election.cc:403] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.046088 10330 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.076274 10314 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.118523  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 306623us
I20260709 12:10:07.154520  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.119637  8902 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:07.159767  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:07.160941  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68653.9us
I20260709 12:10:07.165935  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:07.173177  8760 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:07.155292 10319 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.164239 10370 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.168653 10395 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3.
I20260709 12:10:07.189739  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.161465 10265 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:07.180279 10287 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:07.213832 10319 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.215801 10319 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.216189 10319 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:07.221144  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 221037us
I20260709 12:10:07.192829 10393 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.237653 10393 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.201833 10411 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.214493 10405 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:07.246745 10300 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.228752 10370 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:07.276396 10370 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.250905 10405 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.297673 10405 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
W20260709 12:10:07.329527  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 123759us
W20260709 12:10:07.333478  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 178758us
I20260709 12:10:07.335561  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:07.354892  8658 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 3, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.378669  8835 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:07.373761 10427 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:07.381975 10427 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.385080 10427 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:07.385799  8829 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:07.396062 10427 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.368153  8658 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:07.430169 10383 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:07.431289 10383 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.434487 10300 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.435032 10322 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.435329 10300 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:07.436553 10391 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:07.443464  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.407646 10276 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.445482 10383 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:07.295082 10330 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:07.453584  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 118308us
I20260709 12:10:07.462824 10265 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.462232  8658 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 1 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:07.463681 10265 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.464321 10265 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.471174  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 54398.1us
I20260709 12:10:07.470582  9524 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.470659 10276 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.474646  8658 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.482879 10276 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:07.497341  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 49637.1us
I20260709 12:10:07.498273 10405 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:07.506031  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:07.439229 10300 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.518020 10428 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:07.519032 10428 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.532763 10319 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:07.540781 10385 consensus_meta.cc:287] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.009s
I20260709 12:10:07.541666 10385 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.544581 10385 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:07.548108 10383 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.548988  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.549612 10289 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.526943 10428 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.556777  8725 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:07.562057 10428 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.562722 10428 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.563170 10428 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.564888 10426 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 12:10:07.566777  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 283166us
I20260709 12:10:07.567991 10289 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:07.564967  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:07.570277  9521 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:07.571136  8907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:07.579882  8907 raft_consensus.cc:606] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:07.580747  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.581723  8906 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:07.582672 10383 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:07.583515 10383 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.583806  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.583874  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.585291  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.586257 10383 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.586719  8902 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:07.587795  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.591447  8902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:07.588542  8906 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:07.608423  8725 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.600564  8902 raft_consensus.cc:606] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:07.622977  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:07.624171 10314 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.624907 10319 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:07.622076 10288 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.009s
I20260709 12:10:07.626226 10288 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:07.625962 10265 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.626638 10314 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:07.583082  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.627981  8908 raft_consensus.cc:2368] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:07.629009 10399 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.629544 10399 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.629886 10399 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.630221 10308 consensus_meta.cc:287] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.583s	user 0.014s	sys 0.003s
I20260709 12:10:07.630707 10308 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.633215  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.633554  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.633823 10425 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.612422  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:07.635399  8907 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:07.640149 10426 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.641037  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.641189 10426 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:07.641937  8831 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.633291  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.645629  8903 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:07.650175  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 55366.1us
I20260709 12:10:07.652241 10235 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:07.652877  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:07.654249 10405 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.654645 10265 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.658458  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:07.665028  8799 leader_election.cc:400] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:07.665735 10216 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:07.666500  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:07.667362 10383 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.668821  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.669574 10383 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.669991 10383 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.670365 10383 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.670488 10399 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.671028 10423 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:07.674410  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.675146  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.676535 10370 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.676994 10370 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.677464  8829 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:07.677785  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.678702  8906 raft_consensus.cc:2368] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:07.677879  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.681176  8902 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:07.683483  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:07.684401  8757 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:07.666518 10216 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.671895 10423 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.677380 10370 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.691465  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.692390  8833 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.685572  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.695784  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.696717  8901 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:07.683537  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.699416  8908 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:07.701028  8799 leader_election.cc:400] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:07.702457  8799 leader_election.cc:403] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.704550  8833 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:07.710246  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:07.715939  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 93180.8us
I20260709 12:10:07.642772 10426 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.724774  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.724908 10413 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:07.725965  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.726660  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:07.738664  8831 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:07.739614 10276 raft_consensus.cc:2764] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:07.742235 10405 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:07.743324 10405 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.701550 10423 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:07.740509  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.751199  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.753017  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:07.739907  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.761227  8905 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:07.744771 10235 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:07.754407 10308 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.775132 10413 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.775789 10413 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.776223 10413 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.776911 10385 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.777406 10385 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.777779 10385 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.778273 10314 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.787333  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.788321  8907 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.789934  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.791857  8905 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:07.794780  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.756156 10428 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.799764  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.808307  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:07.809223 10235 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.809320  8760 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:07.819718  8903 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:07.841933  8757 raft_consensus.cc:2368] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:07.812727 10394 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.848935  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.850128  8831 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:07.852065 10405 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:07.812583 10235 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:07.869488  8900 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:07.817543 10216 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:07.886855  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 100043us
I20260709 12:10:07.892074  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:07.942621  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:07.948603  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:07.950309  8833 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
W20260709 12:10:07.949291  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 56341.5us
I20260709 12:10:07.858227 10385 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.857050 10370 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:07.939119 10419 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:07.968492  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.969065  8751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:07.969771  8751 raft_consensus.cc:606] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:07.969647 10265 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.971769 10272 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:07.972529 10272 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.974455 10393 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:07.974867 10272 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:07.975137 10393 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.975929  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.976981  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:07.985239  8902 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.987200  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:07.988289  8833 raft_consensus.cc:2368] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:07.969552  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.010488  8903 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:08.001250  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:08.019584  8828 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:07.955348 10405 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:07.940599 10394 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.037107 10405 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.038868 10394 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.039096 10422 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.039667 10405 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.027545  8760 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:08.030550  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:08.034736 10436 log.cc:927] Time spent T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:10:08.039569 10394 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.023063  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.045059  8907 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.016860 10419 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:07.958122 10383 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:08.065876  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 78227.3us
I20260709 12:10:08.069890  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.072782  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.039847 10422 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.097338  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.102481  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.117821  8754 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:08.118592  8830 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:08.120432  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:08.121668 10439 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:10:08.122650 10443 log.cc:927] Time spent T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:08.123297 10370 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.087972 10394 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.129045 10383 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.130930 10394 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.099798 10428 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.133074 10453 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.117529  8751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:08.145911 10455 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.148233  8752 raft_consensus.cc:2368] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:08.151912  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.156658  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.156965 10393 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.160125  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:08.166306  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 99607.5us
I20260709 12:10:08.169608  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:08.170630  8906 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.156971 10385 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:08.160765  8751 raft_consensus.cc:606] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.172436 10327 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.174160 10327 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:08.159855  8644 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 16a04653cca743d0966d20df2225c35d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:08.173501  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:08.178369  8900 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.181757  8751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:08.182381  8751 raft_consensus.cc:606] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.182829  8905 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:08.184099  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:08.176563 10327 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.186744  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:08.187952  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.188825  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.189664  8752 raft_consensus.cc:2368] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3.
I20260709 12:10:08.190476  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.191598  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.192109  8752 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.193037 10413 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.194070 10419 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.157534 10455 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.196882  8751 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.198984 10455 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.199354  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.200834  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.200973 10422 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.202126  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.212143  8900 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.219591  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.236223  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.237633  8751 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:08.242019  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.245296  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.247948  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.249979  8874 leader_election.cc:400] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:08.257573  8874 leader_election.cc:403] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.260042  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.261049  8798 leader_election.cc:400] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3.
I20260709 12:10:08.261359  8798 leader_election.cc:403] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.262110  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.262231 10314 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.263051 10235 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.263223  8872 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.263530 10235 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.264817 10423 raft_consensus.cc:993] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:08.249385  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.265365 10423 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.265465  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.265805 10422 raft_consensus.cc:1081] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:08.266716 10456 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.266397 10458 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.267315 10456 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.268739  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.269474  8756 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:08.273152 10235 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.275293 10235 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.276580 10458 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3.
I20260709 12:10:08.248397 10383 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.251470 10324 raft_consensus.cc:993] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:08.277468 10442 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:08.263615  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.289158  8872 leader_election.cc:400] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:08.291440  8872 leader_election.cc:400] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:08.291659  8872 leader_election.cc:403] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.295053  8759 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:08.299981  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.286545 10413 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.293120  8751 raft_consensus.cc:2368] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:08.288398 10289 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:08.308013 10454 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.306618  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.308216  8900 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:08.298550 10455 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.323498  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.324560  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.325042  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:08.308852 10391 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.305534 10457 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.321987  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.326217  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:08.297832 10383 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.315140 10460 raft_consensus.cc:1081] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:08.319000 10314 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.329906 10466 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.320693 10454 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.354743 10383 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.330392  8759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:10:08.355698  8759 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.356119  8759 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.356403 10454 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.320652 10427 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.361146 10427 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.362228 10427 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.336400  8906 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:08.340579 10455 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.367833 10455 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.318729  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:08.321702 10324 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:08.368743  8829 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:08.369299  8905 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:08.313633 10265 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:08.369689  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.370716  8834 raft_consensus.cc:2368] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:08.372115  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.380919 10391 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.344759  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.381438 10391 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.346817  8724 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.382507 10399 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:08.382452 10391 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.347307 10456 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.344357  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:08.386094  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68398.5us
I20260709 12:10:08.378394 10265 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:08.386225 10246 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.388726  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.390285 10319 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.344873  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.393038  8760 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:08.391968  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:08.340337  8752 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:08.402861  8759 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.413628  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.425625  8755 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:08.426530  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.414466  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.414564  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.415431 10426 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.416213 10319 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.418177 10456 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.431795 10276 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.432446 10276 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.422101  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.434736 10276 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.422593  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.422786  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.429138  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.437866  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.439333  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.440847 10455 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.441632 10455 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.442274  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.443816 10276 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.443863  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.430667  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:08.448477 10426 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.450240  8827 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.431094  8758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:10:08.432415 10456 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.420604  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:08.462541 10456 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.463176  8759 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.453220  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.469661  8827 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.458063 10455 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.458540  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:08.458218 10426 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.464766  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.452145  8758 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.475406  8758 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.466208  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.466537  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:08.472792  8874 leader_election.cc:400] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:08.476768  8874 leader_election.cc:403] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.476878  8831 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:08.456530  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.479664  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.475939  9487 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:08.482563  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62033.5us
I20260709 12:10:08.486681  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.487365  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.488148  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.489272 10428 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.489856 10428 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.489946  9516 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:08.490969 10428 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.493167 10330 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.493587  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.494300  8834 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:08.495327 10272 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.496263 10444 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.496717 10276 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.500480 10314 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:08.500583 10276 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.501982  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:08.502224  8829 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:08.503093 10276 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.509034 10444 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.509493 10444 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:08.509859 10444 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.509963  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:08.511065  8905 raft_consensus.cc:3055] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.511442  8905 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:08.497160 10324 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.514577 10308 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.515007 10308 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.515831 10308 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.497107  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.512490  8905 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.518198 10455 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:08.521692 10324 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.522150 10454 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.522846 10454 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.523391 10454 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.525789 10466 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.521241 10455 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.526474 10466 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.533499  8905 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.536934  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.538285 10276 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.538836 10276 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.539686 10466 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.540282 10466 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.540759 10466 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.551146  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:08.553624  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 71125.9us
I20260709 12:10:08.558135 10466 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.560477 10454 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:08.562628  8905 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.563683 10308 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.563526  8758 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.564582  8759 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.565796  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:08.575438  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.577196  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:08.578528  8758 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.578485  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.594141  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:08.594842  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.595041  8905 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.595479  8905 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:08.595355  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.590816 10319 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.599982 10319 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.600914 10319 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.605923  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.598373  8827 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.611244  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.614358 10276 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.615425  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.615602 10265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43806 (request call id 79) took 2161 ms. Trace:
I20260709 12:10:08.634155 10265 rpcz_store.cc:276] 0709 12:10:06.454555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.456506 (+  1951us) service_pool.cc:224] Handling call
0709 12:10:06.895807 (+439301us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b540027bb20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380b8a1d 00007fce3809f1a4 00007fce38121447 00007fce3813e70a 00007fce3813f76a 00007fce3813e91b 00007fce3814a03c 00007fce381496b3 00007fce381419fa 00007fce3d1094c9
0709 12:10:06.943973 (+ 48166us) log.cc:844] Serialized 501 byte log entry
0709 12:10:07.284143 (+340170us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b540027bb20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380c3b26 00007fce380bd49a 00007fce380bc714 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634
0709 12:10:07.429318 (+145175us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b540027bb20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380bc142 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634 0000000000388479 00007fce35056475
0709 12:10:08.615478 (+1186160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25048,"raft.queue_time_us":5730,"raft.run_cpu_time_us":8122,"raft.run_wall_time_us":386512,"spinlock_wait_cycles":32614144,"thread_start_us":210541,"threads_started":1,"wal-append.queue_time_us":312441,"wal-append.run_cpu_time_us":2445,"wal-append.run_wall_time_us":1013238}
I20260709 12:10:08.643553  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:08.643635  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 47400.5us
I20260709 12:10:08.657274  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.665109  8905 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.667884  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.668555  8826 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.671415 10455 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.678917  8905 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.680393  8798 leader_election.cc:400] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:08.681694  8826 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:08.681891  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.683019  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.660599 10314 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.691039  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.683646 10454 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.702978  8905 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:08.704659  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.689067 10276 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.685880 10457 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.707870  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:08.711046  8642 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f78b2d2f5154e388ca8e35799e1afeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:08.697590 10216 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.711994  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.714284  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:08.716056  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.718453  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.719916  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.716410 10458 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.726527 10444 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.721378 10452 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.727849 10452 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.730392  9516 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.716219 10413 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.713541 10453 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.722205 10442 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.723641 10454 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.729518 10276 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.730270 10452 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.748215  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:08.772326  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 275956us
I20260709 12:10:08.774088  8656 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:08.775236 10330 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:08.777787 10272 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.778235 10272 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.778529  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:08.779167 10272 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:08.776139  8656 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.784435 10272 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.794562  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 143) took 1860 ms. Trace:
I20260709 12:10:08.815086  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:08.822790  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.835762  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a4cb41ea20c4484bfefd8f68fcdc475 with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52170
I20260709 12:10:08.821306 10319 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.838505 10330 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.839947  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.841312 10481 raft_consensus.cc:993] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.841936 10481 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.842409 10428 raft_consensus.cc:1081] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.843324 10428 raft_consensus.cc:993] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.843732 10428 raft_consensus.cc:1081] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.845467  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.831058 10429 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.856560  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:08.836337  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet ec2ab93c6c3448edaa2bb2569cfd970b with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43806
I20260709 12:10:08.850718 10319 raft_consensus.cc:993] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.863757  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.851465 10481 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:08.795861  8658 rpcz_store.cc:276] 0709 12:10:06.933934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.934121 (+   187us) service_pool.cc:224] Handling call
0709 12:10:08.794470 (+1860349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:07.614536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:07.656246 (+ 41710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:07.656302 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:07.656336 (+    34us) tablet.cc:662] Decoding operations
0709 12:10:07.657199 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:07.657342 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:07.657383 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:07.658073 (+   690us) tablet.cc:701] Row locks acquired
0709 12:10:07.658202 (+   129us) write_op.cc:260] PREPARE: finished
0709 12:10:07.658393 (+   191us) write_op.cc:270] Start()
0709 12:10:07.658551 (+   158us) write_op.cc:276] Timestamp: P: 1783599007658329 usec, L: 0
0709 12:10:07.658595 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:10:07.789568 (+130973us) log.cc:844] Serialized 1749 byte log entry
0709 12:10:08.202098 (+412530us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813ee28 00007fce3bb79581 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901 00007fce3bb7cb2d 0000000000388634 0000000000388479
0709 12:10:08.336764 (+134666us) op_driver.cc:464] REPLICATION: finished
0709 12:10:08.561401 (+224637us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3814032a 00007fce380c5f14 00007fce380c5ec3 00007fce380c5e38 00007fce380c5df3 00007fce380c50dc 00007fce380eee16 00007fce380d6cbb 00007fce380c139d 00007fce380c4d75
0709 12:10:08.588132 (+ 26731us) write_op.cc:301] APPLY: starting
0709 12:10:08.593731 (+  5599us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:08.660924 (+ 67193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:08.678789 (+ 17865us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:08.724932 (+ 46143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:08.725232 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:08.725308 (+    76us) write_op.cc:312] APPLY: finished
0709 12:10:08.725658 (+   350us) log.cc:844] Serialized 41 byte log entry
0709 12:10:08.725885 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.726007 (+   122us) write_op.cc:454] Released schema lock
0709 12:10:08.726072 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:08.726494 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.726521 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":182950,"apply.run_cpu_time_us":3778,"apply.run_wall_time_us":159900,"num_ops":4,"prepare.queue_time_us":74185,"prepare.run_cpu_time_us":16495,"prepare.run_wall_time_us":587854,"raft.queue_time_us":113251,"raft.run_cpu_time_us":18340,"raft.run_wall_time_us":244347,"replication_time_us":668448,"spinlock_wait_cycles":74946176,"thread_start_us":370017,"threads_started":4,"wal-append.queue_time_us":403032}]]}
I20260709 12:10:08.877488 10481 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.879980 10300 raft_consensus.cc:1081] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:08.880805  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.857197 10429 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:08.861143 10442 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.858143  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:08.887974  8900 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:08.902581  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.903369  8834 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.899101 10444 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:08.907781  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:08.910295  8833 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:08.923883  8830 raft_consensus.cc:2955] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:08.892575 10429 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.928514  8828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52178
I20260709 12:10:08.931093  8828 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.931468  8828 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.948467  8832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52178
W20260709 12:10:08.949988 10482 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:10:08.954808 10483 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:08.939953 10442 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.957609 10442 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:08.959815 10442 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:08.965502  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:08.966192  8900 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:08.967597  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:08.931442 10452 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:08.982982 10442 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.012738 10442 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.013181 10442 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.008493  8834 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:09.023029  8828 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.037246  8905 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.039197  8902 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.047706 10272 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.054387 10488 tablet_replica.cc:333] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:10:09.056384 10458 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:09.061591  8828 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.066143  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:09.066833  8902 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.071535  8826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52178
I20260709 12:10:09.072124  8826 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.072489  8826 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.076584  8832 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.077109  8832 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.078975  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.083132  8759 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.083878  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.085590  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:09.086184  8755 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.088966  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:09.094244  8908 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:09.096879  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.086486  8755 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:09.102588  8755 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.103725  8755 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.057078 10458 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.105260 10429 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.106478  8758 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.108850  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:09.110613  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.100309  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 228) took 1777 ms. Trace:
I20260709 12:10:09.113818  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:09.064414 10235 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:09.130203  8801 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:09.128616  8826 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.130051  8832 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.107360 10458 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:09.108016 10457 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.122689 10456 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.118580 10454 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.114351  8656 rpcz_store.cc:276] 0709 12:10:07.323690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.325368 (+  1678us) service_pool.cc:224] Handling call
0709 12:10:09.100241 (+1774873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:08.987158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:08.991752 (+  4594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:08.991786 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:08.991803 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:08.992231 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:08.992310 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:08.992337 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:08.994657 (+  2320us) tablet.cc:701] Row locks acquired
0709 12:10:08.994682 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:10:08.994824 (+   142us) write_op.cc:270] Start()
0709 12:10:08.994943 (+   119us) write_op.cc:276] Timestamp: P: 1783599008994785 usec, L: 0
0709 12:10:08.994965 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.047503 (+ 52538us) log.cc:844] Serialized 924 byte log entry
0709 12:10:09.055202 (+  7699us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.066644 (+ 11442us) write_op.cc:301] APPLY: starting
0709 12:10:09.066737 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.066880 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.066968 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.067406 (+   438us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.067577 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:09.067642 (+    65us) write_op.cc:312] APPLY: finished
0709 12:10:09.067934 (+   292us) log.cc:844] Serialized 29 byte log entry
0709 12:10:09.068125 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.068223 (+    98us) write_op.cc:454] Released schema lock
0709 12:10:09.068264 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.068667 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.068694 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":43392,"child_traces":[["op",{"apply.queue_time_us":5884,"apply.run_cpu_time_us":1964,"apply.run_wall_time_us":1964,"num_ops":2,"prepare.queue_time_us":162096,"prepare.run_cpu_time_us":3592,"prepare.run_wall_time_us":60708,"replication_time_us":60049,"spinlock_wait_cycles":37248,"thread_start_us":62041,"threads_started":1}]]}
I20260709 12:10:09.165524  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:09.119200 10265 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:09.183598  8829 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.184196  8828 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.184868  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:09.186388  8827 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.139281 10276 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.201782  8755 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:09.216899  8657 catalog_manager.cc:5697] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.218858  8657 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.222904 10272 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.224449  8657 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.225822 10235 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:09.148686 10383 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:10:09.188076 10442 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.246547  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:09.247928  8906 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:09.246651  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 110063us
I20260709 12:10:09.267235  8906 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:09.268886  8831 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.275609  8826 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.254436 10454 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:09.380595  8902 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:09.379570  8908 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.391682  8832 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:09.394110 10488 raft_consensus.cc:2243] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:10:09.386063  8754 consensus_meta.cc:287] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 12:10:09.399953  8754 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
W20260709 12:10:09.401424 10494 log.cc:927] Time spent T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:10:09.401846  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 142904us
I20260709 12:10:09.324301 10454 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.409194 10488 raft_consensus.cc:2272] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:09.432578  8908 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.435005  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:09.435762  9524 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.450393  8905 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:09.451617  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 45909.5us
I20260709 12:10:09.453576  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:09.455775 10429 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.457707 10442 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.460863 10235 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:09.470292 10487 tablet_replica.cc:333] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:10:09.474987  9487 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:09.477669  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:09.479183 10442 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.479671 10442 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.479202  8835 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.482271 10309 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.482774 10309 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:09.483419 10454 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.485015 10497 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.484661 10488 ts_tablet_manager.cc:1916] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:09.485740 10497 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:09.486743 10497 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.487663  8832 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.483762 10309 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.496034  8835 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.497896  9524 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:09.484781 10458 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.499590  8801 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:09.508369 10496 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.508944  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:09.508692  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:09.509846  8903 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:09.515800  8833 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.514101 10454 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.528034 10454 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:09.524590 10373 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:10:09.530889 10373 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.531260 10373 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:09.533908 10454 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.549952 10442 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:09.532214 10373 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.557798 10373 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.566108 10319 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.575400  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:09.584465  8658 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 3 to 4, VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) evicted. New cstate: current_term: 1 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:09.586416  9524 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.589047  8654 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:09.591706  8901 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.593633 10426 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.594885 10426 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.595233 10426 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:09.512442 10458 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:09.599509 10458 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.604058  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:09.604930  8755 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.605257  8755 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:09.610458  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:09.612179  8755 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.613551  8755 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.633172  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:09.633533  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:09.638291  8755 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:09.630949  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:09.634071  8760 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:09.650854  8831 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.667919  8892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f78b2d2f5154e388ca8e35799e1afeb with delete_type TABLET_DATA_TOMBSTONED (TS 61fbd5afaa194845917d5b1b04571378 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38178
I20260709 12:10:09.670228  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 234) took 2540 ms. Trace:
I20260709 12:10:09.622413 10426 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.677588 10426 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.670719  8657 rpcz_store.cc:276] 0709 12:10:07.129595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.129778 (+   183us) service_pool.cc:224] Handling call
0709 12:10:09.670131 (+2540353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.281072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.421126 (+140054us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.421170 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:09.421190 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:09.421783 (+   593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.421846 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.421879 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:09.422261 (+   382us) tablet.cc:701] Row locks acquired
0709 12:10:09.422279 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:09.422440 (+   161us) write_op.cc:270] Start()
0709 12:10:09.422560 (+   120us) write_op.cc:276] Timestamp: P: 1783599009422397 usec, L: 0
0709 12:10:09.422584 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.423261 (+   677us) log.cc:844] Serialized 1312 byte log entry
0709 12:10:09.438622 (+ 15361us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.439144 (+   522us) write_op.cc:301] APPLY: starting
0709 12:10:09.439243 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.439400 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.439506 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.440047 (+   541us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.440275 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:09.442686 (+  2411us) write_op.cc:312] APPLY: finished
0709 12:10:09.445214 (+  2528us) log.cc:844] Serialized 35 byte log entry
0709 12:10:09.447450 (+  2236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.447576 (+   126us) write_op.cc:454] Released schema lock
0709 12:10:09.447637 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.448023 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.448052 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24351,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":298,"apply.run_cpu_time_us":2327,"apply.run_wall_time_us":8832,"num_ops":3,"prepare.queue_time_us":9740,"prepare.run_cpu_time_us":3339,"prepare.run_wall_time_us":149513,"replication_time_us":15865}]]}
I20260709 12:10:09.686137  8658 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:09.690934 10425 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.692168 10425 raft_consensus.cc:3055] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:09.693019  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.694685 10330 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:09.692541 10425 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:09.698434 10425 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.699991 10425 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.705724 10481 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:09.707018 10491 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:09.707487 10429 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.698802  8901 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.710078 10300 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:09.721378  8831 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.722838  8834 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.733141  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.735005  8900 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:09.734311  8656 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:09.742312  8654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 219) took 2098 ms. Trace:
I20260709 12:10:09.741557  8656 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 3, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:09.739151 10272 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:10:09.754340  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.755589  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:09.748389  8656 catalog_manager.cc:5697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.773070 10383 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.782943 10383 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:09.746502  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:09.783373 10383 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.745074  8654 rpcz_store.cc:276] 0709 12:10:07.644182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.644621 (+   439us) service_pool.cc:224] Handling call
0709 12:10:08.147186 (+502565us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:10:09.742239 (+1595053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.662852 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.663428 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.663472 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:09.663489 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:09.663851 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.663909 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.663941 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:09.664130 (+   189us) tablet.cc:701] Row locks acquired
0709 12:10:09.664143 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:10:09.664294 (+   151us) write_op.cc:270] Start()
0709 12:10:09.664400 (+   106us) write_op.cc:276] Timestamp: P: 1783599009664253 usec, L: 0
0709 12:10:09.664416 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.665063 (+   647us) log.cc:844] Serialized 541 byte log entry
0709 12:10:09.677893 (+ 12830us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.678423 (+   530us) write_op.cc:301] APPLY: starting
0709 12:10:09.678514 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.682811 (+  4297us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.698494 (+ 15683us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.698774 (+   280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.698946 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:09.698993 (+    47us) write_op.cc:312] APPLY: finished
0709 12:10:09.699201 (+   208us) log.cc:844] Serialized 23 byte log entry
0709 12:10:09.699380 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.699461 (+    81us) write_op.cc:454] Released schema lock
0709 12:10:09.699505 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.699885 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.699910 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43685,"reported_tablets":12,"spinlock_wait_cycles":89588096,"child_traces":[["op",{"apply.queue_time_us":287,"apply.run_cpu_time_us":1884,"apply.run_wall_time_us":21415,"num_ops":1,"prepare.queue_time_us":1636,"prepare.run_cpu_time_us":2512,"prepare.run_wall_time_us":2512,"replication_time_us":13300}]]}
I20260709 12:10:09.816548  8724 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:09.768802 10455 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.767753 10487 raft_consensus.cc:2243] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:10:09.842480 10510 log.cc:927] Time spent T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.152s	user 0.004s	sys 0.000s
I20260709 12:10:09.844727 10491 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.845266 10491 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:09.846228 10491 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:09.764334 10265 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:10:09.899466 10497 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.903481 10487 raft_consensus.cc:2272] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:09.915896 10216 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:09.936365 10216 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:09.941061 10487 ts_tablet_manager.cc:1916] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:09.915228 10515 tablet_replica.cc:333] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:10:09.977218 10515 raft_consensus.cc:2243] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:09.978513 10515 raft_consensus.cc:2272] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:09.942838 10488 ts_tablet_manager.cc:1929] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:09.982281 10488 log.cc:1199] T ec2ab93c6c3448edaa2bb2569cfd970b P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/ec2ab93c6c3448edaa2bb2569cfd970b
I20260709 12:10:09.997726 10488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43806 (request call id 80) took 1195 ms. Trace:
I20260709 12:10:09.998395 10488 rpcz_store.cc:276] 0709 12:10:08.824984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.835968 (+ 10984us) service_pool.cc:224] Handling call
0709 12:10:09.053803 (+217835us) ts_tablet_manager.cc:1151] Deleting tablet ec2ab93c6c3448edaa2bb2569cfd970b
0709 12:10:09.053913 (+   110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:09.700764 (+646851us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:09.940455 (+239691us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:09.997606 (+ 57151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269217,"tablet-delete.queue_time_us":190600,"thread_start_us":61443,"threads_started":1}
W20260709 12:10:10.026072  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 43616.8us
I20260709 12:10:10.070443  8833 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.090173  8751 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.078832 10324 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:10.105957  8753 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:10.106212 10324 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.120551  8902 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.132179  8833 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.133198 10442 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:10.108587 10324 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:10.136355  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 102131us
I20260709 12:10:10.140820 10456 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.100520 10383 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.143702  9516 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.144887  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:10.145581  8751 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:10.146021 10383 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:10.153798  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:10.157274  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:10.158231  8900 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:10.158492  8760 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.161311  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:10.161962 10385 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.162410 10385 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:10.163076 10385 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.166225 10442 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.166953 10442 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:10.169095  8905 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.169512 10442 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:10.171195 10455 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.173039 10457 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:10.173703  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:10.181010  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:10.183938  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:10.184674  8752 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:10.186849  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:10.187467  8755 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.185791 10309 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:10.173221 10455 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.196934 10380 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:10.210932 10487 ts_tablet_manager.cc:1929] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:10.211521 10487 log.cc:1199] T 0a4cb41ea20c4484bfefd8f68fcdc475 P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/0a4cb41ea20c4484bfefd8f68fcdc475
I20260709 12:10:10.213774  8751 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:10.218613 10455 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:10.219297  8830 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:10.193857 10383 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.223529  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:10.221484 10495 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.234319 10383 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.238197 10383 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.230990 10442 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:10:10.269131 10517 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.316s	user 0.001s	sys 0.003s
W20260709 12:10:10.301792  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 111257us
I20260709 12:10:10.236392 10487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52170 (request call id 82) took 1437 ms. Trace:
I20260709 12:10:10.308143  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:10.309345 10497 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.268296 10383 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:10.298147 10385 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.305379 10487 rpcz_store.cc:276] 0709 12:10:08.797054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.832524 (+ 35470us) service_pool.cc:224] Handling call
0709 12:10:09.102488 (+269964us) ts_tablet_manager.cc:1151] Deleting tablet 0a4cb41ea20c4484bfefd8f68fcdc475
0709 12:10:09.102576 (+    88us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:09.470158 (+367582us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b54000d8ed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3814bff9 00007fce3d159482 00007fce3d18a2d0 00007fce3d17083d 00007fce3d1707e9 00007fce3d170779 00007fce3d170741 00007fce3d16f96d 0000000000388634 0000000000388479
0709 12:10:10.085588 (+615430us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:10.210765 (+125177us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:10.233112 (+ 22347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268667,"spinlock_wait_cycles":10863488,"tablet-delete.queue_time_us":243710,"thread_start_us":105124,"threads_started":1}
I20260709 12:10:10.316582 10497 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:10.341943  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:10.343145  8757 raft_consensus.cc:2410] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:10.348016  8831 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:10.355293 10385 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:10.356918  8905 raft_consensus.cc:2410] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:10.363441  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:10.365622 10497 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.367367  8759 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.367551 10383 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:10.369835  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:10.370220  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:10.400336  8758 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:10.403949  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:10.409493  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 110982us
I20260709 12:10:10.418895 10503 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.454870  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:10.455724  8758 raft_consensus.cc:1813] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Handling vote request from an unknown peer 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:10.456312  8758 raft_consensus.cc:2393] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:10.465726 10516 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.509s	user 0.001s	sys 0.003s
I20260709 12:10:10.438290 10503 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:10.513204 10503 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:10.594369  8904 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.594760 10216 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:10.605166  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:10.608418  8875 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:10.609362  8875 raft_consensus.cc:2686] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:10.637522 10515 ts_tablet_manager.cc:1916] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:10.639849 10528 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:12.054970  9524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.652s	user 0.017s	sys 0.026s
W20260709 12:10:12.055480  9524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.652s	user 0.017s	sys 0.026s
I20260709 12:10:12.073873 10553 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.074457 10553 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.076448 10553 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.076889 10553 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.077431 10553 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.079012 10553 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.079466 10553 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.079864 10553 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.081411 10553 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.081804 10553 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.082159 10553 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.083578 10553 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.083978 10553 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.084549 10553 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.087150 10553 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.087798 10553 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.088322 10553 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.090787 10553 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.091694 10553 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.092160 10553 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.094933 10553 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.098114 10554 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.098886 10554 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.099658 10496 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.100277 10496 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.101379 10554 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.103120 10496 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.104221 10553 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.104751 10553 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:12.105216  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 1.51677e+06us
I20260709 12:10:12.106729 10553 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.107196 10553 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.107771 10553 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.110484 10553 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:12.117090  8798 connection.cc:256] RPC call timeout handler was delayed by -1.2246266480001395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 12:10:12.144276 10324 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.145202 10324 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.147704 10324 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.149657 10324 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.150240 10324 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.152112 10561 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.152585 10324 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.153285 10324 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.152683 10561 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.155157 10559 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.154770 10324 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.161365 10324 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.162161 10324 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.156437 10559 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.165536 10559 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:12.165725  8908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.723s	user 0.040s	sys 0.047s
I20260709 12:10:12.166599 10559 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.162689 10324 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:12.169608  8908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.727s	user 0.041s	sys 0.048s
I20260709 12:10:12.163030 10561 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.173933 10561 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.175931 10563 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.176252 10561 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.186007  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1353) took 1744 ms. Trace:
I20260709 12:10:12.186679  8908 rpcz_store.cc:276] 0709 12:10:10.441217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.442044 (+   827us) service_pool.cc:224] Handling call
0709 12:10:10.442444 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.442676 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:12.173136 (+1730460us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.185381 (+ 12245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.185466 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:12.185543 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.185661 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.185873 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100128,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":1738308,"threads_started":2}
I20260709 12:10:12.177119 10563 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.192701 10563 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.194449 10564 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.171067 10559 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.207784 10324 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.196468 10563 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.211752 10563 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.206151 10564 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.215885 10561 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.217691 10561 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.218334 10561 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.218891 10276 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.219800 10276 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.221395 10566 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.222261 10566 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.227272 10457 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.227954 10457 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.225993 10566 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.233487 10566 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.234035 10566 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.235041 10572 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.237396 10559 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.237811 10564 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.238013 10559 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.238456 10564 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.239759 10564 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.240200 10570 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.241127 10571 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.232985 10276 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.241847 10563 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.241923 10566 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.238593 10559 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.245711 10457 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.246989 10457 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.247392 10457 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.244508 10276 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.249009 10276 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.249634 10457 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.233146 10561 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.244299 10571 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.236802 10572 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.256335 10559 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.258116 10572 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.249655 10570 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.264176 10570 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.265729 10571 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.267063 10564 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.268422 10459 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.269210 10459 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.272545 10459 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:12.275936  8798 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.591s (SENT) [suppressed 3 similar messages]
I20260709 12:10:12.283147 10459 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.283875 10459 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.287982 10459 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.288034 10573 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.339370 10573 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:12.337204  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61296.9us
W20260709 12:10:12.292649  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3ec0 after lost signal to thread 7581
W20260709 12:10:12.342876  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800034860 after lost signal to thread 8692
I20260709 12:10:12.345500 10573 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.345986 10459 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.352401 10459 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.354912 10459 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.355582 10459 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.348362 10574 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.359074 10574 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.359464 10572 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.356223 10573 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.362526 10572 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.363065  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 145) took 2689 ms. Trace:
I20260709 12:10:12.362907 10573 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.362468 10574 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.364811 10573 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.365891 10574 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.363442  8658 rpcz_store.cc:276] 0709 12:10:09.673524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.674599 (+  1075us) service_pool.cc:224] Handling call
0709 12:10:12.362993 (+2688394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.753499 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.774670 (+ 21171us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.774704 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:09.774721 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:09.775073 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.775123 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.775160 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:09.775341 (+   181us) tablet.cc:701] Row locks acquired
0709 12:10:09.775357 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:09.775493 (+   136us) write_op.cc:270] Start()
0709 12:10:09.775614 (+   121us) write_op.cc:276] Timestamp: P: 1783599009775460 usec, L: 0
0709 12:10:09.775638 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.776300 (+   662us) log.cc:844] Serialized 536 byte log entry
0709 12:10:09.876678 (+100378us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.901098 (+ 24420us) write_op.cc:301] APPLY: starting
0709 12:10:09.901220 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.901367 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.901487 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.901774 (+   287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.901953 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:09.902004 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:09.902240 (+   236us) log.cc:844] Serialized 23 byte log entry
0709 12:10:09.902427 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.902545 (+   118us) write_op.cc:454] Released schema lock
0709 12:10:09.902596 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.903022 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.903056 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":13643,"apply.run_cpu_time_us":1912,"apply.run_wall_time_us":1912,"num_ops":1,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":2636,"prepare.run_wall_time_us":32954,"replication_time_us":75970,"spinlock_wait_cycles":119680}]]}
I20260709 12:10:12.368696 10574 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.357301 10459 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.369678 10572 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.366590 10573 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.370385 10572 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.374954 10572 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.376575  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.376938  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.370842 10574 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.379926  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.380030 10574 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.371414 10459 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.380542  8905 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.378651  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.381150 10459 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.381516  8907 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:12.378839  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.382030 10459 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.372699 10573 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.380657 10572 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.385636 10572 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.386183 10573 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.386826 10573 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.387481 10459 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.386202 10572 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.380610 10574 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.391188 10572 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.391853 10574 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.387352 10573 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.395416  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.396374  8900 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:12.397934  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.398109  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.398519 10573 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:12.398665  8907 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.398810  8905 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:12.399395  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.401160  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.401456  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.402123  8905 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:12.403379  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.404019  8905 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:12.405589  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.406227  8905 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:12.407169  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.409793  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.410426  8900 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.411816  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.414510  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:12.415565  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.416178  8905 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.417711 10497 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.419163 10497 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:12.420476  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.421567  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.421897  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.422638  8905 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:12.422978  8900 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.425060  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.426842  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.427485  8902 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:12.431546  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.434459  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.435701  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.437175  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.438030 10561 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.438438 10561 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.438817 10561 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.444988 10559 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.445715 10559 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.446244 10559 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.448886 10571 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.449510 10571 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.450022 10571 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.450228  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.450666 10564 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.451256 10564 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.451452 10569 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.451776 10564 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.452108 10569 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.453359  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.454227 10566 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.454610 10566 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.454938 10566 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.452823 10569 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.457250  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.466344  8799 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.469358  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.470340 10457 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.470839 10457 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.471248 10457 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.471304  8799 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:12.473990  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62052.1us
I20260709 12:10:12.475777 10563 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.475399  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.467592 10497 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.448947 10561 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.476296 10563 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.478377 10563 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.481591 10276 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.483615 10276 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.484252 10276 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.484853 10276 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.477478  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.490828 10457 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:12.494313 10309 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.960s	user 0.053s	sys 0.083s
W20260709 12:10:12.495747 10309 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.961s	user 0.055s	sys 0.084s
I20260709 12:10:12.495872  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.497567 10555 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.498112 10555 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.498530 10555 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.498684 10495 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.501147  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.477102 10497 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.499221 10495 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.509579 10495 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.506254 10497 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.508934  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.515784  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 357) took 2116 ms. Trace:
I20260709 12:10:12.516902  9524 rpcz_store.cc:276] 0709 12:10:10.398987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.399152 (+   165us) service_pool.cc:224] Handling call
0709 12:10:10.399453 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.399643 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:12.055851 (+1656208us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.515317 (+459466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.515383 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.515438 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.515524 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.515683 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457677,"prepare.queue_time_us":972135,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":458598,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":1654099,"threads_started":2,"wal-append.queue_time_us":1771}
I20260709 12:10:12.521967  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:12.522567  8907 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.523963 10410 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.525054 10544 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.524689 10410 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.504359 10564 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.525698 10544 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.539723  8907 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:12.541754 10444 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.543470 10444 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.546101 10444 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:10.092603  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:12.526046 10457 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:10.596380  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet ec2ab93c6c3448edaa2bb2569cfd970b (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:10:12.566262  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.571542  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 229) took 3042 ms. Trace:
W20260709 12:10:12.572359  8642 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 1.97582e+06us
I20260709 12:10:10.348897  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet 0a4cb41ea20c4484bfefd8f68fcdc475 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
W20260709 12:10:12.575323  8644 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 2.22625e+06us
I20260709 12:10:12.569983 10276 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.576507 10410 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.573902  8656 rpcz_store.cc:276] 0709 12:10:09.529074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.529242 (+   168us) service_pool.cc:224] Handling call
0709 12:10:09.567118 (+ 37876us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:10:12.571435 (+3004317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.843021 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.843628 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.843659 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:10:09.843675 (+    16us) tablet.cc:662] Decoding operations
0709 12:10:09.844207 (+   532us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.844258 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.844287 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:09.844665 (+   378us) tablet.cc:701] Row locks acquired
0709 12:10:09.844678 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:10:09.844813 (+   135us) write_op.cc:270] Start()
0709 12:10:09.844929 (+   116us) write_op.cc:276] Timestamp: P: 1783599009844769 usec, L: 0
0709 12:10:09.844946 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.988827 (+143881us) log.cc:844] Serialized 1317 byte log entry
0709 12:10:10.242843 (+254016us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.246984 (+  4141us) write_op.cc:301] APPLY: starting
0709 12:10:10.247080 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.247235 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.247334 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.247787 (+   453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.247957 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:10.248001 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:10.248240 (+   239us) log.cc:844] Serialized 35 byte log entry
0709 12:10:10.248416 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.248518 (+   102us) write_op.cc:454] Released schema lock
0709 12:10:10.248561 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.264022 (+ 15461us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813ee28 00007fce3bb79581 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901 00007fce3bb7cb2d 0000000000388634 0000000000388479
0709 12:10:10.264277 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.264310 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2169460,"reported_tablets":10,"spinlock_wait_cycles":6888832,"child_traces":[["op",{"apply.queue_time_us":3866,"apply.run_cpu_time_us":1919,"apply.run_wall_time_us":1919,"num_ops":3,"prepare.queue_time_us":2286,"prepare.run_cpu_time_us":7822,"prepare.run_wall_time_us":421231,"replication_time_us":397730,"spinlock_wait_cycles":140365056}]]}
I20260709 12:10:12.579682 10410 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.579631 10561 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.580883  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:12.597158  8907 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.581646  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:12.581530 10566 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.582154 10276 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.582829 10564 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.583036 10571 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.586270  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.587170 10544 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.620591  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.620906  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.584381  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:12.622071  8902 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.622327  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.589874 10410 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:12.592972 10456 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.603268  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.625296  8832 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:12.605587  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.614573  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.616714  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.626631  8827 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.626910  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1485) took 2011 ms. Trace:
I20260709 12:10:12.605237  8904 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.617450 10419 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.589457 10309 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.627310  8830 rpcz_store.cc:276] 0709 12:10:12.601201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.612986 (+ 11785us) service_pool.cc:224] Handling call
0709 12:10:12.626851 (+ 13865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:12.600513 10580 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.621322  8833 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:12.634459 10499 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.630224 10309 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:12.625319  8901 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.135s	user 0.016s	sys 0.020s
I20260709 12:10:12.583086 10569 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.628559  8907 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:12.631577 10456 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:12.636050 10419 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.637233 10544 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.647755  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.657267  9524 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.650720  8902 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.635018 10499 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:12.641183  8901 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.152s	user 0.016s	sys 0.020s
I20260709 12:10:12.600153 10495 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.667615  8835 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.641891 10410 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.677294  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.680066 10579 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.681416 10495 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.684223  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:12.686035  8902 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.681106 10579 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.689687  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.682734 10309 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.688091 10410 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.668797 10544 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.708606  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.731822  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.735186  8904 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:12.636919 10580 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.738312 10580 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.739038  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:12.743005  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.744127  8833 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.718772 10309 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.746038 10583 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.746167 10586 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:12.746506 10309 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.746738 10583 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.749907 10590 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.714412 10571 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.757318  8902 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:12.742054 10495 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:12.747231 10586 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:12.763732  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.783007  8833 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.785024  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.751579 10566 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.787629  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.729858 10456 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.784088 10495 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:12.763945 10563 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.785665 10582 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.794000  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.794780 10373 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.796396  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.796684 10585 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:12.797266 10581 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.797600 10309 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.800817  8830 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:12.809863  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.799496 10515 ts_tablet_manager.cc:1929] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:12.806845 10373 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.792865 10569 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.816491  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1355) took 2351 ms. Trace:
I20260709 12:10:12.817119 10579 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.819417  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.822430  8834 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.753594 10555 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.831650  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.832466  8827 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.833345 10571 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.815821 10515 log.cc:1199] T 4f78b2d2f5154e388ca8e35799e1afeb P 61fbd5afaa194845917d5b1b04571378: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/wals/4f78b2d2f5154e388ca8e35799e1afeb
I20260709 12:10:12.835309 10383 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.837121  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.808943 10559 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.841835  8832 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.842864 10383 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.844013 10216 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.846040 10216 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.846482 10216 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.847882  8827 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.847977  8830 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.817003  8901 rpcz_store.cc:276] 0709 12:10:10.461552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.461779 (+   227us) service_pool.cc:224] Handling call
0709 12:10:10.462126 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.462374 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:12.674090 (+2211716us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.787460 (+113370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.790439 (+  2979us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:12.791287 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.795255 (+  3968us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.812661 (+ 17406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15297,"prepare.queue_time_us":80662,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":244,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1614,"thread_start_us":2274272,"threads_started":2,"wal-append.queue_time_us":126967}
I20260709 12:10:12.820546 10581 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.851945 10499 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.852238 10495 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.852952  8828 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:12.828254 10584 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.853149 10544 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.854171  8831 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:12.778587 10590 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.850013  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.844273 10583 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.856603  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.860704  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.847235 10383 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:12.836318 10586 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:12.863452 10399 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.865715 10399 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:12.821368 10582 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.864557  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.849412 10587 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:12.869599  8828 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:12.872901  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.873602  8828 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:12.874733  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:12.827585 10585 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.856670 10591 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:12.877856  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 129917us
I20260709 12:10:12.841274 10571 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.874912  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:12.889343 10385 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.871999 10399 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.905572  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:12.889751 10385 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:12.912552 10385 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.914484  8827 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:12.865676 10584 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.985778  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:12.986843  9524 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
W20260709 12:10:12.995205  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.877980 10515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38178 (request call id 74) took 3200 ms. Trace:
I20260709 12:10:13.002537  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.003571  9524 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:12.869751 10497 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.014670  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.018085  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.019384  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:13.013142  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 107110us
I20260709 12:10:13.020184  9524 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:13.027807  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.029356  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.031647  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.032701  9524 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:13.028582  8828 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.037685  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.041038  8833 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:13.014199 10582 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:12.904361 10591 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:12.881855 10587 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.054768 10584 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.056160 10373 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.041432  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.057044  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.057282 10555 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.044102  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.062381  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.062789 10591 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.077258  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.063227  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.078389  8907 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.066915  8900 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:13.068740  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.079934  8905 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.070853  8902 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.070823  9524 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:13.072070 10265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.473s	user 0.016s	sys 0.044s
I20260709 12:10:13.046804 10563 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.093483  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.094175  8908 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.094735  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.096104 10563 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.096732 10591 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.097319 10591 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.097476 10563 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.100138  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.100898  8901 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.100250 10563 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.105461 10590 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.106875 10581 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.074162  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.112763  8903 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:13.113597  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.075094  9516 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:13.075191 10571 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.083643 10587 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.084088 10399 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.072880 10585 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
W20260709 12:10:13.087719 10265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.488s	user 0.016s	sys 0.045s
I20260709 12:10:13.088217 10497 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.089718  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.137145  8828 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:13.137893  8902 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:13.138660  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.112171  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.115480  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.139310  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.139739  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.118393  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.069509  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.141199  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.141834  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.118022  8801 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.141294 10587 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.142526 10587 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.142696  8902 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:13.143042 10587 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.143051  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:13.143615  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.143967  8900 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.144763  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.125325  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.141440  8904 raft_consensus.cc:2393] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 2: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:13.148528  8902 raft_consensus.cc:2410] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:13.148535  8905 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:13.150279  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.139915  8903 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.151809  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.153929  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:12.997538 10515 rpcz_store.cc:276] 0709 12:10:09.666626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.667537 (+   911us) service_pool.cc:224] Handling call
0709 12:10:09.826884 (+159347us) ts_tablet_manager.cc:1151] Deleting tablet 4f78b2d2f5154e388ca8e35799e1afeb
0709 12:10:09.851756 (+ 24872us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:12.595323 (+2743567us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:12.799347 (+204024us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:12.863016 (+ 63669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21160,"tablet-delete.queue_time_us":123996,"thread_start_us":53590,"threads_started":1}
I20260709 12:10:13.155965  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.156749  8903 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.157513 10399 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.120705 10581 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.159528  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.161839  9488 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:13.165532  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.160440 10588 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:13.167037  8643 catalog_manager.cc:5028] TS 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): tablet 4f78b2d2f5154e388ca8e35799e1afeb (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:10:13.122081 10583 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.182365 10583 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.182849 10583 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.155978 10582 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.185032 10582 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.185511 10582 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.167927 10385 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.170495 10593 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.170739 10579 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.187412  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47787.8us
W20260709 12:10:13.187790  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 73093.3us
I20260709 12:10:13.188752  8801 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.120498 10555 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:13.176097  8900 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:13.098237 10591 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.180178  8908 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:13.189937  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.207448  8830 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.211669  8799 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.186301  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.169581  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.190196 10383 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.214893 10456 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.215010 10590 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.185422  8907 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:13.212293  8801 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:13.217304  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47770.9us
I20260709 12:10:13.220067 10593 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.220345  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.222286  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:13.218302  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.189765 10579 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.191284 10497 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.190721 10571 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.190959 10385 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.219715 10495 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.215493 10456 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.180125  8901 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:13.230028  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.225942  8799 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.215751 10383 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.237299  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.216614 10590 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.226608 10588 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.239348 10588 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.239828 10588 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.232298 10456 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.227016 10593 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.227869 10579 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.228797 10497 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.229194 10571 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.248101  8829 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:13.241613  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:13.227330  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.250572 10309 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.238364  8828 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.244081 10554 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.245702 10558 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.232805 10495 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.254985 10563 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.244870 10593 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.265419 10593 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.256662 10495 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.256983  8801 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.259930  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.249579 10571 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.248057 10497 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.263460 10410 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:13.263242 10590 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.264333 10558 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.272192 10597 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.262158 10554 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.286687 10554 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.285030 10597 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.288928 10558 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.299616 10272 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.308533  8828 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:13.312119  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.300871 10272 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.300199 10536 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.291353 10597 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.320920 10505 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.307778 10300 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.329250 10300 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.330319 10272 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.314721 10330 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.331470 10300 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.331745 10330 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.333554  8908 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:13.301479 10556 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.334497 10330 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.321818 10423 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.317834 10491 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.285331 10383 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.324599 10425 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.332398 10505 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.350956 10587 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.352367 10505 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.353200 10587 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.345486 10272 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.334257 10556 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.365928  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.328117 10536 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.332417 10593 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.348394 10391 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:13.356786 10425 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.392035 10425 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.393517 10583 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.395926 10583 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.384089 10497 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.369200 10272 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.401784 10272 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.402323 10272 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.402837 10272 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.403434 10599 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.389739 10556 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.406159 10272 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.412223 10536 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:13.413443  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 56572.7us
I20260709 12:10:13.413578  8831 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:13.420264  8900 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.421309  8902 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.420524  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.355046 10491 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.435374  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:13.436501  9525 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 2: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:13.439911  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.441094  8753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:13.448235  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.448691  8908 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.450028  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.450701  8900 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:13.450798  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.436760 10497 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.397403 10579 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.453922 10536 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:13.454627 10426 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:13.456171 10425 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:13.456991  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:13.458112 10423 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:13.417366 10385 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.453291 10216 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.004s
I20260709 12:10:13.461918  8753 raft_consensus.cc:606] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.466676 10495 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.404237 10599 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.483752 10538 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.467895 10385 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.482121 10582 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:13.478541 10598 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:10:13.504837 10429 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.510625  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.519758  8826 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.467733 10216 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.534211  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:13.543891  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.554237  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.469350 10602 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.529292 10300 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.530277 10423 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.562269  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.572034  8900 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:13.568506 10609 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.569011 10536 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:13.587915 10607 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:13.588477  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.520853 10571 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:13.591961  8906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.194s	user 0.022s	sys 0.066s
I20260709 12:10:13.592129  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.558219 10452 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.603442  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.582122 10605 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.585690  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.562464 10491 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.557596 10495 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.600994  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.602919  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.558166 10235 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.603925  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.529099 10429 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.621575 10429 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.623416 10216 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.625339  8833 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.627350  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.604193  8755 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.595984  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:13.605005 10595 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 12:10:13.606784  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.607064  9524 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.608091  9519 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.608400  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.635224  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.608898  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.609021  8756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:13.609396  8907 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.609562 10391 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.603806 10452 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.610805 10481 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.611814  8900 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.571064 10300 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:13.617316  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.617439  8754 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:13.515884 10538 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.611275 10265 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.637022  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.735702  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.637393  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.723600  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1498) took 1091 ms. Trace:
I20260709 12:10:13.592993 10602 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.586493 10536 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.623886 10588 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.610380  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.763429  8908 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.671214  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.629184  9525 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:13.741271  8756 raft_consensus.cc:606] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
W20260709 12:10:13.659361  8906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.261s	user 0.022s	sys 0.067s
I20260709 12:10:13.730125 10419 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.742494  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.630920 10495 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.743942  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:13.638245 10455 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:10:13.744956 10265 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.745513 10538 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.728768  9520 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.728461 10426 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:13.746078  8827 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:13.737877  8835 rpcz_store.cc:276] 0709 12:10:12.621938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.622084 (+   146us) service_pool.cc:224] Handling call
0709 12:10:13.712894 (+1090810us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b5400051754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:13.713133 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101820672}
I20260709 12:10:13.742957  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.637953 10561 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.677364 10601 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.838582  8752 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.630321 10235 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.815152  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.816274 10495 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.818575 10606 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:13.850121 10588 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:13.818408  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44778.3us
W20260709 12:10:13.755515  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800391640 after lost signal to thread 8784
I20260709 12:10:13.850338 10606 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:13.851998  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08002df100 after lost signal to thread 8859
I20260709 12:10:13.852459 10602 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:13.853400  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08003560c0 after lost signal to thread 8933
W20260709 12:10:13.854871  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800209080 after lost signal to thread 9549
I20260709 12:10:13.649856 10582 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.855027 10606 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.785308  9518 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:13.690900 10579 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.828240  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:13.862756  8835 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.759400 10571 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.760281 10385 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.748301 10456 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.871729  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.813750  8909 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:13.845289 10580 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.845475  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:13.846179 10561 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:13.763165 10391 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.612538 10609 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.846802 10536 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.849303 10495 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.691732 10587 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:13.822988  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.858294  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:13.748898 10452 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.845213 10599 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.931552 10456 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.931815  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1508) took 1144 ms. Trace:
I20260709 12:10:13.890473  8827 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:13.932312  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:13.933001  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:13.933168  9523 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 2: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:13.933223  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.933601  9517 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.934015  8827 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:13.931746  9525 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.934998  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:13.842998 10601 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:13.940827  8835 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:13.889322  8751 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:13.905321  8726 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:13.958323  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 53061us
I20260709 12:10:13.908986  8829 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.714174 10605 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.906893 10425 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.914956  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.916160 10235 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.916522 10606 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:13.918149 10265 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:13.919337  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6560 after lost signal to thread 10494
W20260709 12:10:13.920084 10617 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:10:13.922667  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.967023  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.913295  8756 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
I20260709 12:10:13.924693 10593 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.925602  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.926642 10538 raft_consensus.cc:3055] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.848836 10300 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.936874 10601 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.944368 10609 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:13.946069 10561 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.890950 10556 consensus_queue.cc:1059] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:13.893301 10580 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:13.913626 10597 consensus_meta.cc:287] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.004s
I20260709 12:10:13.948827 10391 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:13.903247 10608 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.950344  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.932343  8834 rpcz_store.cc:276] 0709 12:10:12.787162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.787340 (+   178us) service_pool.cc:224] Handling call
0709 12:10:13.931621 (+1144281us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54003bbd54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:13.931753 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77676800}
I20260709 12:10:13.753790 10481 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:13.902750 10576 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:13.956993  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.904457  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1351) took 3558 ms. Trace:
I20260709 12:10:13.961596 10425 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:13.970611  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.974787  8755 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:13.975937  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:13.966161 10599 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.978240  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.978271  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.994645  9521 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:13.983103  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:13.967487 10606 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.973641 10538 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.001279  9522 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.987408  8906 rpcz_store.cc:276] 0709 12:10:10.345911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.346070 (+   159us) service_pool.cc:224] Handling call
0709 12:10:10.346360 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.346557 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:13.769388 (+3422831us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.882954 (+113566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.902245 (+ 19291us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:13.902297 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.902406 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.904386 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168777,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":109,"raft.run_cpu_time_us":8680,"raft.run_wall_time_us":16325,"spinlock_wait_cycles":2341248,"thread_start_us":3493209,"threads_started":2,"wal-append.queue_time_us":139167}
I20260709 12:10:13.993208  8832 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.995162  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:13.996714  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.979771 10580 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.997462  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:13.970824 10272 consensus_queue.cc:1059] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:13.999346  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.985647 10300 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.965709 10603 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:10:14.000712 10588 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.017838  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:13.998857 10599 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:14.023036  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1722) took 1183 ms. Trace:
I20260709 12:10:14.052917  8756 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
W20260709 12:10:13.984011  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.071363  8826 rpcz_store.cc:276] 0709 12:10:12.840079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.840935 (+   856us) service_pool.cc:224] Handling call
0709 12:10:12.841258 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.520241 (+678983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.022671 (+502430us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54000e5954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:14.022917 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559856000}
I20260709 12:10:14.057299 10481 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.019639  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.074494  9487 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:13.990629 10608 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.020937  9520 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:14.075585  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.075846  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.076346  8756 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:14.077428  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.078833  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.079012 10605 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.079578  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.080121  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.081570  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.082389  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.083581  9518 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.083684  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.085059  9518 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.020313  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:14.094805 10615 log.cc:927] Time spent T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:10:14.095103  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.069756 10588 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.096202 10588 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.096928  9520 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.021730  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.066602 10235 raft_consensus.cc:3055] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.982661 10597 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.019418  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.067838  9522 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:13.986438 10601 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.034329  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:14.025840 10606 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:13.993592  8904 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.081146 10538 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.077399  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.086484 10608 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.088694 10419 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.994424 10576 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:13.989898 10425 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.017827 10385 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.994724 10423 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.065227 10452 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.102356  9487 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.093721  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.105824  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.107370  8906 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:14.072856 10599 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.111253  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 77020.4us
I20260709 12:10:14.113328  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:14.136783  8827 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:14.141083 10606 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.144742  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.116163  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.120963  8907 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:14.124897  8828 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:14.107583 10235 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.150565  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.112068  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.151639  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:14.156818  8758 raft_consensus.cc:606] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.112324 10605 consensus_queue.cc:1059] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:14.158938  8759 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.157281  8758 raft_consensus.cc:614] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:14.114450 10563 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.146783 10419 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.136806  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.176578 10235 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.178179 10235 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.180501  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.182305  8907 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.183463  8907 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:14.184916  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.186863 10571 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.187453 10452 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:14.189688 10613 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
I20260709 12:10:14.190086  9517 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:14.193750  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1725) took 1348 ms. Trace:
I20260709 12:10:14.194150  8830 rpcz_store.cc:276] 0709 12:10:12.849452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.849586 (+   134us) service_pool.cc:224] Handling call
0709 12:10:12.852412 (+  2826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.207959 (+355547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.193511 (+985552us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540006a254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:14.193679 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816048512}
I20260709 12:10:14.197175  9487 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.198362 10606 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.198964 10559 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:14.150389 10608 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.242230  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.243446  8827 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:14.246138  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 78457.9us
I20260709 12:10:14.164899 10563 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:14.211282 10419 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.223477 10593 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.252444  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:14.258502  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 164888us
I20260709 12:10:14.259596  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.257772  8801 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:14.236827 10423 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:14.267709  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.268146  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:14.269233  8758 raft_consensus.cc:606] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.248234 10481 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.260170 10563 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.239609 10611 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:14.259718 10419 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.265965  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:14.279060 10373 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:14.265878 10612 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.273701 10324 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:14.286460  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.272436 10442 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.287289 10624 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:14.260982 10383 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:14.289723 10425 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.291669 10538 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.264357 10495 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.257302 10593 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.294875  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.264045 10423 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.247959 10330 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:14.264806 10385 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:14.273190 10570 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.272935 10481 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:14.313027 10612 raft_consensus.cc:3055] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.330787 10612 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:14.333856  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:14.334630  9522 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:14.304481 10373 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.263119 10580 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.318655  9521 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:14.326712  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.313347 10442 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:14.332414  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.322458 10593 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.324600 10597 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.343837 10373 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.332953 10481 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.344887  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:14.346439 10612 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.328447 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58050 (request call id 0) took 1688 ms. Trace:
I20260709 12:10:14.350948  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.367120  8902 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:14.320909 10425 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:14.341290  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.321409  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.368978  8907 raft_consensus.cc:1240] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.344184 10588 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.373788  8759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:14.374524  8759 raft_consensus.cc:606] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.372268 10373 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.374912  8759 raft_consensus.cc:614] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:14.338043 10495 raft_consensus.cc:697] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:14.374066 10442 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.325924 10624 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.403895  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.404577  8759 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.404803  9522 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.368546 10587 rpcz_store.cc:276] 0709 12:10:12.640165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.640345 (+   180us) service_pool.cc:224] Handling call
0709 12:10:12.665378 (+ 25033us) log.cc:844] Serialized 501 byte log entry
0709 12:10:14.328349 (+1662971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67,"raft.queue_time_us":334,"raft.run_cpu_time_us":1099,"raft.run_wall_time_us":5293,"thread_start_us":177612,"threads_started":1,"wal-append.queue_time_us":195695,"wal-append.run_cpu_time_us":2530,"wal-append.run_wall_time_us":1138587}
I20260709 12:10:14.385197  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1521) took 1117 ms. Trace:
I20260709 12:10:14.385739  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.386348  9525 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.387244 10611 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.388779 10580 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.371955 10503 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:14.406045  8833 rpcz_store.cc:276] 0709 12:10:13.267777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.268312 (+   535us) service_pool.cc:224] Handling call
0709 12:10:13.269158 (+   846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.625751 (+356593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.384941 (+759190us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001fefd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:14.385128 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818603392}
I20260709 12:10:14.396284  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:14.397780  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.399523  8908 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.402797  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.372743  9520 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.411012  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.412441 10581 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:14.413230 10611 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.415580  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.375272 10373 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.395001  8757 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:14.366480 10585 consensus_queue.cc:1059] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:14.433701 10495 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.434597  9516 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.422976 10452 raft_consensus.cc:3055] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.441195  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.442252  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.443200  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:14.443837  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.445021  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.445180  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.445722 10624 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.431409 10399 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:14.447576  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.448928  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.532965 10391 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.533398 10391 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.533428  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.534708  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.534507 10391 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.535869  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.538187  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.539609  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.454005 10599 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.456338  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1816) took 1034 ms. Trace:
I20260709 12:10:14.459214 10576 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.462128  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.541399 10456 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.451831  8907 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.470852  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:14.475566 10425 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.476055 10300 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.479024  9524 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.485723  8909 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.488946  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.555727  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.556360  8760 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:14.556746  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 94744.8us
I20260709 12:10:14.557317  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.451776 10588 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:10:14.563722  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.416774  9487 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.499187  8759 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:14.500399  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:14.503439  8900 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.567664  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:14.507144  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.568799  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:14.503039  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 45959.1us
I20260709 12:10:14.516515  8755 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:14.518071 10585 raft_consensus.cc:3055] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.510699 10593 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:14.517297  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 83662.3us
I20260709 12:10:14.425333 10385 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.580305  8906 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.519680 10276 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.521673  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.521819  8903 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.523586  8904 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.524127 10612 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.525681  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1724) took 1681 ms. Trace:
I20260709 12:10:14.525826  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.529306 10373 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.579589  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:14.450034  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.537437  8754 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:14.511745 10452 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.629374 10452 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.630848 10452 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.637132  8834 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.538160 10455 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.538111 10554 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.445230 10605 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.506552 10581 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.540874 10597 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.569830 10300 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.562021 10622 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:10:14.540751 10611 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.535732 10391 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.653400 10300 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:14.656602  8758 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:14.607019 10276 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:14.542407  9521 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.542272  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.463203  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:14.628386  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.560276 10481 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:14.582762  8798 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.591s (SENT)
I20260709 12:10:14.624691 10588 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.611622  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.571092  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.609889  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.678086  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.678452  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.678795  8760 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:14.575686  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:14.679788  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:14.680164  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 104549us
W20260709 12:10:14.613159  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 196270us
I20260709 12:10:14.616938  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:14.681687  8826 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:14.620062  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:14.621935  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:14.549577 10458 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:14.561575 10457 consensus_queue.cc:1059] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:10:14.684489  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:14.687704  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.606762 10399 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:14.693735  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.627215  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.615223 10444 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.581727 10585 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:14.571245 10582 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.543705  8905 rpcz_store.cc:276] 0709 12:10:13.421494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.423526 (+  2032us) service_pool.cc:224] Handling call
0709 12:10:14.023532 (+600006us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800135398. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:14.023823 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.119389 (+ 95566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.119423 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.123506 (+  4083us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.236268 (+112762us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.236316 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.456023 (+219707us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b5400117954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:14.456076 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.456124 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:14.456139 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.456269 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":20180,"spinlock_wait_cycles":245358848,"thread_start_us":100847,"threads_started":1,"wal-append.queue_time_us":172696}
W20260709 12:10:14.673588  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 99385us
I20260709 12:10:14.609046  8832 rpcz_store.cc:276] 0709 12:10:12.844325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.844442 (+   117us) service_pool.cc:224] Handling call
0709 12:10:13.713266 (+868824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.002534 (+289268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.506324 (+503790us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400051754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:14.525442 (+ 19118us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400051750. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:14.525610 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640586880}
I20260709 12:10:14.561909 10425 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.676750  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.686429  8903 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.686512  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.688748  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.679803  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.617215  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:14.738147  8902 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.748018  8760 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:14.555614 10419 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.749969  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:14.750037  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 56393.7us
I20260709 12:10:14.752358  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.755146  8756 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:14.755426  8752 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:14.756385  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.757076  8752 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.757788  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:14.758684 10276 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.657471 10373 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:10:14.683871  9516 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.761417  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.762837  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.763521  8760 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:14.769909 10481 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.771142 10457 raft_consensus.cc:3055] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.771657 10457 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:14.772114 10599 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.775627 10457 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.777101 10457 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.696302 10300 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:10:14.778908 10300 consensus_queue.cc:1243] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:14.696729 10330 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:10:14.779445 10423 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.780061  8752 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:14.783895 10419 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.785635  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:14.786298  9522 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:14.789113  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 206372us
I20260709 12:10:14.756193  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.647742 10605 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.795193  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:14.799799  8798 leader_election.cc:336] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.663s (SENT)
I20260709 12:10:14.804243  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:14.796401  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.685061 10588 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.691249 10608 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.780380 10330 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.813964  8757 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:14.813428  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.815016  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.744416 10216 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.833680 10216 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:14.834079 10216 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.745437  8645 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16a04653cca743d0966d20df2225c35d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:10:14.750931 10235 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.814574 10588 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.814432 10491 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.779511 10300 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.762848  8751 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.867061  9525 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:14.869566  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73235.9us
I20260709 12:10:14.868688  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.787051 10601 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.794507 10624 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.866515  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.883550  8759 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:14.803401 10455 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.888675  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.892490  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.827484 10330 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.834882 10581 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.904435  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:14.905258 10330 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.906342 10581 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:14.906719 10330 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.907112 10593 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.813409 10458 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:14.885422 10300 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.836895 10481 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:10:14.788491 10563 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.909531 10300 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.910583 10235 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:14.910885 10300 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.912184 10563 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:14.892467 10606 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.913385  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.829416  8756 raft_consensus.cc:2376] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2. Re-sending same reply.
I20260709 12:10:14.914667  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.815565  9520 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:14.900478  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:14.920697  8831 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.829983 10608 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:14.917425  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:14.918898  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:14.927066  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.924363  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.926416  9523 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.931003  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:14.932340  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.933550  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.883572 10391 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.891037 10603 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.941447  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.916028 10584 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.837133 10599 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:10:14.839119 10610 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:14.962823  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.964042 10425 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:14.965947  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.969024 10324 raft_consensus.cc:3055] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.969691 10324 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:14.970745  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.970705 10324 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.972172  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:14.973526 10599 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.919291 10605 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.975056 10605 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.929872 10491 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.914887 10570 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.947674  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 464411us
W20260709 12:10:14.891901  8645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 194702us
I20260709 12:10:14.921818 10580 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.930665 10608 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.943408 10582 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.915654 10624 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.977694 10619 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.990998 10619 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:14.992007 10619 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:14.993250 10619 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.005870 10624 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.955178  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:14.979295  8759 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.947144  8756 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.978169 10491 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:14.972411 10324 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.008704  8757 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:15.011003  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 55973us
I20260709 12:10:15.011559  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:15.027329 10642 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:15.028062 10642 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:15.029150 10642 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.033684  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.034925  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:15.037489  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 337) took 1090 ms. Trace:
I20260709 12:10:15.038286 10491 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.039834  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:14.973937 10599 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:15.062353  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44448.6us
I20260709 12:10:15.064806  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.037882  9523 rpcz_store.cc:276] 0709 12:10:13.946700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.946842 (+   142us) service_pool.cc:224] Handling call
0709 12:10:14.440197 (+493355us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:14.926198 (+486001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.928759 (+  2561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.037272 (+108513us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400520b50. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:15.037401 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113100416}
I20260709 12:10:14.985384 10423 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:14.984478 10638 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.990046 10570 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:14.955044 10603 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:15.119992  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.155491  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:15.156395  8828 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.047515 10582 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:15.110114  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.066473 10610 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:10:15.160219  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:15.142396 10289 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:15.140190  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.108695 10579 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:10:15.197288  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 132633us
W20260709 12:10:15.194968 10576 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.022s
W20260709 12:10:15.208958 10576 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.017s	sys 0.022s
I20260709 12:10:15.163236 10638 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:15.214680  8872 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.216899  8759 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:15.217975  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.218644  9487 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.224409  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.232932  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:15.239995  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 419637us
I20260709 12:10:15.240406  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:15.234586  8759 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.150633 10599 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.242570  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:15.243547  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:15.227465 10610 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.251368  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.251430  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.253005  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.249281  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:15.234895 10643 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:15.238070 10579 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:15.257154  8759 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.263039  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.255858  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:15.261029  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 342406us
I20260709 12:10:15.264479  9488 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:15.265341 10581 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.250022 10373 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.268198  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.273988  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:15.275506  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.275475  8757 raft_consensus.cc:2376] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2. Re-sending same reply.
I20260709 12:10:15.272477  8828 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:15.247714 10385 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.254729  9516 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.244243 10391 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:15.331910  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:15.261183 10289 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.246987 10481 consensus_queue.cc:1059] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:10:15.233105 10644 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:15.275009 10599 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.274550 10503 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.275126 10373 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:15.268967 10452 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:10:15.276415  9517 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:15.279011 10579 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:15.348842  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:15.348418  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 74512.4us
W20260709 12:10:15.359342 10640 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:10:15.331496 10606 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:15.344244 10633 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:15.362712  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 116539us
I20260709 12:10:15.367245  8726 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:15.363885  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:15.369935  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:15.370604  8757 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.261521 10582 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:15.371433  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.371680  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:15.371973  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.373456  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:15.373375  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:15.375211  8902 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:15.357652 10373 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.376664  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:15.366483 10458 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:15.378328  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:15.381754  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.353844 10587 consensus_queue.cc:1059] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:15.364873 10581 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:15.378945 10647 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:15.389160  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:15.404922  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.387868 10603 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:15.376796 10570 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:15.409228 10585 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.374881 10456 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:15.407657 10579 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.488035  9523 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.342774 10638 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:15.489398  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.387627 10612 consensus_meta.cc:287] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.008s
W20260709 12:10:15.493358  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 111645us
I20260709 12:10:15.513001  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.496021  8756 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:15.498895 10653 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.492075 10648 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.499032 10585 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.514796  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.372714 10606 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.519202  9487 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.510675  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1383) took 1041 ms. Trace:
W20260709 12:10:15.582204  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 203981us
I20260709 12:10:15.523514  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.525765  8909 raft_consensus.cc:606] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.585978  8909 raft_consensus.cc:614] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:15.586969  8902 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.564092  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.592439  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.593938  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 74885.6us
I20260709 12:10:15.584151  8760 rpcz_store.cc:276] 0709 12:10:14.469000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.765084 (+296084us) service_pool.cc:224] Handling call
0709 12:10:14.765366 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.928912 (+163546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.928950 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.943044 (+ 14094us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.068249 (+125205us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.208788 (+140539us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.209037 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.209118 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.510348 (+301230us) raft_consensus.cc:1685] finished
0709 12:10:15.510385 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.510595 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140545,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":3680,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":239,"spinlock_wait_cycles":11008,"thread_start_us":369670,"threads_started":3,"wal-append.queue_time_us":204627}
I20260709 12:10:15.595887  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:15.595044  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68810us
I20260709 12:10:15.597762  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.599767  8902 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:15.600730  8900 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.521270 10653 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.525067 10458 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.391691  8754 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.603260  8908 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.603518  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.597167 10659 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.491086 10300 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:15.577962  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.506932 10399 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.602233  8900 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.586714 10644 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:15.521402 10652 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.116s	user 0.000s	sys 0.004s
I20260709 12:10:15.508143 10452 consensus_queue.cc:1243] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:15.504295 10491 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.620882  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:15.622885 10659 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:15.601058 10612 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.596885 10660 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:10:15.609830 10653 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.624924  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.654021 10399 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:15.743502  8760 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:15.628189  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55790 (request call id 10) took 1049 ms. Trace:
I20260709 12:10:15.629446 10276 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.744912  8909 rpcz_store.cc:276] 0709 12:10:14.579220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.579392 (+   172us) service_pool.cc:224] Handling call
0709 12:10:15.627982 (+1048590us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54003d2554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813d853 00007fce3d10b60a 00007fce366917d4 00007fce36691762 00007fce36691691 00007fce3669160c 00007fce366908c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:15.628093 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093613440}
I20260709 12:10:15.673575 10419 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:15.633723 10619 consensus_meta.cc:287] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.008s
W20260709 12:10:15.640590 10634 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.966s	user 0.013s	sys 0.000s
I20260709 12:10:15.642859 10642 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.644851 10606 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:15.655244  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:15.779613 10642 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:15.679801 10612 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:15.780262 10612 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.780593 10642 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.781864  8900 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.782274  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:15.783102  8900 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:15.657616  8833 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.759843 10570 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:15.658367  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:15.653777  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:15.664098  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.786543  8756 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:15.608603 10458 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:15.673669  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:15.675755  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:15.677842  9488 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:15.707690  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.738960  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60125us
W20260709 12:10:15.626511 10330 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 12:10:15.631083  9520 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:15.806133  8723 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38804 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:15.669427 10644 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:15.810397 10644 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.752565  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.753140 10399 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.672991 10300 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:15.767693  8751 consensus_meta.cc:287] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.732s	user 0.017s	sys 0.000s
W20260709 12:10:15.769410  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.769150 10659 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.827309  8751 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:15.827700  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.828208  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.770998 10608 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.003s
I20260709 12:10:15.781888 10642 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.772517  8759 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:15.784392  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:15.804431  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.785574 10597 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.808044  9523 raft_consensus.cc:2393] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 2: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:15.779444 10605 consensus_meta.cc:287] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.002s
W20260709 12:10:15.785964 10216 consensus_meta.cc:287] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.951s	user 0.013s	sys 0.005s
I20260709 12:10:15.808954 10425 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.843096 10425 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:15.819017  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.844321  8756 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:15.820082  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 144406us
I20260709 12:10:15.826365 10300 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.785234 10570 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.758436 10419 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:15.806782  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 129019us
I20260709 12:10:15.833343 10655 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.806516  8723 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38804 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1442)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
I20260709 12:10:15.836463  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:15.809593 10588 consensus_meta.cc:287] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.013s
I20260709 12:10:15.831403 10587 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.868170  8832 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:15.869310  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.847545  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 86320.5us
I20260709 12:10:15.833570  8753 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:15.839304 10606 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:15.838032 10608 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.914669  9523 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.932516  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:15.842280 10597 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.938601  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.923382  8900 raft_consensus.cc:2955] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:15.912824  9517 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.881958  9516 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.913672 10605 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.847077 10216 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.942585  8723 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43822 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1442)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1447)
I20260709 12:10:15.911769 10655 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:15.846863 10289 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:10:15.964722  8752 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.974978  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:15.975708  8756 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:15.910621 10619 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:15.874577 10455 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 12:10:15.990878  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.884366 10588 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.980984  8757 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:15.982339 10666 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:10:15.977361 10456 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:15.995230 10456 consensus_queue.cc:1243] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:15.849282 10458 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.997023 10458 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.997427 10653 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.999902 10653 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:15.986666 10373 consensus_meta.cc:287] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
W20260709 12:10:15.987270 10610 consensus_meta.cc:287] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.002s
I20260709 12:10:15.929855 10612 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:15.988495 10603 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.927764 10606 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:15.990087  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 76399.2us
I20260709 12:10:15.979367  8758 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:15.995950  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.026980  8756 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
W20260709 12:10:16.002537 10658 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 12:10:15.977262  9520 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:16.001116 10373 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.005940 10610 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.007079 10216 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:15.993391 10419 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.036837 10419 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.007942  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:15.971751 10605 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:15.875205 10425 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:16.027979  9521 raft_consensus.cc:1240] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.987473 10644 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:16.038997  8903 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:16.080215  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 147814us
W20260709 12:10:16.082926  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.085045  8902 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.087128  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.074167  8904 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.100723  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 69483us
I20260709 12:10:16.074604 10610 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:16.089270  8901 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.075063 10554 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:16.112076  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:16.113199  8906 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:16.009591 10655 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:16.106792  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.114387  8756 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
W20260709 12:10:16.116233  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 105910us
I20260709 12:10:16.116295  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:16.119285 10608 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:16.119577 10588 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:16.120038 10330 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.115139 10674 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.126145  8906 raft_consensus.cc:1240] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:16.127224 10670 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:16.127388  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:16.109910 10570 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.130106 10644 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:16.132766  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.132848 10674 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.135330 10674 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.137023 10566 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.137481 10566 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:16.140026 10373 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.120499 10330 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.145417 10330 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.145689 10611 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.144913  8909 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.154173 10399 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:16.155224 10584 raft_consensus.cc:3055] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.155777 10612 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:16.123943 10606 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.160327  9517 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.160550 10585 consensus_queue.cc:1059] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.161309 10554 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.171512 10554 consensus_queue.cc:1243] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:16.172186 10563 raft_consensus.cc:3055] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:16.172694 10563 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:16.173699 10563 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.174083  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.174559 10579 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.174810  8760 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:16.174935 10563 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.175638 10579 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.176030 10579 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:16.178196 10423 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:16.178606 10423 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:16.179486 10423 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.183745  8905 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.163040  8904 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:16.133015 10605 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.168167 10584 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:16.175431 10452 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.164494 10330 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:16.191610  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.168684  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.479379  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1849) took 1106 ms. Trace:
I20260709 12:10:16.376140  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1385) took 1906 ms. Trace:
W20260709 12:10:16.381695  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1413) took 1598 ms (client timeout 1980 ms). Trace:
I20260709 12:10:16.397061  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.410363 10689 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.013751  8754 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:17.013940 10655 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.434582  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:17.014297  8754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1435) took 1292 ms (client timeout 1539 ms). Trace:
I20260709 12:10:17.014600 10655 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:17.014891  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1437) took 1292 ms (client timeout 1683 ms). Trace:
W20260709 12:10:17.014842  8754 rpcz_store.cc:269] 0709 12:10:15.721826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.396673 (+674847us) service_pool.cc:224] Handling call
0709 12:10:17.014217 (+617544us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.015448  8760 rpcz_store.cc:269] 0709 12:10:15.722473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.434286 (+711813us) service_pool.cc:224] Handling call
0709 12:10:17.014829 (+580543us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:16.422748  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.016520  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.017331  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1469) took 1353 ms. Trace:
I20260709 12:10:17.017649  8760 rpcz_store.cc:276] 0709 12:10:15.664073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.016264 (+1352191us) service_pool.cc:224] Handling call
0709 12:10:17.017279 (+  1015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.018482  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.411391  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:16.245083  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.116873  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.367090  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.509348  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1397) took 2036 ms. Trace:
I20260709 12:10:16.191793  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:17.182951  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 991140us
I20260709 12:10:16.513746  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.184818 10216 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:16.544606  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1449) took 1297 ms (client timeout 1720 ms). Trace:
W20260709 12:10:17.185954  8759 rpcz_store.cc:269] 0709 12:10:15.247413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.262737 (+ 15324us) service_pool.cc:224] Handling call
0709 12:10:16.544351 (+1281614us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002b2fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:16.544520 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169860992}
W20260709 12:10:16.531538  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.300285  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.215111  9516 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:17.215847  9516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 507) took 1058 ms. Trace:
I20260709 12:10:16.468372  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 386) took 1602 ms. Trace:
I20260709 12:10:16.345974 10330 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.431747 10385 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.348973 10391 raft_consensus.cc:3055] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.251901 10391 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:16.358242 10399 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.248353 10385 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.302240 10423 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.255187 10391 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:16.225850 10452 consensus_queue.cc:1243] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:16.411060 10456 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:17.259891 10385 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.260897 10456 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:17.261446 10456 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.263692 10456 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:16.348552 10491 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.366271 10481 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.264897 10491 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.265481 10481 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:17.266582 10481 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.267897 10481 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.193994 10554 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:10:16.368120 10458 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.442435 10425 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.177071 10579 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.330505 10584 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:16.410859 10563 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:16.316143 10601 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.356222 10597 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:16.192492 10622 raft_consensus.cc:3055] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.302011 10622 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:16.448182 10606 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.488986 10636 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.304080 10606 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.304670 10636 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.306488 10606 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.306756 10636 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:16.318816 10675 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:10:16.987033  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.312474  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.312937  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.313284  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.313629  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.316011  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:17.013037  8752 rpcz_store.cc:276] 0709 12:10:14.469463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.780998 (+311535us) service_pool.cc:224] Handling call
0709 12:10:14.781373 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.975187 (+1193814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.375655 (+400468us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000f5fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:16.376002 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720851328}
I20260709 12:10:16.410851  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:16.461300  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1450) took 1194 ms. Trace:
I20260709 12:10:17.317473  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.317622  8757 rpcz_store.cc:276] 0709 12:10:15.267133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.372773 (+105640us) service_pool.cc:224] Handling call
0709 12:10:16.461089 (+1088316us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001a13d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:16.461228 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821401984}
I20260709 12:10:17.318339  8752 raft_consensus.cc:2376] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4. Re-sending same reply.
I20260709 12:10:17.319023  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.319878  8757 raft_consensus.cc:2393] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:17.320278  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1443) took 1387 ms (client timeout 1712 ms). Trace:
I20260709 12:10:17.013993  8903 rpcz_store.cc:276] 0709 12:10:15.373041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.373280 (+   239us) service_pool.cc:224] Handling call
0709 12:10:15.373602 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.073566 (+699964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.479099 (+405533us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540019ad54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:16.479314 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529613184}
I20260709 12:10:17.320422  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:17.321355  8904 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.321516  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.322309  8900 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
W20260709 12:10:17.013108  8758 rpcz_store.cc:269] 0709 12:10:14.783469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.932080 (+148611us) service_pool.cc:224] Handling call
0709 12:10:16.381400 (+1449320us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54001a31d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:16.381569 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097421056}
I20260709 12:10:17.323663  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.324255  8758 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
W20260709 12:10:17.324734  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1459) took 1825 ms (client timeout 2165 ms). Trace:
W20260709 12:10:17.325074  8758 rpcz_store.cc:269] 0709 12:10:15.500069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.323400 (+1823331us) service_pool.cc:224] Handling call
0709 12:10:17.324680 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.325954  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.016438  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:17.327251  8754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1467) took 1720 ms (client timeout 1836 ms). Trace:
W20260709 12:10:17.327630  8754 rpcz_store.cc:269] 0709 12:10:15.606433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.016118 (+1409685us) service_pool.cc:224] Handling call
0709 12:10:17.327186 (+311068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.328097 10584 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.020422 10655 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:17.025620  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.333213  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.333949  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.334023 10452 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.067972  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1419) took 1470 ms. Trace:
I20260709 12:10:17.334654 10452 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.334791  8905 rpcz_store.cc:276] 0709 12:10:15.597523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.598628 (+  1105us) service_pool.cc:224] Handling call
0709 12:10:15.598925 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.184287 (+585362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.067652 (+883365us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400037ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:17.067899 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344484608}
I20260709 12:10:17.072162 10603 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.336104 10603 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.336766  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:17.337337 10452 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.114789 10693 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.338061 10693 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.338508 10603 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:17.081411  9490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.016s	sys 0.006s
W20260709 12:10:17.339219  9490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.017s	sys 0.007s
I20260709 12:10:17.120824 10689 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.340516  9517 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:17.145768 10585 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.345105 10585 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.345563  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:17.346875  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.347288 10585 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.144477 10619 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:17.154179 10561 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.348182  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.334707 10330 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.348558 10561 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.349140 10330 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.350709 10561 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.168334  8753 rpcz_store.cc:276] 0709 12:10:14.472445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.762483 (+290038us) service_pool.cc:224] Handling call
0709 12:10:15.039707 (+277224us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:10:16.509078 (+1469371us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001a18d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:16.509258 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797980672}
I20260709 12:10:17.351020 10330 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.351756  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.165947 10593 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.575526  8725 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43822 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1471)
I20260709 12:10:17.195797  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.204321  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.180012 10455 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:17.204932  8831 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:17.207161  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.361202  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.208959  8835 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:17.210971  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.212404 10696 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.213775  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.219645  9521 rpcz_store.cc:276] 0709 12:10:14.865762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.867401 (+  1639us) service_pool.cc:224] Handling call
0709 12:10:14.867760 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.043733 (+1175973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.468012 (+424279us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540074e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:16.468293 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667757440}
W20260709 12:10:17.364202  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 150523us
I20260709 12:10:17.364347  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.365147  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.216280  9516 rpcz_store.cc:276] 0709 12:10:16.157400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.190858 (+ 33458us) service_pool.cc:224] Handling call
0709 12:10:17.215766 (+1024908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.245187 10698 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.256886 10391 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.268805  8755 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:17.274612 10385 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:17.268307 10491 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.278306 10458 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.282230 10554 consensus_queue.cc:1243] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:17.399222  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.295348  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.309458  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.309576  8756 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:17.019022  8760 raft_consensus.cc:2376] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:17.326474  8758 raft_consensus.cc:2376] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:17.317462  8751 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:17.329660  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:17.319027  8752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1468) took 1701 ms (client timeout 1980 ms). Trace:
I20260709 12:10:17.331993 10579 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.354264 10481 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:17.335510 10611 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:17.337430  9523 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:17.342362  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.360973 10425 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.123458 10324 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.343559  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.345351  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:17.469900  8725 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:43816 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 12:10:17.475143  8905 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
W20260709 12:10:17.468407  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1458) took 2074 ms (client timeout 2133 ms). Trace:
I20260709 12:10:17.340337 10693 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:17.186496  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.475768  8760 rpcz_store.cc:269] 0709 12:10:15.394022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.018248 (+1624226us) service_pool.cc:224] Handling call
0709 12:10:17.468336 (+450088us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.477785  8798 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.561s (SENT)
I20260709 12:10:17.475071  8725 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:43816 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1476)
W20260709 12:10:17.478324  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.358327  8656 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 4, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 4 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:17.365345  9521 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:17.366609  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:17.225641  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.367898  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.368757  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.369304  8831 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:17.371187 10452 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.371811  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:17.482492  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 115945us
W20260709 12:10:17.485664  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 113936us
I20260709 12:10:17.486040  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.372013 10706 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.487511  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:17.487766  8872 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43822 dropped due to backpressure: service queue is full with 50 items [suppressed 55 similar messages]
I20260709 12:10:17.488140  8900 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:17.483923  8725 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:43816 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1476)
I20260709 12:10:17.384308 10689 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:17.289897 10601 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:17.459216  8755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1393) took 2926 ms (client timeout 2210 ms). Trace:
I20260709 12:10:17.459421  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.352531 10419 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:17.393425 10695 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:17.363374 10597 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.385195 10603 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:17.332732  8757 rpcz_store.cc:269] 0709 12:10:15.933072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.318731 (+1385659us) service_pool.cc:224] Handling call
0709 12:10:17.320222 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.384585 10619 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:17.461841  8752 rpcz_store.cc:269] 0709 12:10:15.617839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.317129 (+1699290us) service_pool.cc:224] Handling call
0709 12:10:17.318954 (+  1825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.369645 10330 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 12:10:17.465857 10583 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.469849 10622 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.472020  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.521975  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.472214 10458 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:17.467074  8753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1462) took 1963 ms (client timeout 2210 ms). Trace:
W20260709 12:10:17.529017  8753 rpcz_store.cc:269] 0709 12:10:15.501233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.351443 (+1850210us) service_pool.cc:224] Handling call
0709 12:10:17.464262 (+112819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.478214  8798 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:17.530684  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52951.8us
I20260709 12:10:17.504613 10706 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.474741  9525 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:17.480309  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:17.532321  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52140.6us
I20260709 12:10:17.489563  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.533165 10706 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.468189  8902 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:17.483919 10611 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:17.459532  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1460) took 1959 ms (client timeout 2196 ms). Trace:
W20260709 12:10:17.534260  8758 rpcz_store.cc:269] 0709 12:10:15.500545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.325715 (+1825170us) service_pool.cc:224] Handling call
0709 12:10:17.459441 (+133726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.535208  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.535332 10611 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.535786  8758 raft_consensus.cc:2376] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
W20260709 12:10:17.536259  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466) took 1947 ms (client timeout 2249 ms). Trace:
I20260709 12:10:17.396400 10698 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.522205  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.396654 10696 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.500486 10491 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.496066  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:17.554234  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58235.3us
I20260709 12:10:17.524561  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.502377  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:17.504089  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1431) took 1810 ms (client timeout 1720 ms). Trace:
I20260709 12:10:17.540874  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.497884  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:17.501024  8755 rpcz_store.cc:269] 0709 12:10:14.471476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.679421 (+207945us) service_pool.cc:224] Handling call
0709 12:10:17.398169 (+2718748us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b540033cf54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:17.398284 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5952771968}
I20260709 12:10:17.545204  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.557607  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.397483 10561 consensus_queue.cc:1059] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:10:17.470860 10605 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.114234  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 702831us
I20260709 12:10:17.369431 10593 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.522850  8757 raft_consensus.cc:2376] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4. Re-sending same reply.
I20260709 12:10:17.543586  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:17.562371  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1464) took 2037 ms (client timeout 2247 ms). Trace:
W20260709 12:10:17.562614  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 60350us
W20260709 12:10:17.562762  8757 rpcz_store.cc:269] 0709 12:10:15.525326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.521607 (+1996281us) service_pool.cc:224] Handling call
0709 12:10:17.562317 (+ 40710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.523842  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:17.473794  8751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1434) took 1749 ms (client timeout 1521 ms). Trace:
I20260709 12:10:17.470670  8754 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:17.574517  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.472512 10566 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.520813 10619 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:17.491892  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.526060 10636 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.384850 10455 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.592242 10455 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.560343 10423 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.399135 10385 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:17.531303  8798 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.581s (SENT)
I20260709 12:10:17.593823  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:17.355592  8829 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.595825 10385 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.504245 10606 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.596791 10458 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.394152 10659 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:10:17.569988  9520 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:17.560597 10697 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:17.557870  8827 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:17.558480  8755 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.598400 10697 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.599452  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.600116  8827 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:17.500854 10554 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:17.600822 10704 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:17.600930 10554 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.545977 10583 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.602432  8827 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:17.603176 10554 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.518293  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.603593 10583 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.603935  8752 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:17.559873  8875 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:17.605216  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 45447.8us
I20260709 12:10:17.536855 10705 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.605822 10705 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.605948  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.606236 10705 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.606608  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 75335.4us
I20260709 12:10:17.607091  8875 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:17.500651 10703 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.607736 10455 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:17.605970  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.608186 10703 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.608443 10636 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.609835  8829 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:17.610478 10703 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.556535  8831 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
W20260709 12:10:17.536604  8758 rpcz_store.cc:269] 0709 12:10:15.589115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.534945 (+1945830us) service_pool.cc:224] Handling call
0709 12:10:17.536205 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.611697  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.612192  8758 raft_consensus.cc:2376] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2. Re-sending same reply.
I20260709 12:10:17.551848  9488 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:17.553181  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.612757  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1470) took 1038 ms. Trace:
W20260709 12:10:17.613147  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61432.1us
I20260709 12:10:17.547452  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.546414  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.563380  8872 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.497716  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.614046  9525 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:17.613116  8758 rpcz_store.cc:276] 0709 12:10:16.574182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.611467 (+1037285us) service_pool.cc:224] Handling call
0709 12:10:17.612687 (+  1220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.555575  8756 rpcz_store.cc:269] 0709 12:10:15.693670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.512376 (+818706us) service_pool.cc:224] Handling call
0709 12:10:17.503910 (+991534us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002c24d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:17.504019 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271838976}
I20260709 12:10:17.545346 10696 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:17.570343  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1463) took 2068 ms (client timeout 2244 ms). Trace:
W20260709 12:10:17.629082  8760 rpcz_store.cc:269] 0709 12:10:15.501550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.523482 (+2021932us) service_pool.cc:224] Handling call
0709 12:10:17.570294 (+ 46812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.504288 10689 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.553874 10491 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.586376  9516 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:17.525224 10597 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.588948 10593 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.640102 10216 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.643723 10491 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.569809 10706 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.644925 10706 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.646981 10706 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.573068 10399 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.647807 10399 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.542584 10698 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.596958 10606 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:17.501580 10324 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.648566 10606 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.650153 10324 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.575340 10601 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.551133  8904 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:17.567917  9523 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:17.651113 10601 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.616005  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.562450 10603 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.618898  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:17.623587 10636 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.568955 10605 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.623894  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.614662  8830 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:17.577183 10619 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.624435 10622 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.474359 10481 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.624652 10659 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.525075 10419 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.631254 10624 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.641278 10566 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.653481 10603 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.642179  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.653057 10423 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.681653  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.632220  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.642339 10689 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.628163 10425 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:17.693702 10603 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.694183 10713 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:17.686183 10659 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.654681 10655 raft_consensus.cc:2764] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:17.681531 10579 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.697293 10425 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.701340 10481 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.700114 10579 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.708986 10579 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.703650 10606 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.710824 10605 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.712733 10697 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.714401 10606 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.713886 10659 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.722404 10619 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.722523 10705 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.724998 10619 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.725011 10705 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.479507  8656 catalog_manager.cc:5697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.760159  8656 catalog_manager.cc:5697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.763810  8656 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.766564  8656 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.769266  8656 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 4, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.771727  8656 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 2 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:17.773825  8656 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.527532  8725 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43816 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1482)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1480)
I20260709 12:10:17.578334  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.490820  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:17.782197  8753 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:17.575187  8757 raft_consensus.cc:2368] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3.
W20260709 12:10:17.783218  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 292313us
I20260709 12:10:17.784408  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1472) took 1209 ms. Trace:
W20260709 12:10:17.570055  8751 rpcz_store.cc:269] 0709 12:10:15.721535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.410471 (+688936us) service_pool.cc:224] Handling call
0709 12:10:17.467206 (+1056735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.785054  8757 rpcz_store.cc:276] 0709 12:10:16.574768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.574258 (+999490us) service_pool.cc:224] Handling call
0709 12:10:17.784100 (+209842us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.785737  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.604507  8752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1438) took 1881 ms (client timeout 2072 ms). Trace:
W20260709 12:10:17.796296  8752 rpcz_store.cc:269] 0709 12:10:15.722739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.518021 (+1795282us) service_pool.cc:224] Handling call
0709 12:10:17.604450 (+ 86429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.798867  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.691682  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.802058  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.693336  9522 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:17.803635  8904 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 1.
W20260709 12:10:17.579131  8754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1461) took 2076 ms (client timeout 2206 ms). Trace:
I20260709 12:10:17.623454  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:17.677521  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.805321  8754 rpcz_store.cc:269] 0709 12:10:15.500917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.328369 (+1827452us) service_pool.cc:224] Handling call
0709 12:10:17.577216 (+248847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.806056  8756 raft_consensus.cc:2376] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:17.806972  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1473) took 1232 ms. Trace:
W20260709 12:10:17.807179  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.807472  8756 rpcz_store.cc:276] 0709 12:10:16.575029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.614984 (+1039955us) service_pool.cc:224] Handling call
0709 12:10:17.806868 (+191884us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.676086  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 57294.1us
I20260709 12:10:17.630540  8829 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:17.674381  8834 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:17.788651  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.677749  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:17.792999  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08000e23e0 after lost signal to thread 7581
I20260709 12:10:17.794849  8801 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:17.794977  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 182097us
I20260709 12:10:17.694078  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.855767  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:17.816392 10419 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.817325 10481 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:17.780145  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 206168us
I20260709 12:10:17.856783  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.857795  8902 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
W20260709 12:10:17.607244  8798 leader_election.cc:336] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.625s (SENT)
I20260709 12:10:17.860324 10419 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.861045 10419 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:17.861462  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 254098us
W20260709 12:10:17.862730  8798 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.637s (SENT)
I20260709 12:10:17.809875  9517 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:17.776106  8656 catalog_manager.cc:5697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 5, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:17.865965  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08001f43c0 after lost signal to thread 8692
I20260709 12:10:17.810868 10425 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.823740  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 260225us
I20260709 12:10:17.829107  8759 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:17.710899 10491 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.873853  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:17.878275 10606 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.854276  8874 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.881104 10697 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.882397 10697 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:17.883006 10697 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.884136 10655 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.885578 10456 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.800526  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1428) took 2885 ms. Trace:
I20260709 12:10:17.847427 10710 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.889097  8760 rpcz_store.cc:276] 0709 12:10:14.945252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.797977 (+2852725us) service_pool.cc:224] Handling call
0709 12:10:17.800438 (+  2461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.626573  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.889009 10710 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.891225  8835 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:17.861572 10419 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.835455  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:17.893471  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58539.5us
I20260709 12:10:17.856889 10481 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.894825 10481 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.692960 10423 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:17.783368  8753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1444) took 1849 ms (client timeout 2069 ms). Trace:
W20260709 12:10:17.897126  8798 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.676s (SENT)
I20260709 12:10:17.888981 10491 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:17.897029  8753 rpcz_store.cc:269] 0709 12:10:15.933439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.553291 (+1619852us) service_pool.cc:224] Handling call
0709 12:10:17.783181 (+229890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.897342 10710 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.897877  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:17.897032 10655 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.899248 10655 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.899756 10655 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.899552 10603 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.903688 10391 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.904615 10391 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.905936  8751 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:17.906476  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.906788 10659 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:17.908058  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.853223  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58908us
I20260709 12:10:17.910089  8801 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:17.871686 10425 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.914106 10425 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.881050 10452 raft_consensus.cc:3055] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.896531 10423 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.866281 10698 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:17.917025  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.866361  8656 catalog_manager.cc:5697] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 4, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:17.872016  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1d40 after lost signal to thread 8784
W20260709 12:10:17.918850  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.910347 10659 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:17.928396  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.928805  8829 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.928869 10622 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.928341  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:17.929776 10579 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.931429  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:17.937158  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.938467 10655 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:17.941114 10563 raft_consensus.cc:3055] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.942950  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.940281  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:17.932247  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.947644 10458 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:17.949810  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.950385  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:17.950806  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.919490 10452 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:17.966833  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:17.992233  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:17.992662 10597 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.993760 10385 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.994410 10385 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:17.994925 10385 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.967725 10622 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.968305 10655 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.995828 10622 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.996327 10622 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.960759 10563 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:17.996603  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.970144  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.960803  8752 raft_consensus.cc:2376] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2. Re-sending same reply.
I20260709 12:10:17.970947  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.971721  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:17.969192  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 104575us
I20260709 12:10:17.972759  8835 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.971915  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:17.974704 10583 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:17.997555  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:17.975571 10606 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.922188 10603 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:17.979795  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.980242  8755 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:17.980804  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:17.982326  8834 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.954557  8753 raft_consensus.cc:2376] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:18.020587  8751 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:18.028719  9524 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:18.031690  8833 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.984308  9518 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:17.989439 10456 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.991456  9523 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:17.991346  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:17.991838  8757 raft_consensus.cc:2376] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:17.993125 10452 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:17.969996 10579 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:17.995851  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:17.974574  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:18.002636  8758 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.009459  8828 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:18.010501  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.010195 10563 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.041064  8760 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:18.012048  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:18.012938  8798 leader_election.cc:336] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.683s (SENT)
I20260709 12:10:17.997320  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:18.013556  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1432) took 2319 ms (client timeout 1893 ms). Trace:
I20260709 12:10:18.013471  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.042088  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:18.042037  8759 rpcz_store.cc:269] 0709 12:10:15.693946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.195435 (+1501489us) service_pool.cc:224] Handling call
0709 12:10:18.013295 (+817860us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000398d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:18.013459 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088440064}
I20260709 12:10:18.014451  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.042995  8760 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:18.043557  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.045675  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.046341  8759 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.046991  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.047508  8760 raft_consensus.cc:2376] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5. Re-sending same reply.
I20260709 12:10:18.048439  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.048720 10425 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.049458 10425 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:17.993115  9517 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.017143 10619 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:18.017788  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55890.1us
I20260709 12:10:18.014354  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.011269 10583 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.042944  8726 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.021618  9488 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:18.071456  8755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 278) took 1936 ms (client timeout 2100 ms). Trace:
I20260709 12:10:18.031924  8656 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.052074  8760 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:18.073434  8756 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.071635  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.074455  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:18.071883  8755 rpcz_store.cc:269] 0709 12:10:16.121232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.557274 (+1436042us) service_pool.cc:224] Handling call
0709 12:10:18.039960 (+482686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.054905  8759 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:18.056914  8903 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:18.057478  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.057977  8835 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.059456  8752 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:18.051877 10425 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.079183 10583 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.038219 10456 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.071008  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:18.059883  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd1a0 after lost signal to thread 8859
I20260709 12:10:18.059583  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.083688  8830 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:18.084463  8751 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:18.061340 10622 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.062371  8904 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:18.063059  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:18.063723  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74391.7us
I20260709 12:10:18.064663  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.065160 10702 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.065609 10579 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.098198 10579 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:18.098747 10579 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.099107  8900 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:18.100026  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 98823.6us
I20260709 12:10:18.101169 10695 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.101637 10695 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.102017 10695 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.103508  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.104015  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.097406  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.066254  8826 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.066051  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.068697  8832 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.103950  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:18.089447  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2a40 after lost signal to thread 8933
I20260709 12:10:18.089974  8905 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:18.089604  8760 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.092844 10491 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.093035  8834 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.084259 10456 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.097013  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.110073  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.110522 10491 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.110988 10491 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.111177 10606 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:18.112118 10606 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.113533 10452 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.110146  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1425) took 3619 ms. Trace:
I20260709 12:10:18.115356 10606 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.110368  8752 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:18.115518  8760 rpcz_store.cc:276] 0709 12:10:14.490250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.081286 (+3591036us) service_pool.cc:224] Handling call
0709 12:10:18.089140 (+  7854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.108921 (+ 19781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.109122 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.115163 10458 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.117434  8760 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.117702  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:18.118181  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1419) took 3312 ms. Trace:
I20260709 12:10:18.118248  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.118845  8760 rpcz_store.cc:276] 0709 12:10:14.805859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.116704 (+3310845us) service_pool.cc:224] Handling call
0709 12:10:18.117139 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.117923 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.118126 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.115772  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 102940us
I20260709 12:10:18.117548  8752 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.121032 10216 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.121436  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1424) took 3208 ms. Trace:
I20260709 12:10:18.121822 10216 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:18.122041  8752 rpcz_store.cc:276] 0709 12:10:14.913345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.116716 (+3203371us) service_pool.cc:224] Handling call
0709 12:10:18.117283 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.121096 (+  3813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.121320 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53376}
I20260709 12:10:18.123282 10216 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.110980  8757 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.106693  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1386) took 3598 ms. Trace:
I20260709 12:10:18.126453  8753 rpcz_store.cc:276] 0709 12:10:14.469721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.067389 (+3597668us) service_pool.cc:224] Handling call
0709 12:10:18.067880 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.068230 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.068270 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.068323 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.068366 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.068423 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.068564 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.092063 10423 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.130137 10391 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:18.130528  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.131619 10423 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.133641 10702 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.124094  8752 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:18.162489  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58758.9us
I20260709 12:10:18.131438  8832 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.131362  8656 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:18.169493  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58063.3us
W20260709 12:10:18.145541  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2b40 after lost signal to thread 8934
I20260709 12:10:18.028338 10697 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.173293  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1431) took 3165 ms. Trace:
I20260709 12:10:18.175534  8752 rpcz_store.cc:276] 0709 12:10:15.001454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.123377 (+3121923us) service_pool.cc:224] Handling call
0709 12:10:18.123836 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.166646 (+ 42810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.166951 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.178172  8751 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:18.178968  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1412) took 3395 ms. Trace:
I20260709 12:10:18.179358  8751 rpcz_store.cc:276] 0709 12:10:14.783210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.177281 (+3394071us) service_pool.cc:224] Handling call
0709 12:10:18.177808 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.178635 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.178860 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.183423  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:18.186160  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.164862 10563 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.187090  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:18.189797  8752 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.193322  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 268) took 3505 ms. Trace:
I20260709 12:10:18.193903  8759 rpcz_store.cc:276] 0709 12:10:14.687718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.183149 (+3495431us) service_pool.cc:224] Handling call
0709 12:10:18.183555 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.192965 (+  9410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.192992 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.193046 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.193085 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.193136 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.193251 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.197413  8798 leader_election.cc:336] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.710s (SENT)
I20260709 12:10:18.179751 10391 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.199255  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1434) took 3189 ms. Trace:
I20260709 12:10:18.200551  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1417) took 3415 ms. Trace:
I20260709 12:10:18.201380  8752 rpcz_store.cc:276] 0709 12:10:15.002330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.176409 (+3174079us) service_pool.cc:224] Handling call
0709 12:10:18.180245 (+  3836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.191449 (+ 11204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.191721 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.201684  8755 rpcz_store.cc:276] 0709 12:10:14.788282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.188086 (+3399804us) service_pool.cc:224] Handling call
0709 12:10:18.193162 (+  5076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.197430 (+  4268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.197457 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.200251 (+  2794us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.200304 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.200365 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.200482 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.205785  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.208530  8832 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.208580  8751 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.182752  8753 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.211774  8758 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:18.212477  8760 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:18.201011 10583 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:18.205066 10721 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.006s
I20260709 12:10:18.210002  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1435) took 3207 ms. Trace:
I20260709 12:10:18.216504  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.223863  8905 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.223667  8751 rpcz_store.cc:276] 0709 12:10:15.002598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.188126 (+3185528us) service_pool.cc:224] Handling call
0709 12:10:18.200550 (+ 12424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.209756 (+  9206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.209948 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.216506  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.219506  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.232615 10566 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:18.233050  9519 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.234072 10566 consensus_queue.cc:1059] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:18.235352 10566 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.235790 10566 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:18.208940  8656 catalog_manager.cc:5697] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.237007 10689 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.237486 10689 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:18.237691  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2120 after lost signal to thread 9549
I20260709 12:10:18.238481 10689 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:18.239205  8781 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2a40 after lost signal to thread 10642
I20260709 12:10:18.239991 10689 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.188974 10419 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.237772  8656 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 4, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.242069 10697 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.242623  8656 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 3 to 5, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:18.221570  8759 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.244673  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1439) took 3241 ms. Trace:
I20260709 12:10:18.244948  8759 rpcz_store.cc:276] 0709 12:10:15.003609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.217771 (+3214162us) service_pool.cc:224] Handling call
0709 12:10:18.221084 (+  3313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.244375 (+ 23291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.244601 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.223732  8756 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.230572  9487 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:18.218688 10385 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.246443  9525 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:18.247087  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1426) took 3755 ms. Trace:
I20260709 12:10:18.247279  8826 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.247716  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.247994 10385 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.223073 10583 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.248824 10583 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.249280  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.249593  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.250016  8829 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:18.251418  8830 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.223534  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.247567  8756 rpcz_store.cc:276] 0709 12:10:14.490589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.167735 (+3677146us) service_pool.cc:224] Handling call
0709 12:10:18.216924 (+ 49189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.245685 (+ 28761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.245878 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.253844  8827 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.253196  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.259315  8832 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 1.
I20260709 12:10:18.260396 10622 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:18.259935 10566 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.217700 10391 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.265370  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 271) took 3328 ms. Trace:
I20260709 12:10:18.265857  8758 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:18.266685 10391 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:18.264559  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.247015 10419 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:18.269531  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 89333.1us
W20260709 12:10:18.270251  8798 leader_election.cc:336] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.720s (SENT)
W20260709 12:10:18.271297  8798 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.733s (SENT)
W20260709 12:10:18.272367  8798 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.758s (SENT)
W20260709 12:10:18.274577  8798 leader_election.cc:336] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.802s (SENT)
I20260709 12:10:18.265787  8760 rpcz_store.cc:276] 0709 12:10:14.936567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.119969 (+3183402us) service_pool.cc:224] Handling call
0709 12:10:18.212299 (+ 92330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.212877 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.265100 (+ 52223us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400311ad0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:18.265281 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211309440}
I20260709 12:10:18.278658  8756 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.280128  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1443) took 3162 ms. Trace:
I20260709 12:10:18.280503  8756 rpcz_store.cc:276] 0709 12:10:15.117816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.275329 (+3157513us) service_pool.cc:224] Handling call
0709 12:10:18.278497 (+  3168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.279839 (+  1342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.280065 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.281818  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.258088 10481 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.282631  8756 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:18.282840  8908 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:18.283303  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1465) took 2700 ms. Trace:
I20260709 12:10:18.283674  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.284384  8902 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.285895  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:18.286927 10391 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.283211 10636 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.284189  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.289474  8906 raft_consensus.cc:2410] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:18.289595  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 272) took 3277 ms. Trace:
I20260709 12:10:18.290452  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:18.289956  8751 rpcz_store.cc:276] 0709 12:10:15.012163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.255651 (+3243488us) service_pool.cc:224] Handling call
0709 12:10:18.289061 (+ 33410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.289269 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.289297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.289336 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.289387 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.289435 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.289540 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.283697  8756 rpcz_store.cc:276] 0709 12:10:15.583235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.281209 (+2697974us) service_pool.cc:224] Handling call
0709 12:10:18.282281 (+  1072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.283062 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.283256 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.254568  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1432) took 3242 ms. Trace:
I20260709 12:10:18.293648  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.296063  8900 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.296844  8755 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.295855  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.296854  8752 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.298619  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1436) took 3295 ms. Trace:
I20260709 12:10:18.299125  8752 rpcz_store.cc:276] 0709 12:10:15.002865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.213262 (+3210397us) service_pool.cc:224] Handling call
0709 12:10:18.294226 (+ 80964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.298328 (+  4102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.298560 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.301781  8798 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.803s (SENT)
I20260709 12:10:18.302603  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.303543 10458 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:18.305140  8798 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.810s (SENT)
I20260709 12:10:18.305382  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.307360  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1429) took 2614 ms. Trace:
I20260709 12:10:18.284251 10481 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.296195  8753 rpcz_store.cc:276] 0709 12:10:15.001725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.127857 (+3126132us) service_pool.cc:224] Handling call
0709 12:10:18.128414 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.215761 (+ 87347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.223228 (+  7467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.307915  8752 rpcz_store.cc:276] 0709 12:10:15.693064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.306129 (+2613065us) service_pool.cc:224] Handling call
0709 12:10:18.306629 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.306932 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.306971 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.307022 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.307071 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.307134 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.307278 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.310850  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1445) took 2377 ms. Trace:
I20260709 12:10:18.311267  8753 rpcz_store.cc:276] 0709 12:10:15.933743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.309665 (+2375922us) service_pool.cc:224] Handling call
0709 12:10:18.310097 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.310426 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.310456 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.310526 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.310568 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.310634 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.310780 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.305743  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.311569  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1446) took 2377 ms. Trace:
I20260709 12:10:18.317912  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:18.312885 10636 raft_consensus.cc:697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.320250 10636 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.313297 10698 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:18.323951  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 93656.6us
I20260709 12:10:18.325245  9487 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.317588  8656 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 4, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:18.318482  8752 rpcz_store.cc:276] 0709 12:10:15.934038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.310643 (+2376605us) service_pool.cc:224] Handling call
0709 12:10:18.310971 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.311191 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.311214 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.311284 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.311324 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.311394 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.311495 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.330107  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:18.340910  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.351673  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:18.358966  8760 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.364464  8905 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:18.366513  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 276) took 2737 ms. Trace:
I20260709 12:10:18.366990  8760 rpcz_store.cc:276] 0709 12:10:15.628875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.298026 (+2669151us) service_pool.cc:224] Handling call
0709 12:10:18.358779 (+ 60753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.359487 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.366442 (+  6955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.368753  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 273) took 3313 ms. Trace:
I20260709 12:10:18.369216  8759 rpcz_store.cc:276] 0709 12:10:15.055857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.256914 (+3201057us) service_pool.cc:224] Handling call
0709 12:10:18.313941 (+ 57027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.368301 (+ 54360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.368363 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.368423 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.368471 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.368540 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.368694 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.370283  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:18.371685  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46543.8us
I20260709 12:10:18.373894  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 277) took 2343 ms. Trace:
I20260709 12:10:18.374361  8752 rpcz_store.cc:276] 0709 12:10:16.030836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.359214 (+2328378us) service_pool.cc:224] Handling call
0709 12:10:18.373226 (+ 14012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.373500 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.373528 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.373604 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.373640 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.373695 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.373824 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.375416 10491 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.375589  8656 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.377112 10698 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.378399  8756 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 4. Ops: []
W20260709 12:10:18.381201  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 63401us
I20260709 12:10:18.377645  8656 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.367805  8906 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
W20260709 12:10:18.384255  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91487.7us
I20260709 12:10:18.387061  8902 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:18.386977  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:18.389863  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.390625  8757 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.391115  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 279) took 2234 ms. Trace:
I20260709 12:10:18.391443  8757 rpcz_store.cc:276] 0709 12:10:16.156966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.356730 (+2199764us) service_pool.cc:224] Handling call
0709 12:10:18.386403 (+ 29673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.390912 (+  4509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.391061 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.394435  8760 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.394811  8656 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:18.380226 10452 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.396222 10704 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.398017 10391 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.398442 10391 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.398775 10391 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:18.400388  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.400324  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1471) took 1825 ms. Trace:
I20260709 12:10:18.405694  8760 rpcz_store.cc:276] 0709 12:10:16.574491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.391811 (+1817320us) service_pool.cc:224] Handling call
0709 12:10:18.394092 (+  2281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.394929 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.400260 (+  5331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.409308 10730 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.410439  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.411808  8751 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:18.413331 10724 log.cc:927] Time spent T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:18.413542  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 281) took 1074 ms. Trace:
I20260709 12:10:18.413996  8751 rpcz_store.cc:276] 0709 12:10:17.338772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.411049 (+1072277us) service_pool.cc:224] Handling call
0709 12:10:18.411453 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.413240 (+  1787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.413488 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.415252  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.415740 10583 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:18.416718  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.418025  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.418396 10583 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.394299  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1449) took 2424 ms. Trace:
I20260709 12:10:18.419811  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.419732  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.421743  8833 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:18.422072  8757 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.419364  8753 rpcz_store.cc:276] 0709 12:10:15.967961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.312529 (+2344568us) service_pool.cc:224] Handling call
0709 12:10:18.316009 (+  3480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.358534 (+ 42525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.365252 (+  6718us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.366030 (+   778us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.378147 (+ 12117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.383598 (+  5451us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.392437 (+  8839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.424021  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.425280  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.425865  8753 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:18.427560  9517 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:18.430197  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1437) took 3427 ms. Trace:
I20260709 12:10:18.430840  8755 rpcz_store.cc:276] 0709 12:10:15.003115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.206261 (+3203146us) service_pool.cc:224] Handling call
0709 12:10:18.255359 (+ 49098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.297328 (+ 41969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.429870 (+132542us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54002b2ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:18.430117 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81545088}
W20260709 12:10:18.432013  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 43530.2us
I20260709 12:10:18.432222  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1440) took 3428 ms. Trace:
I20260709 12:10:18.415879 10579 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.432734  8758 rpcz_store.cc:276] 0709 12:10:15.006933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.216264 (+3209331us) service_pool.cc:224] Handling call
0709 12:10:18.257883 (+ 41619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.266564 (+  8681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.431998 (+165434us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b54001a13d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:18.432160 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16928000}
I20260709 12:10:18.433960 10730 raft_consensus.cc:697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.434422  8758 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.435256 10730 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.436497 10593 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:18.438760 10702 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.374382 10456 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.427743  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.441977  8752 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.442983 10456 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.428589  8751 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.443970 10491 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.484674  8906 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.444962  9523 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.441962  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.450548  8900 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.481680  8656 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.469759  8905 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.485657  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:18.486855  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 181802us
I20260709 12:10:18.488237  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:18.468039  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.470775  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.444489  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:18.491250  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 282) took 1152 ms. Trace:
I20260709 12:10:18.491806  8833 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:18.448119 10385 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.493345 10385 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.454739  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.481971  8754 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:18.495428  8758 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.491607  8909 raft_consensus.cc:2368] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:18.491751  8751 rpcz_store.cc:276] 0709 12:10:17.339010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.416360 (+1077350us) service_pool.cc:224] Handling call
0709 12:10:18.428228 (+ 11868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.485145 (+ 56917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.491174 (+  6029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.491483  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.502276  8757 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:18.504246 10698 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.505321 10698 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.508064  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:18.509070  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 67176.2us
W20260709 12:10:18.510476  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.510979  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.507577  9519 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:18.447234 10603 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:18.524818 10603 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.526522  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.527163 10603 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:18.528095  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.528262  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.529150  8909 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:18.514701  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:18.515236  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64928.2us
I20260709 12:10:18.530236  8833 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:18.517366  8798 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.812s (SENT)
I20260709 12:10:18.522785 10391 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.523391  8760 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.523661  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 275) took 2924 ms. Trace:
W20260709 12:10:18.533703  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.483747 10579 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:18.527354  8906 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:18.522234  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.537501  8831 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.529680  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.533962  8756 rpcz_store.cc:276] 0709 12:10:15.599445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.296727 (+2697282us) service_pool.cc:224] Handling call
0709 12:10:18.313044 (+ 16317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.378824 (+ 65780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.523386 (+144562us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540033d454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:18.523592 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149830400}
I20260709 12:10:18.515705  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.538712  8900 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.530567  9487 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.533753  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 280) took 1195 ms. Trace:
I20260709 12:10:18.501044 10491 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.539474  8760 rpcz_store.cc:276] 0709 12:10:17.338472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.495912 (+1157440us) service_pool.cc:224] Handling call
0709 12:10:18.523042 (+ 27130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.533465 (+ 10423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.533698 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.539515  8907 raft_consensus.cc:2368] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
W20260709 12:10:18.541510  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.543344  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.543226  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.516307 10702 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.548983  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.550460  8827 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.553444  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.550966  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.548139  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.555502  8903 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:18.549027  9525 raft_consensus.cc:2376] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3. Re-sending same reply.
I20260709 12:10:18.560964  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.563138 10706 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.563581  8753 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.564278 10706 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:18.563725 10705 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.544945 10491 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.574764  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.581633  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.584226 10385 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:18.585191 10705 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.586371 10705 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.590934  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.591070  8875 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.592135  8909 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.593784  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.595441  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:18.594110  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 76818.7us
I20260709 12:10:18.580375 10606 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.597970  9525 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:18.593581  8906 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
W20260709 12:10:18.598940  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.563401  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.597378 10606 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.604131 10606 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:18.607034  8906 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.607640  8902 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:18.610824  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1480) took 1093 ms. Trace:
I20260709 12:10:18.611477  8753 rpcz_store.cc:276] 0709 12:10:17.517230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.426555 (+909325us) service_pool.cc:224] Handling call
0709 12:10:18.426888 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.564221 (+137333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.610471 (+ 46250us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001a18d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:18.610734 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294780160}
I20260709 12:10:18.618043  9519 raft_consensus.cc:2368] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
W20260709 12:10:18.618217 10695 consensus_meta.cc:287] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.004s
I20260709 12:10:18.618754 10695 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.619505  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.620908 10659 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:18.622284 10391 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.618758 10566 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.623543 10731 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:18.620934 10603 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.624816 10603 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:18.625491 10581 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:18.625911 10603 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:18.630079  8798 leader_election.cc:336] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.812s (SENT)
W20260709 12:10:18.631384  8798 leader_election.cc:336] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.836s (SENT)
I20260709 12:10:18.634083  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.634874  8754 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.627177  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.636750  8759 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.599617 10385 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.639195 10385 raft_consensus.cc:697] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:18.640360 10385 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.641191  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.620353  8830 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.642124 10419 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.553843 10702 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:18.622727 10695 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:18.632387  8798 leader_election.cc:336] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.855s (SENT)
I20260709 12:10:18.668018  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.673810  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:18.675300  8900 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.563295  8901 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:18.667121  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.667250  8909 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.675414  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:18.593321 10491 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.678232  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:18.679083  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.651425  8759 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.683104  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.698449  8902 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.698633  8760 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.679965  8875 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:18.686497  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 81586us
I20260709 12:10:18.684370 10689 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.667542 10702 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.703624  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 105289us
I20260709 12:10:18.622370 10659 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 12:10:18.693801  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61430.6us
I20260709 12:10:18.687918  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.698626  8905 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.667217 10419 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.565738 10706 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.711630  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.711916  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.712622  8826 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:18.715279  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.715540  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:18.716358  8834 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:18.716460  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:18.717111  8826 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.725204  8826 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.727551  8905 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:18.729658  9525 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.676064 10452 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:18.731613 10734 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.745421  8752 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.742578  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:18.702848 10481 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:18.748656  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44685.8us
W20260709 12:10:18.751515  8798 leader_election.cc:336] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.871s (SENT)
I20260709 12:10:18.751365  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.751931  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:18.745890  8752 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:18.753510 10324 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.754433  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:18.730020 10419 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.756886 10734 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.761214  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:18.705202  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:18.767547  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:18.784276  8798 leader_election.cc:336] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.937s (SENT)
I20260709 12:10:18.784691  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.785548 10456 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:18.785916  8798 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.980s (SENT)
W20260709 12:10:18.786868  8798 leader_election.cc:336] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.088s (SENT)
I20260709 12:10:18.770131  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.771019  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.789009  8758 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:18.769340  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.789849  8751 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:18.774106  8903 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.761229 10563 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:18.779762 10697 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.801584  8831 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.779466  8799 leader_election.cc:400] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:18.781410  9517 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:18.782538  8754 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.782687 10734 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:18.784830 10566 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.773007  8752 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:18.792178  9525 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:18.793644  8902 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:18.795949  8827 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
W20260709 12:10:18.832934  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53628.2us
I20260709 12:10:18.797334  8875 leader_election.cc:400] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:18.833731  8875 leader_election.cc:403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:18.780382 10689 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:18.815497  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 63707.7us
I20260709 12:10:18.815582  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:18.839171  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52319.5us
W20260709 12:10:18.839993  8798 leader_election.cc:336] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.133s (SENT)
W20260709 12:10:18.841001  8798 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.165s (SENT)
I20260709 12:10:18.841369  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:18.817709  8830 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
W20260709 12:10:18.821185  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.786823 10481 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:18.845407  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:18.752166 10731 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.813510  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:18.847026  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:18.848038  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 110373us
I20260709 12:10:18.848505  8757 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:18.822345 10423 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.821995 10324 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:18.831152 10730 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:18.849905 10698 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.848920 10734 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.871670  8830 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.869866 10456 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.868381 10731 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.876133  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:18.882140  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:18.885679  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:18.862648 10563 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.884321  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:18.891052  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.890949  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:18.860868 10622 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3.
I20260709 12:10:18.887612  8752 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.894690  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 105486us
I20260709 12:10:18.892001  8908 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
W20260709 12:10:18.933168  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91054.8us
I20260709 12:10:18.934702  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:18.936894  8909 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:18.933488  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 92505.3us
I20260709 12:10:18.883347 10698 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.894423 10636 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.888324 10734 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:18.901005 10452 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:18.947192  8798 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.196s (SENT)
I20260709 12:10:18.901648 10456 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.955905  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 73905.9us
I20260709 12:10:18.961135  8799 leader_election.cc:400] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:18.961472  8799 leader_election.cc:403] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:18.871099 10730 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.968963  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:18.976675  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.967700 10689 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.987588  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:18.988546  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.965824 10423 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.973242 10563 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:19.002367  8798 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.206s (SENT)
I20260709 12:10:19.003628 10456 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:19.004742 10456 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:19.004828 10391 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.005189 10456 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:19.005396 10391 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:18.970345 10748 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:10:18.974033 10583 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:18.962186 10481 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:18.978847 10697 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:10:18.964972 10324 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:19.054579  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52259.2us
I20260709 12:10:18.976918 10731 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.026489 10452 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:19.023221 10419 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.056224 10754 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:19.074182  8798 leader_election.cc:336] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.210s (SENT)
I20260709 12:10:19.074407  8726 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:19.068401 10740 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:10:19.022686 10698 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.093199 10748 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:19.095407 10746 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:10:19.066913 10456 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:19.098039 10456 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:19.097213 10752 log.cc:927] Time spent T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:10:19.075830 10754 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.064508 10702 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.041085 10734 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.109892  8906 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:19.110949  8798 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.244s (SENT)
I20260709 12:10:19.140920  9523 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:19.142359  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 197492us
I20260709 12:10:19.106194 10754 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.113718 10636 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:19.154256  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:19.081938 10391 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.155150  8906 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:19.147121 10730 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:19.164340  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 176284us
W20260709 12:10:19.208035  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44634us
W20260709 12:10:19.211323  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.212292  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:19.217047  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:19.217599  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.221096  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:19.234046  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.291311  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 356647us
I20260709 12:10:19.223563 10385 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.299053  9525 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:19.235147 10745 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 12:10:19.229525 10706 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.308527  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.325822  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:19.325908  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:19.326048  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:19.330557  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 103950us
I20260709 12:10:19.326941  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:19.331455  8833 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.159593 10452 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:19.334213  8751 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.335928  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:19.307855 10761 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.359964  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.220758 10772 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:10:19.328054 10731 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.329172 10385 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.371418  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:19.413462  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 53075.9us
I20260709 12:10:19.415237  8827 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:19.444909  8758 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.422425  8760 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:19.418237  8752 consensus_meta.cc:287] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
W20260709 12:10:19.361881 10750 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:10:19.446228  8752 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:19.448382  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.451731  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139055us
W20260709 12:10:19.467391 10491 consensus_meta.cc:287] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.760s	user 0.000s	sys 0.013s
I20260709 12:10:19.479840  8835 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:19.492223  8758 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:19.454746 10385 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.455631 10760 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.459446 10731 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:19.339738 10636 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.480569 10702 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:19.529080  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.442242 10761 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:19.558871  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 117360us
W20260709 12:10:19.561698  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 116108us
I20260709 12:10:19.527691 10731 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.566220  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:19.503461 10491 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:19.574172  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 97332.8us
I20260709 12:10:19.575309  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:19.580183  8799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.025s
W20260709 12:10:19.592525  8799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.025s
W20260709 12:10:19.591979  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.593295  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 547422us
I20260709 12:10:19.597527 10768 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
W20260709 12:10:19.609627 10775 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:10:19.619594  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.630910  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64784.5us
W20260709 12:10:19.668156  8798 connection.cc:256] RPC call timeout handler was delayed by -1.5637832710001476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:10:19.740952  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 165738us
W20260709 12:10:19.742887 10765 log.cc:927] Time spent T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
W20260709 12:10:19.771389  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.775970 10776 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 12:10:19.737283 10788 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:10:19.853936  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.829990 10324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.051s	sys 0.071s
I20260709 12:10:19.855152  8751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:19.865007  8751 raft_consensus.cc:606] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:19.865458  8751 raft_consensus.cc:614] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:19.867159  8798 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.140s (SENT)
W20260709 12:10:19.867769  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.860895 10747 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.180s	user 0.005s	sys 0.003s
W20260709 12:10:19.887370  8833 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.001s
I20260709 12:10:19.887969  8833 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:19.890767  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.859473 10731 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:19.859720 10385 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:19.640316 10563 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:10:19.877646 10324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.053s	sys 0.073s
I20260709 12:10:19.856647 10761 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:19.887480  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 254950us
W20260709 12:10:19.960677 10785 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:10:19.892230 10772 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:19.994997  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 127889us
I20260709 12:10:19.984655 10491 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:19.985468 10481 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.961792 10603 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:10:20.014652  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:20.044883  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.048529  8798 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.247s (SENT)
W20260709 12:10:20.014333 10754 consensus_meta.cc:287] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.004s
W20260709 12:10:20.118183  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.060231  8906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.024s	sys 0.066s
W20260709 12:10:20.119098  8906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.026s	sys 0.073s
W20260709 12:10:20.081962  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.119786  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.123216  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68867.6us
I20260709 12:10:20.146531 10563 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:20.148753  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 188958us
I20260709 12:10:20.044394  9517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35686 (request call id 373) took 1334 ms. Trace:
I20260709 12:10:20.054327  8754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:20.154088  8754 raft_consensus.cc:606] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.154636  8754 raft_consensus.cc:614] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:20.154852 10603 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.156078  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.156930  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 297) took 1008 ms. Trace:
I20260709 12:10:20.152451  9517 rpcz_store.cc:276] 0709 12:10:18.704824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.729912 (+ 25088us) service_pool.cc:224] Handling call
0709 12:10:20.028074 (+1298162us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b5400520b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:20.036107 (+  8033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15382272}
I20260709 12:10:20.157320  8759 rpcz_store.cc:276] 0709 12:10:19.148127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.148253 (+   126us) service_pool.cc:224] Handling call
0709 12:10:19.155779 (+  7526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.226810 (+ 71031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.226888 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.239834 (+ 12946us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.780855 (+541021us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.780914 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.781030 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.156695 (+375665us) raft_consensus.cc:1685] finished
0709 12:10:20.156717 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.156866 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52929,"raft.queue_time_us":171795,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7876,"thread_start_us":422008,"threads_started":1,"wal-append.queue_time_us":707749}
W20260709 12:10:20.159374 10798 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:10:20.159488  8875 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:20.121212 10754 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.160643 10760 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.161069 10760 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.161456 10760 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.162038  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 295) took 1028 ms. Trace:
I20260709 12:10:20.053653 10324 raft_consensus.cc:2764] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:20.092469 10772 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:20.118147 10491 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.172993  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 131790us
I20260709 12:10:20.162477  8755 rpcz_store.cc:276] 0709 12:10:19.134101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.139702 (+  5601us) service_pool.cc:224] Handling call
0709 12:10:19.151069 (+ 11367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:19.217846 (+ 66777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.217877 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:19.226309 (+  8432us) log.cc:844] Serialized 52 byte log entry
0709 12:10:19.553892 (+327583us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:19.686342 (+132450us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.686791 (+   449us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.870840 (+184049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.870952 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.161773 (+290821us) raft_consensus.cc:1685] finished
0709 12:10:20.161795 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.161969 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16822,"prepare.queue_time_us":772484,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":366024,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":142576,"spinlock_wait_cycles":16989824,"thread_start_us":310135,"threads_started":2,"wal-append.queue_time_us":340225}
I20260709 12:10:20.191044  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.148240 10761 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.043156 10481 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.149272 10385 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.169966 10603 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.174230 10563 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:20.230247  8798 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.249s (SENT)
I20260709 12:10:20.231112 10754 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:20.218266 10689 consensus_meta.cc:287] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 1.227s	user 0.019s	sys 0.009s
I20260709 12:10:20.239208  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.189697 10491 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.219467  9519 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.220503 10324 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:20.237259 10456 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 1.139s	user 0.017s	sys 0.003s
I20260709 12:10:20.207468 10761 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.232538  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:20.256485  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.268261  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.257680 10795 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:10:20.258234 10603 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.258985 10804 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:20.259413  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.261348 10756 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:20.264529  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 54530.5us
I20260709 12:10:20.268424  8831 raft_consensus.cc:2410] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.242617 10689 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:20.271872 10756 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:20.272953  8798 leader_election.cc:336] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.261s (SENT)
I20260709 12:10:20.275331  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.252233 10731 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.278348 10481 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.262316 10772 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.245285 10796 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.287191  8798 connection.cc:256] RPC call timeout handler was delayed by -1.4764832710000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:10:20.287835  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.288051 10756 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.280445 10761 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.288153 10481 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:20.270888 10324 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.291224  8832 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.294196 10563 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:20.282274  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.288228  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.306821 10491 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:20.315901  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.307286 10759 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.316860 10759 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:20.318275 10759 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.320175 10759 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.308717  8754 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:20.303201 10603 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.325075 10603 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.324836 10385 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.325717 10603 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.329900  8829 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.330852 10581 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:20.333076  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.335022  8798 connection.cc:256] RPC call timeout handler was delayed by -1.226856855999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4122s for a response
I20260709 12:10:20.337695  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 409) took 1756 ms. Trace:
I20260709 12:10:20.338994  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 303) took 1005 ms. Trace:
I20260709 12:10:20.339583  8828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 227) took 1175 ms. Trace:
I20260709 12:10:20.340839  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 1757) took 1240 ms. Trace:
I20260709 12:10:20.283245 10770 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.359537  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1756) took 1212 ms. Trace:
I20260709 12:10:20.340001 10796 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:20.363646  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.365345 10385 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.366604 10324 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:20.370422  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.372915 10563 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.374459  9525 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:20.386148  8798 connection.cc:256] RPC call timeout handler was delayed by -1.18375641800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2948s for a response
I20260709 12:10:20.387719  8831 rpcz_store.cc:276] 0709 12:10:19.100424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.100568 (+   144us) service_pool.cc:224] Handling call
0709 12:10:20.340558 (+1239990us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003f34d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:20.340746 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160454016}
I20260709 12:10:20.386544  9523 rpcz_store.cc:276] 0709 12:10:18.580868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.584733 (+  3865us) service_pool.cc:224] Handling call
0709 12:10:18.585083 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.142933 (+557850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.337267 (+1194334us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400600254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:20.337574 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277616512}
I20260709 12:10:20.386600  8760 rpcz_store.cc:276] 0709 12:10:19.333370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.339837 (+  6467us) service_pool.cc:224] Handling call
0709 12:10:19.370891 (+ 31054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.445575 (+ 74684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.338727 (+893152us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b5400311ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:20.338920 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102723968}
I20260709 12:10:20.386723  8828 rpcz_store.cc:276] 0709 12:10:19.164065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.164245 (+   180us) service_pool.cc:224] Handling call
0709 12:10:20.338685 (+1174440us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5800140498. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:20.338903 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.339159 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.339207 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.339260 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.339293 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.339368 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.339491 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9933696}
I20260709 12:10:20.389423  8832 rpcz_store.cc:276] 0709 12:10:19.100066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.100214 (+   148us) service_pool.cc:224] Handling call
0709 12:10:20.290907 (+1190693us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800140498. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ef8c 00007fce3501eef6 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:20.291046 (+   139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.311860 (+ 20814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.312080 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4657664}
W20260709 12:10:20.401127  8798 connection.cc:256] RPC call timeout handler was delayed by -1.0723832710000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:10:20.402269  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.400739 10385 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.403539 10583 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:20.404762  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.397929  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 294) took 1713 ms. Trace:
I20260709 12:10:20.405792 10796 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.283500 10804 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:20.416996  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.423588  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.423796  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.434178 10771 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.434965 10771 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.443773 10771 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:20.444783  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.445245 10761 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.445992 10761 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.453701 10767 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.437235 10481 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.426851 10796 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.440971 10768 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.473793 10385 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.419780  8753 rpcz_store.cc:276] 0709 12:10:18.680882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.957220 (+276338us) service_pool.cc:224] Handling call
0709 12:10:18.983546 (+ 26326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.160476 (+176930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.164217 (+  3741us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.319686 (+155469us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.675477 (+355791us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:19.683449 (+  7972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.704722 (+ 21273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.347388 (+642666us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b240012beb8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34edc9c4 00007fce34edaacb 00007fce35095dc9 00007fce35095a55 00007fce35094fb0 00007fce37d0b488 00007fce37d0bbe8 00007fce37ce3398 00007fce37cde76a 00007fce37cddbb6
0709 12:10:20.368225 (+ 20837us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b180039c220. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:10:20.382331 (+ 14106us) raft_consensus.cc:1685] finished
0709 12:10:20.383369 (+  1038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.389486 (+  6117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114416,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":12078,"spinlock_wait_cycles":13863936,"thread_start_us":214845,"threads_started":2,"wal-append.queue_time_us":493151}
I20260709 12:10:20.475165 10768 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:20.476876  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.454500 10767 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.456188 10491 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.470717 10764 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.501926 10779 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.503527 10804 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.504310 10796 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.528815 10761 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.510218 10491 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.530191 10603 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.535965 10491 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.539207  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.540314 10761 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.541061 10761 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.541826  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.543883  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.544693  8757 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:20.546195  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.546941  8757 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:20.463140 10481 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.507681 10385 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.552337  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.557147 10419 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.557999 10803 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.558714 10803 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.559682  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1608) took 1230 ms. Trace:
I20260709 12:10:20.565361 10481 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.566046 10767 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:20.566259  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.566100  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1873) took 1346 ms. Trace:
I20260709 12:10:20.567095  8906 rpcz_store.cc:276] 0709 12:10:19.215133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.215260 (+   127us) service_pool.cc:224] Handling call
0709 12:10:19.224068 (+  8808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.130895 (+906827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.150123 (+ 19228us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.195001 (+ 44878us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.281753 (+ 86752us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.281808 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.282510 (+   702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.561132 (+278622us) raft_consensus.cc:1685] finished
0709 12:10:20.561153 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.561309 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74467,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":18958,"thread_start_us":937543,"threads_started":2,"wal-append.queue_time_us":176317}
I20260709 12:10:20.569712 10768 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.562143 10796 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.556512 10760 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.570845 10796 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.525892 10779 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.573765  9523 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.573853  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:20.575899  9519 raft_consensus.cc:2393] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:20.523841 10764 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.579694 10796 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:20.603721  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 223850us
I20260709 12:10:20.655875 10770 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:20.657310 10770 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.659818 10770 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:20.660727  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 83225.3us
W20260709 12:10:20.661065  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.580889  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:20.607321  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.666044  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 63756.7us
I20260709 12:10:20.560259  8829 rpcz_store.cc:276] 0709 12:10:19.329529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.470633 (+141104us) service_pool.cc:224] Handling call
0709 12:10:19.479862 (+  9229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.330486 (+850624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.559305 (+228819us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540037c154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:20.559590 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879374592}
I20260709 12:10:20.666505  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.543875 10761 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.664762 10423 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:20.669705  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.669802 10820 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.669890  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.667928 10796 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.671125 10796 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.673303 10796 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:20.667707 10770 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.665161 10603 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.674247 10770 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.675868  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:20.580391 10760 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:20.677454  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.577832 10779 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.603487 10803 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:20.677918  8798 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:43816 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:20.679772  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:20.685159  8902 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:20.686610  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:20.686950  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 124162us
I20260709 12:10:20.685920  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.689545  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.690723  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.691859  8908 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.577171 10385 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.693502  8906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:20.694522  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:20.694211  8907 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:20.695299  8903 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.697510  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.698395  8909 raft_consensus.cc:2410] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:20.680682 10796 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.680052 10603 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:20.694257  8906 raft_consensus.cc:606] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.701866  8902 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.705248  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.687698 10760 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.713742  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.715879  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.741926  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.743045  8904 raft_consensus.cc:2410] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.708560 10814 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.744100  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.744606  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 67509us
I20260709 12:10:20.704839 10821 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.747105  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.701226 10823 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.748443  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.757763  8902 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:20.755133 10770 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:20.752751 10823 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:20.724831 10603 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.753777  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.730173 10759 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.744457  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.766103  8907 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:20.750174  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.770881  8901 raft_consensus.cc:2410] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:20.762730  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51324.2us
I20260709 12:10:20.774363 10778 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:20.775164  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:20.775861  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.777084  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.769294 10814 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.777973 10814 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.765331 10748 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:20.780179 10385 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:20.781256 10764 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.781760 10814 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:20.800240  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.801337  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 93215.3us
I20260709 12:10:20.783082 10481 raft_consensus.cc:2764] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:20.808782  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.818595  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.820289  8760 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.765224 10823 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.823743  8906 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:20.827663  8827 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:20.827736  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.829048  8833 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:20.830616  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.830870  8830 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.831679  8833 raft_consensus.cc:2410] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.834751  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.835893  8835 raft_consensus.cc:2410] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.839432  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.797382 10805 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.847705  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.847937  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.843569  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:20.849326  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 99300.6us
I20260709 12:10:20.850350  8758 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.844238  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.851567  8759 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:20.852800  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.853561  8832 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.853405  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:20.762017 10804 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:20.849563  8834 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:20.842213  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.797323 10759 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.847937  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.845359 10796 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:20.855785  9523 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.895691  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.839541 10791 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:20.855396  8725 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:20.843624 10814 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.889564  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.891966  8754 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:20.842190 10809 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:20.892881  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.914099  8831 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.915593  8835 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:20.824219 10491 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.893797  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.815671 10770 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:20.857542  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.924161  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.855594 10566 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:20.916548  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.921068  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:20.924544  8906 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:20.859802  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.963266  8758 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:20.963754  8830 raft_consensus.cc:2410] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.893482  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:20.925729  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.928586  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.931412  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.933979  8833 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:20.938421 10603 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:20.938513 10697 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.934914 10809 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.972779  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.973256  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.973424  8830 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:20.907001  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:20.944849  8831 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:20.860487 10821 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:20.927675 10814 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.950256 10481 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.950609  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 105604us
I20260709 12:10:20.853344 10805 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:20.952746  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:20.936209 10566 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.960942  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:20.954747  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:20.990872 10825 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:20.974732 10583 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:20.992293  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 228) took 1780 ms. Trace:
W20260709 12:10:20.971972  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.992826  8826 rpcz_store.cc:276] 0709 12:10:19.211629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.211833 (+   204us) service_pool.cc:224] Handling call
0709 12:10:20.416201 (+1204368us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800140498. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:20.416420 (+   219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.419627 (+  3207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.419655 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.420796 (+  1141us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.677157 (+256361us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180031f540. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:10:20.742017 (+ 64860us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:20.742082 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.742192 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.992053 (+249861us) raft_consensus.cc:1685] finished
0709 12:10:20.992079 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.992228 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3547,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4343,"spinlock_wait_cycles":12001408,"thread_start_us":64503,"threads_started":1,"wal-append.queue_time_us":388643}
I20260709 12:10:20.994201  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:20.994881  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.995576  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.996070  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.996300  8759 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:20.914733 10791 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:20.977216  8831 pending_rounds.cc:85] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 2
I20260709 12:10:20.977977  8754 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 1.
I20260709 12:10:20.978703  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:20.981287  8829 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:20.981444  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 128182us
I20260709 12:10:20.989037  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.969717 10581 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:20.989357  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:20.970963  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.015684  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.014544  8835 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:21.018016  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.019361  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:20.975740  8903 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.989141  8834 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.999468  8826 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:20.997571  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:21.021222  8900 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.016767  8831 pending_rounds.cc:107] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:21.024483  8831 raft_consensus.cc:2889] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.010473  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:21.027040  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:21.032382 10809 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:20.969595 10705 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:21.033200 10809 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:21.033674 10809 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.035405 10764 raft_consensus.cc:3055] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.035692 10809 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.035905 10764 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:21.037463 10814 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.038216  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.058281  8827 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.038487 10759 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.039301  8830 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:21.040431 10791 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:20.988742 10698 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:20.976814 10796 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.043061  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:21.022698  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.046012 10805 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.047626  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.048319 10706 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.089743  8904 raft_consensus.cc:2393] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:21.050557  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:21.013710  8758 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:21.057583  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.094434  8831 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:21.061676  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:21.042398 10324 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.044276  8753 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.066568 10759 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:21.066776 10781 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.083335  8834 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:21.109228  8754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
W20260709 12:10:21.123459  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 161379us
I20260709 12:10:21.070281 10791 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.078212 10809 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.059980 10768 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:21.064791 10452 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:21.057740 10820 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:10:21.067301 10491 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:10:21.137912  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 90411.2us
I20260709 12:10:21.110647 10423 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.106086 10566 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:21.105360 10324 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:21.149114  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 252066us
I20260709 12:10:21.125300 10748 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.154301 10835 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:21.154543  8903 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.126168 10781 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:21.213181  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 64590.7us
I20260709 12:10:21.184783 10423 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.155016 10835 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.258221  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:21.259219 10452 raft_consensus.cc:2764] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:21.260768  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.262625  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:21.263806  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.264475 10481 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.265224 10481 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.265620 10481 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:21.265993 10481 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.266214  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.267328 10823 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:21.268714  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.268805 10748 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.260407 10835 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:21.269619 10748 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.257773 10423 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:21.267382  8725 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:21.275161 10491 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.275549 10491 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:21.275905 10491 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.282177 10823 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:21.287623  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:21.190764 10812 log.cc:927] Time spent T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:10:21.302423  8907 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.302943 10768 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:21.315963  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.253521 10324 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.191965 10842 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.181958 10805 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:21.191812 10606 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.135541 10791 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.154870 10603 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:21.361109  8907 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:21.336383  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 114581us
W20260709 12:10:21.360941  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73468.6us
I20260709 12:10:21.423313  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:21.424897 10606 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.426949 10820 raft_consensus.cc:2764] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:21.427481 10606 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:21.433931  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:21.437678  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55899.7us
I20260709 12:10:21.418226 10603 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.441425 10848 raft_consensus.cc:2764] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:21.423975 10805 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.424180 10842 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.458014  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:21.462929 10764 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.470103 10603 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:21.483183  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 60174.4us
I20260709 12:10:21.464490 10764 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.482411 10768 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.517823  8751 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:21.522464  8799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.028s
W20260709 12:10:21.523640  8799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.013s	sys 0.028s
W20260709 12:10:21.524075  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 510203us
W20260709 12:10:21.524902  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 70298.6us
W20260709 12:10:21.530277  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.471326 10481 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:21.531072  8799 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.193s (SENT)
I20260709 12:10:21.532148  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:21.537483  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.480372 10705 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:21.512405 10781 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:21.579061  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 71541.6us
I20260709 12:10:21.546054  8751 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.534437 10768 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:21.547151 10566 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.594899  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 69142.3us
I20260709 12:10:21.551118  8753 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:21.632794  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:21.655691  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52359.5us
W20260709 12:10:21.667834  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 57965.5us
I20260709 12:10:21.668959  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:21.610993 10804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.003s	sys 0.015s
I20260709 12:10:21.604905 10791 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.601447 10734 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:21.601919 10771 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:21.603014 10566 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:21.675631 10804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.004s	sys 0.015s
W20260709 12:10:21.678130 10831 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:10:21.673300 10748 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.688401 10689 raft_consensus.cc:2764] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:21.712239  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.729682  8831 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:21.717885 10851 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:10:21.718827 10860 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:10:21.719373 10805 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:21.720388 10853 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:10:21.731973  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.759840 10324 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.736146 10748 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:21.763446  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 165886us
I20260709 12:10:21.764779  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:21.765517  8827 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:21.766625 10705 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.739755 10842 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:21.768573  8827 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.769529  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:21.781965  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 76112.6us
I20260709 12:10:21.706460 10768 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:21.805738  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 136878us
I20260709 12:10:21.806502  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.784649  8901 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.779711 10796 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.830579 10796 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.837421  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:21.829537 10857 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:10:21.825449 10805 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.858378  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.828418  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.827247 10481 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.864071  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.865357 10758 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.854708 10796 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:21.872247  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.862128 10748 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.878894  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1480) took 1040 ms. Trace:
I20260709 12:10:21.880553  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:21.883661 10858 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:10:21.884248 10872 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:10:21.885154 10864 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:21.880331  8759 rpcz_store.cc:276] 0709 12:10:20.838947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.998814 (+159867us) service_pool.cc:224] Handling call
0709 12:10:20.999222 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.999704 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.999744 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.000338 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.439411 (+439073us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18004597c0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:10:21.622783 (+183372us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.700479 (+ 77696us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.873044 (+172565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.873142 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.873198 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:21.878155 (+  4957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.878796 (+   641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95773,"prepare.queue_time_us":86847,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":99846,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":16406,"spinlock_wait_cycles":3381632,"thread_start_us":354966,"threads_started":2,"wal-append.queue_time_us":738081}
W20260709 12:10:21.889010 10868 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:21.890630 10804 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.892764 10804 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.895269 10804 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:21.896529 10791 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.897477 10855 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.898689 10791 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:21.898418 10855 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.901049 10791 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:21.903406 10855 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.903962 10791 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:21.905242  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:21.905653 10863 log.cc:927] Time spent T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:10:21.906172 10855 raft_consensus.cc:2764] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:21.907160  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1466) took 1104 ms. Trace:
I20260709 12:10:21.907495 10855 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:21.908492 10849 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:21.909104 10849 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:21.910440 10849 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.912421 10849 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.914485 10481 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:21.915620 10878 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.866858 10805 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:21.925642 10491 consensus_meta.cc:287] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 12:10:21.879066 10324 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:21.878715 10566 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:21.907523  8902 rpcz_store.cc:276] 0709 12:10:20.802807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.803085 (+   278us) service_pool.cc:224] Handling call
0709 12:10:20.822241 (+ 19156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.130611 (+308370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.137355 (+  6744us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.226576 (+ 89221us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.487456 (+260880us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.515284 (+ 27828us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.515554 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.515804 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.906960 (+391156us) raft_consensus.cc:1685] finished
0709 12:10:21.906987 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.907103 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14345,"prepare.queue_time_us":28686,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2778,"raft.queue_time_us":93855,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":27229,"spinlock_wait_cycles":25077504,"thread_start_us":518151,"threads_started":2,"wal-append.queue_time_us":343290}
I20260709 12:10:21.923252 10855 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:21.957404  8872 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:21.947495 10758 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.935266 10491 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.958045 10855 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:21.962826 10324 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.995486  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:21.997438  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:21.998219  8872 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:21.999485  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:21.999552 10796 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.999974 10842 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.000233 10796 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:21.999652 10391 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.003055 10781 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.001845 10842 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.005834 10842 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:21.995893 10324 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:22.001566 10796 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.018788 10324 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.019040  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:22.011416 10491 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:22.026286  8755 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:22.015058  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.027323 10827 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.029903 10761 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.030525 10761 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.033007  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.037638  8872 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.040151  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.044035  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.044111 10805 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:22.046949  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:22.048858  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.051465  9517 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.055980 10827 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.057541  8831 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:22.062158  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.065709  8760 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.067207  8753 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:22.068560 10885 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:22.071439  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1625) took 1131 ms. Trace:
I20260709 12:10:22.073709  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 301) took 1103 ms. Trace:
I20260709 12:10:22.074163  8901 rpcz_store.cc:276] 0709 12:10:20.970469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.028255 (+ 57786us) service_pool.cc:224] Handling call
0709 12:10:21.044661 (+ 16406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.832068 (+787407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.073418 (+241350us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54000b3e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:22.073634 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649773440}
I20260709 12:10:22.076930  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 240) took 1129 ms. Trace:
I20260709 12:10:22.077387  8835 rpcz_store.cc:276] 0709 12:10:20.947079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.113924 (+166845us) service_pool.cc:224] Handling call
0709 12:10:22.075317 (+961393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.075560 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.075590 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.075645 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.075681 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.075749 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.076715 (+   966us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540038a4d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:22.076856 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209724288}
I20260709 12:10:22.080242  9489 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:22.083850 10659 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.084306 10659 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.084683 10659 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.071960  8830 rpcz_store.cc:276] 0709 12:10:20.940247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.988768 (+ 48521us) service_pool.cc:224] Handling call
0709 12:10:22.071215 (+1082447us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b540038a4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:22.071364 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58093440}
I20260709 12:10:22.039394  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:22.087953  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48693.4us
W20260709 12:10:22.088467  9488 connection.cc:256] RPC call timeout handler was delayed by -1.0306394799997634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 12:10:22.088724  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.091087  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.092111  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.099050 10821 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:22.101475 10821 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:22.100622  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.101909 10821 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.103871  8901 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.104455  8901 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.099208 10835 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.106104 10838 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.106431 10835 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:22.106683 10838 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:22.106770 10779 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.107435  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.109839 10835 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.113302 10796 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.100697 10324 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.123857 10324 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.147073  8757 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:22.151836  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 307) took 1941 ms. Trace:
I20260709 12:10:22.152366  8755 rpcz_store.cc:276] 0709 12:10:20.210505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.210794 (+   289us) service_pool.cc:224] Handling call
0709 12:10:20.418430 (+207636us) spinlock_profiling.cc:243] Waited 941 us on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:20.418691 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.026809 (+1608118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.151570 (+124761us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400039dd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:22.151772 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3698369024}
I20260709 12:10:22.157857  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:22.171715  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 56851.7us
I20260709 12:10:22.122646 10759 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:22.179410  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.180186  8755 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:22.209800  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.218751  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.222005  8901 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.222806 10659 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.223436  8901 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.212694 10698 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:22.225296 10698 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.227846 10698 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:22.212741  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.233799  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.239874  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:22.250342 10842 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.251004 10842 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.206887 10891 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:22.256232 10842 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.256876  8754 raft_consensus.cc:606] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.257522  8754 raft_consensus.cc:614] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.263921  8901 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:22.237250 10698 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.233371 10761 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:22.264482  8901 pending_rounds.cc:85] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
W20260709 12:10:22.283298  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 156735us
I20260709 12:10:22.284196  8901 pending_rounds.cc:107] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:22.284590  8901 raft_consensus.cc:2889] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.238348 10782 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.284849  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.287992  9523 raft_consensus.cc:1240] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:22.274201 10780 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:22.301831  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 99922.9us
I20260709 12:10:22.286994 10734 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:10:22.310909  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 222279us
I20260709 12:10:22.303112 10659 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:22.107801 10838 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.305732 10842 consensus_queue.cc:1059] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:22.327649 10891 raft_consensus.cc:3055] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.328154 10891 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.329123 10891 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.306488 10796 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.330559 10891 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.316220 10902 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:22.319010 10904 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.334414  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44250 (request call id 22) took 1225 ms. Trace:
I20260709 12:10:22.334879  8754 rpcz_store.cc:276] 0709 12:10:21.108865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.109045 (+   180us) service_pool.cc:224] Handling call
0709 12:10:22.334196 (+1225151us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000f55d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813d853 00007fce3d10b60a 00007fce366917d4 00007fce36691762 00007fce36691691 00007fce3669160c 00007fce366908c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:22.334318 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610426112}
I20260709 12:10:22.320389 10698 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:22.321286 10899 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:22.313445  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.337559 10835 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.345454 10842 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.345803  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:22.345913 10842 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:22.346505 10842 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.346581 10821 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.347582 10835 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:22.349257 10887 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.337s	user 0.003s	sys 0.000s
I20260709 12:10:22.349557 10835 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.350167 10835 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.351269 10835 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.352641  8754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
W20260709 12:10:22.393793  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 101820us
I20260709 12:10:22.394176  8754 raft_consensus.cc:606] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.394505  8754 raft_consensus.cc:614] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.357167  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:22.379498  8759 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.378521  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58919.6us
W20260709 12:10:22.354570  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 70088us
I20260709 12:10:22.400358  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.393316  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 247) took 1264 ms. Trace:
I20260709 12:10:22.403158  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:22.401335  8829 rpcz_store.cc:276] 0709 12:10:21.129261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.440207 (+310946us) service_pool.cc:224] Handling call
0709 12:10:21.440706 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.446861 (+  6155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.446912 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.454914 (+  8002us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.629070 (+174156us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.679244 (+ 50174us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.686534 (+  7290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.686642 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.390582 (+703940us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800440c20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:10:22.392988 (+  2406us) raft_consensus.cc:1685] finished
0709 12:10:22.393097 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.393252 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6411,"prepare.queue_time_us":54428,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":9000,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":13679,"spinlock_wait_cycles":6162816,"thread_start_us":164838,"threads_started":1,"wal-append.queue_time_us":243489}
W20260709 12:10:22.387435 10841 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.687s	user 0.001s	sys 0.000s
I20260709 12:10:22.356231 10698 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.352602 10697 raft_consensus.cc:3055] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.365448 10821 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.422559  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:22.437420  8907 raft_consensus.cc:2410] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.413793 10759 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.372457 10849 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.433543 10698 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:22.436082 10697 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:22.441397  9518 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.432727  8759 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:22.366096 10842 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:22.456586  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 109581us
W20260709 12:10:22.470075  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 68210.1us
I20260709 12:10:22.454067 10759 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:22.454113 10849 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:22.474002  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:22.482197  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.490026  8754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:44250
I20260709 12:10:22.490767  8754 raft_consensus.cc:606] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.491305  8754 raft_consensus.cc:614] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.472203  9517 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.476583 10759 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.507421  9488 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:22.516126 10842 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.517191  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:22.518376 10849 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.519533 10849 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.505074 10566 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:22.532275  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.477070 10697 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.506951 10758 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:22.538239 10758 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.539041  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:22.543510  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 70766.5us
I20260709 12:10:22.525305 10734 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.545873 10581 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.499051 10909 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:22.583467  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.584117  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.487237 10698 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.584997  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.586283  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.602077  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:22.591635  8725 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 2.137s (SENT) [suppressed 10 similar messages]
I20260709 12:10:22.592700  8831 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:22.605821  8831 pending_rounds.cc:85] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 3
I20260709 12:10:22.603783 10566 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:22.593484  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.594420  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.608192  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.593750  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.608389  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:22.548336 10915 consensus_queue.cc:1175] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:22.603770  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:22.607041 10566 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.587721  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:22.595129  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 512617us
I20260709 12:10:22.606395  8831 pending_rounds.cc:107] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:22.616433  8831 raft_consensus.cc:2889] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.616611  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.615671  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:22.624854  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 50643.1us
I20260709 12:10:22.629969 10697 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.632854  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 168672us
I20260709 12:10:22.634389 10891 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.634753  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.634941 10891 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.636188  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.605930 10758 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:22.595705  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.605687  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:22.647903  8830 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
W20260709 12:10:22.683983 10881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.050s	sys 0.049s
W20260709 12:10:22.791867  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.810142  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 173994us
W20260709 12:10:22.717629  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 101123us
I20260709 12:10:22.811352 10324 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.811864 10324 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.653945 10689 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:22.808162  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:22.815095 10884 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:22.717453  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:22.769650  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 51696.4us
I20260709 12:10:22.681233 10916 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:22.819759 10916 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.821110  8827 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:22.812028  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:22.695448 10770 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.663141 10566 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:22.839154 10324 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.842437 10770 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.806675 10912 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 12:10:22.845777 10912 raft_consensus.cc:3055] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.846177 10912 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.847101 10912 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:22.848261 10855 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:22.848798 10891 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:22.788892 10781 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.802316 10821 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.850646  8905 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.852375  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:22.813997 10881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.052s	sys 0.056s
I20260709 12:10:22.848340 10912 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.877445  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:22.849808 10759 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:22.866739  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:22.863914 10823 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.863453 10821 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:22.771831 10826 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.184s
W20260709 12:10:22.889629  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 298044us
I20260709 12:10:22.876855  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:22.903931  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.916275  8754 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:22.906598  8752 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.917863  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.910229  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.919116  8758 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:22.920022  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.920698  8758 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.910797  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.923457  8760 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.912724  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.925135  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.925805  8751 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.914098  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.870563 10781 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.841069 10689 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:22.929157  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.930946  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.931348  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.943390  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.954727  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.954586  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.955410  8755 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:22.955700  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:22.956449  8756 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.956593 10324 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.957304 10324 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:22.823752 10916 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:22.889650 10821 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.962837  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.968910  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.969079  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.972189  8754 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
W20260709 12:10:22.971386  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.974315  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:22.974956  8754 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:22.969475  8752 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:22.987306  8760 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:22.993662  8751 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:22.970263  8755 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:23.003686  8758 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:22.927915 10781 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.027933  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.028880  8906 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:23.030553  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.005390  8752 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:23.006669  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.032589  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.034052  8758 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:23.009682  8760 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.009119  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.009938  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.011415  8657 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.012260  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 16a04653cca743d0966d20df2225c35d with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43806
I20260709 12:10:23.013017  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.035727  8909 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:23.017474 10920 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 12:10:23.015549  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:23.020509 10921 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:23.033926  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.014675  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 230) took 5898 ms. Trace:
I20260709 12:10:23.036890  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.002629 10324 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.041673  8905 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.041100  8751 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:23.047590  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.052609  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.039690  8657 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.001708  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.056406  8909 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.053476  8906 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:23.057731  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.073168  8908 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:23.038762 10697 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.028501 10781 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.078320  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.097208  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.040839  8656 rpcz_store.cc:276] 0709 12:10:17.116831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.117054 (+   223us) service_pool.cc:224] Handling call
0709 12:10:23.014583 (+5897529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:18.708594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:18.709308 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:18.709361 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:10:18.709394 (+    33us) tablet.cc:662] Decoding operations
0709 12:10:18.713744 (+  4350us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:18.722321 (+  8577us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:18.722352 (+    31us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:10:18.725289 (+  2937us) tablet.cc:701] Row locks acquired
0709 12:10:18.725346 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:10:18.725513 (+   167us) write_op.cc:270] Start()
0709 12:10:18.725671 (+   158us) write_op.cc:276] Timestamp: P: 1783599018725445 usec, L: 0
0709 12:10:18.725690 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:18.726460 (+   770us) log.cc:844] Serialized 7899 byte log entry
0709 12:10:20.310538 (+1584078us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b54002fc720. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380c1343 00007fce380c4d75 00007fce380c4d09 00007fce380c4c99 00007fce380c4c61 00007fce380c3f5d 0000000000388634 0000000000388479 00007fce35056475 00007fce350587c1
0709 12:10:20.310878 (+   340us) op_driver.cc:464] REPLICATION: finished
0709 12:10:20.470595 (+159717us) write_op.cc:301] APPLY: starting
0709 12:10:20.495462 (+ 24867us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:20.566896 (+ 71434us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:20.566954 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.659107 (+ 92153us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.659554 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:10:20.659607 (+    53us) write_op.cc:312] APPLY: finished
0709 12:10:20.660114 (+   507us) log.cc:844] Serialized 139 byte log entry
0709 12:10:20.700650 (+ 40536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.705003 (+  4353us) write_op.cc:454] Released schema lock
0709 12:10:20.705097 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.708369 (+  3272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.712275 (+  3906us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":159244,"apply.run_cpu_time_us":21189,"apply.run_wall_time_us":237769,"num_ops":20,"prepare.queue_time_us":77017,"prepare.run_cpu_time_us":6510,"prepare.run_wall_time_us":87897,"raft.queue_time_us":415816,"raft.run_cpu_time_us":33894,"raft.run_wall_time_us":1033090,"replication_time_us":1585007,"spinlock_wait_cycles":9046400,"thread_start_us":455935,"threads_started":5,"wal-append.queue_time_us":255811,"wal-append.run_cpu_time_us":58458,"wal-append.run_wall_time_us":2354946}]]}
I20260709 12:10:23.101002  8905 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:23.056282  8657 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.141664  8657 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.164708  8908 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.167383  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.170567  8905 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.166378  8657 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.168571  8752 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:23.175410  8657 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 2 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.178958  8657 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 3, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.181102  8657 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 4, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.184137  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:23.130978 10697 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:23.186414 10697 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:23.196564  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.179183  8753 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 2: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:23.168817 10827 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:23.227401  8832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.017s	sys 0.057s
W20260709 12:10:23.228053  8832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.017s	sys 0.057s
W20260709 12:10:23.266613  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 493695us
W20260709 12:10:23.268883  8907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.015s	sys 0.011s
W20260709 12:10:23.269346  8907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.015s	sys 0.011s
W20260709 12:10:23.271265  8902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.003s	sys 0.022s
I20260709 12:10:23.272241  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:23.264317  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 452214us
I20260709 12:10:23.275769  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.281028  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.298852  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.273309 10759 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:23.325022  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:23.328361  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:23.337543  8756 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:23.338374  8751 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:23.343299  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:23.286408 10706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.010s
I20260709 12:10:23.323371  8904 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.224009 10827 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:23.358870 10827 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:23.346592  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.366968  8908 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:23.350952  8756 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:23.349887 10804 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.355515  8900 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:23.373826  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.332096 10821 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:23.348161 10706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.007s	sys 0.011s
I20260709 12:10:23.391206  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:23.401338  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.404522  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:23.413609  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:23.393234  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:23.415897  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:23.421036  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.418040  8901 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.420565  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.427109  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:23.429204  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:23.383046 10804 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.411128  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:23.438933  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:23.447925  8830 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:23.417546 10927 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.413654 10915 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:23.425669 10910 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.433426 10805 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.439064 10566 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:23.436604 10697 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.450976  9519 raft_consensus.cc:2393] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:23.487262  8724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.023s	sys 0.018s
W20260709 12:10:23.490059  8724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.024s	sys 0.018s
I20260709 12:10:23.477247 10759 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.436188 10933 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:10:23.449716 10855 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:23.449033 10916 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:23.480176 10697 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.478344 10566 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.483901 10915 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.534291 10759 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:23.536497 10835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.016s	sys 0.048s
I20260709 12:10:23.549120  8726 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:23.567835  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 274205us
W20260709 12:10:23.569882  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.472452 10927 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.576061  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.546835 10706 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.547731 10697 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.489827 10781 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.549104 10566 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:23.566919 10835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.017s	sys 0.048s
I20260709 12:10:23.552785 10759 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.549803 10915 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:23.606909 10938 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.607208 10870 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.607790 10870 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:23.607683 10938 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:23.609089 10870 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.610693 10870 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.610729 10938 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:23.611572 10938 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:23.613360 10928 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:10:23.627988 10698 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.635246  8905 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 4. Ops: []
W20260709 12:10:23.631064 10923 log.cc:927] Time spent T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:10:23.635268 10821 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:23.641731  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1787) took 1042 ms. Trace:
I20260709 12:10:23.598424 10706 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.642233  8832 rpcz_store.cc:276] 0709 12:10:22.599544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.610113 (+ 10569us) service_pool.cc:224] Handling call
0709 12:10:22.610475 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:22.610868 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.610893 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:22.611513 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 12:10:23.257322 (+645809us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.485487 (+228165us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.495348 (+  9861us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.534923 (+ 39575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.535035 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.641466 (+106431us) raft_consensus.cc:1685] finished
0709 12:10:23.641487 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.641647 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63625,"raft.queue_time_us":134735,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":20455,"thread_start_us":824518,"threads_started":2,"wal-append.queue_time_us":825223}
I20260709 12:10:23.646782 10706 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:23.654361 10927 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:23.667752  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 228870us
I20260709 12:10:23.692993  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.694265  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:23.695261  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.695360  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.644541 10689 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:23.652204 10804 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:23.701385  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48246.2us
I20260709 12:10:23.710634 10781 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:23.712452  8725 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.714998  8725 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.720620  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.727449 10759 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.735301  8725 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.739136  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.716179 10804 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.744359 10791 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.745442 10941 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.751948  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.755192  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.756093 10758 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.756472  8725 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.757447 10758 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:23.757922  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.759266  8725 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.760190 10706 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.761490 10870 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:23.762138 10925 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.538s	user 0.003s	sys 0.000s
I20260709 12:10:23.716904 10934 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.706480 10761 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:23.667317 10915 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:23.779392  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 203457us
I20260709 12:10:23.740713 10938 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.780789  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.742486 10927 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.737339 10935 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.745477 10791 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.768674 10804 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:23.790704  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 347) took 1157 ms. Trace:
I20260709 12:10:23.791297  8759 rpcz_store.cc:276] 0709 12:10:22.633150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.633618 (+   468us) service_pool.cc:224] Handling call
0709 12:10:22.633901 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.634256 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.634286 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.634743 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.915540 (+280797us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.916793 (+  1253us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.287101 (+370308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.287189 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.761496 (+474307us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:23.782439 (+ 20943us) raft_consensus.cc:1685] finished
0709 12:10:23.790403 (+  7964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.790620 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":892,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":522941,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12679,"spinlock_wait_cycles":7845632,"thread_start_us":650467,"threads_started":2,"wal-append.queue_time_us":538948}
I20260709 12:10:23.795977  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.793815 10804 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.789191 10915 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.804596  8799 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:23.814160  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.823544  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.825877  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.826805  8908 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:23.827798  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:23.828506  8903 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:23.828933  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.831928  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:23.800091 10706 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:10:23.846720  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.866945  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:23.871790  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.874311  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:23.876669  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:23.828336 10938 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:23.930943  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 64087.8us
I20260709 12:10:23.871855  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:23.864015 10916 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:23.880707  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.830665 10855 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.833992 10927 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:23.932341  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60593.4us
I20260709 12:10:23.866433 10779 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.936484  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 241157us
I20260709 12:10:23.943475 10942 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.939280 10761 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.944657  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:23.936774  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60082.9us
I20260709 12:10:23.876359 10934 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.945900 10934 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.870591 10948 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.927178 10791 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.948975  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.941318  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 321) took 1417 ms. Trace:
I20260709 12:10:23.944121 10942 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.833961 10931 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.950316 10934 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.983634  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:23.952965  8907 rpcz_store.cc:276] 0709 12:10:22.524225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.524418 (+   193us) service_pool.cc:224] Handling call
0709 12:10:22.537836 (+ 13418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.638688 (+100852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.638719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.639234 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.269780 (+630546us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.270397 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.937333 (+666936us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b180045d300. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287 00007fce3815e208
0709 12:10:23.937520 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.937576 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.937605 (+    29us) raft_consensus.cc:1685] finished
0709 12:10:23.941106 (+  3501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.941256 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107574,"prepare.queue_time_us":174,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":147084,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":19988352,"thread_start_us":630217,"threads_started":1,"wal-append.queue_time_us":741777}
I20260709 12:10:23.927011 10949 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:23.992964  8826 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:23.985494  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:23.989924 10697 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:23.982333  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:23.984472  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:23.993824  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.994057  8832 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:23.873823 10940 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:23.995106  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 46353.8us
I20260709 12:10:23.935087 10938 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:23.952807 10927 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:23.971988 10758 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.960469 10826 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.976473 10942 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.958133 10952 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:24.010622  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 727960us
I20260709 12:10:23.972958 10954 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.991127 10855 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.995620 10940 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.995483 10791 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:23.972471 10916 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:10:24.044469  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 50747.8us
I20260709 12:10:24.046212  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.047878  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:23.999769 10706 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:23.956146 10779 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.001776 10759 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:24.033608  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 51342.1us
I20260709 12:10:24.038976 10324 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.984368 10931 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.015579 10927 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:24.051224  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 54273.3us
I20260709 12:10:24.051453  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:24.016297 10826 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.030239 10954 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.055181  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.055334 10324 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.060581 10324 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.029347 10949 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.035317 10940 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.062602  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.050793 10948 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.058102  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.054607 10916 consensus_queue.cc:1243] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:24.058981 10826 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.065503 10759 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.058499 10912 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:24.075402 10962 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.075428 10949 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.068569 10955 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.076740 10926 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.077073 10779 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.077185 10957 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:24.078166 10821 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.074182 10948 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.080952 10855 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.054340 10706 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.057765 10791 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:24.083082 10697 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.112111 10838 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.113245 10791 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:24.113735 10791 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.061627 10954 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.087229  8874 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:24.091123 10926 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:24.119103 10324 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.088260 10566 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.093204  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1516) took 1134 ms. Trace:
I20260709 12:10:24.090430 10962 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.094091 10938 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.094570 10910 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.091404 10916 consensus_queue.cc:1059] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:10:24.105209 10950 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:24.029086 10952 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.110090 10855 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.111277 10948 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.099850 10804 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.147557  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1507) took 1082 ms. Trace:
I20260709 12:10:24.148455 10804 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.149400 10931 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:24.152765  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet 93afd25256e34a3b902813af41f349c9: Illegal state: Replica 61fbd5afaa194845917d5b1b04571378 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:24.153256  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.155623 10908 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.156203 10908 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.158521 10908 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.159283  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.159951  9519 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:24.144682 10938 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.161384 10938 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.163444 10938 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.144495 10855 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.164757 10855 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.165879 10855 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:24.148455 10960 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:10:24.131414 10910 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.126113  8755 rpcz_store.cc:276] 0709 12:10:22.958673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.025187 (+ 66514us) service_pool.cc:224] Handling call
0709 12:10:23.025658 (+   471us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:23.490650 (+464992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.490692 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:23.631012 (+140320us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b2c000014c8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:10:23.634654 (+  3642us) log.cc:844] Serialized 52 byte log entry
0709 12:10:23.833738 (+199084us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:23.833793 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.834194 (+   401us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.089863 (+255669us) raft_consensus.cc:1685] finished
0709 12:10:24.089905 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.093090 (+  3185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":432850,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5363,"spinlock_wait_cycles":4070784,"thread_start_us":620985,"threads_started":2,"wal-append.queue_time_us":332879}
I20260709 12:10:24.129228  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:24.173022  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 43870us
I20260709 12:10:24.114809 10791 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.125039 10926 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.130738 10963 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:24.098310 10796 raft_consensus.cc:993] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:24.201030 10796 raft_consensus.cc:1081] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:10:24.112144 10706 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.128350 10962 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.205415 10936 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.205821  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:24.206449 10870 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:24.148082  8758 rpcz_store.cc:276] 0709 12:10:23.065385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.065544 (+   159us) service_pool.cc:224] Handling call
0709 12:10:23.065925 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.417410 (+351485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.417443 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.427215 (+  9772us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.705382 (+278167us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.971326 (+265944us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.971622 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.971735 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.147264 (+175529us) raft_consensus.cc:1685] finished
0709 12:10:24.147294 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.147476 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6948,"prepare.queue_time_us":304818,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5219,"raft.queue_time_us":374331,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":58995,"thread_start_us":711461,"threads_started":3,"wal-append.queue_time_us":374183}
I20260709 12:10:24.185369 10581 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.207944 10581 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.208467 10826 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.209614 10780 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.210173 10581 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.192528 10910 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.210701 10826 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.211658 10910 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.213543 10942 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.215144  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.216099 10942 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:24.185444 10961 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:10:24.133463 10967 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:10:24.196893  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.197719 10791 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.216162 10952 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.193046  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.217978 10912 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.186259 10878 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.193801 10566 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.216959  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.216539  8753 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:24.217437 10937 tablet_replica.cc:333] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:10:24.128839 10324 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:24.241590  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 178991us
I20260709 12:10:24.251088  8872 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.269110  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.271469 10324 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.238273 10796 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:24.273610  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1513) took 1054 ms. Trace:
I20260709 12:10:24.247254 10842 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.246783 10930 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:24.235842 10826 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.293888  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.294350 10324 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.301642  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.273862 10823 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:24.276297  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:24.210173 10780 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.308511 10324 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.305274 10821 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:24.317529 10932 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.843s	user 0.003s	sys 0.000s
I20260709 12:10:24.285507 10964 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:24.323244 10958 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:10:24.324164  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.323688 10964 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.252825 10878 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.325472  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.326620  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.300647 10826 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.327256 10826 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.327497  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.328606  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.329617 10962 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.332701  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1477) took 1326 ms. Trace:
I20260709 12:10:24.334559  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.336604  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.339972  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.341037  8831 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:24.342026  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 294222us
I20260709 12:10:24.342574  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.343668  8832 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:24.345232  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:24.333141  8900 rpcz_store.cc:276] 0709 12:10:23.005912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.006063 (+   151us) service_pool.cc:224] Handling call
0709 12:10:24.332424 (+1326361us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54003d1b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:24.332559 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734498688}
I20260709 12:10:24.326743 10878 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.349663  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.349371 10954 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.351997 10566 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.321287 10934 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.360319 10965 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.360581 10770 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.361871  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.362650 10969 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.288692  8753 rpcz_store.cc:276] 0709 12:10:23.219230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.270718 (+ 51488us) service_pool.cc:224] Handling call
0709 12:10:24.216113 (+945395us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:24.216298 (+   185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.263778 (+ 47480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.273527 (+  9749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5199104}
I20260709 12:10:24.306603 10823 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.378991 10968 raft_consensus.cc:3055] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.383476  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.399910  8827 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.385037  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.338311 10964 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.381721 10659 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.386528  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1510) took 1214 ms. Trace:
I20260709 12:10:24.360087  8828 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:24.396018  8830 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:24.400012  8831 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:24.284108 10796 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.403448  8832 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.407948  8757 rpcz_store.cc:276] 0709 12:10:23.172158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.172430 (+   272us) service_pool.cc:224] Handling call
0709 12:10:23.175057 (+  2627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.756186 (+581129us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18002ec600. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3813b060 00007fce3813bbfb 00007fce3814664b
0709 12:10:23.756334 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.756363 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.773310 (+ 16947us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.973984 (+200674us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.358496 (+384512us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b18002ec600. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3bb3b3c7 00007fce3814d9a7 00007fce3815d0bf
0709 12:10:24.358714 (+   218us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.386219 (+ 27505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.386301 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.386344 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:24.386355 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.386472 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28053,"prepare.queue_time_us":66862,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":343053,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":46678,"spinlock_wait_cycles":8776320,"thread_start_us":538820,"threads_started":3,"wal-append.queue_time_us":235508}
I20260709 12:10:24.409241  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:24.410882  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 351460us
I20260709 12:10:24.385747 10912 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:24.387558  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 207259us
I20260709 12:10:24.390956 10941 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.416230  8831 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:24.429217  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:24.429344  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.430081  8831 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:24.431221 10940 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:24.431658 10970 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:10:24.431752  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.390923 10891 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.422614 10823 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.422894 10826 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.303573 10930 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:24.449527  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.423537  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.450398  8757 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:24.424610  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.424989 10954 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.425220  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.419131 10968 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.459497 10930 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:24.459903 10968 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.427625 10659 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.461684  8826 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:24.462515 10659 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.464862  8833 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:24.426988  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:24.465700  8760 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.466768 10934 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.391332 10870 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.469061 10780 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.397346 10770 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.468986 10870 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.469983 10770 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.470261 10826 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.471482 10870 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.471432 10823 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.427989  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:24.472972  8758 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.473829  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:24.411720 10969 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.516829 10969 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.518555  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.437598 10842 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:24.395226 10952 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:24.525902 10842 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.526257 10952 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.438796  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.528658 10952 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:24.529376  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 95427.1us
I20260709 12:10:24.530310  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:24.439673 10927 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.394290 10965 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:24.440819  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139249us
I20260709 12:10:24.445127  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.446592 10891 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.458729  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.522101  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.524336  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.535594  8760 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:24.542572  8831 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:24.535983  8829 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.537480  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:24.538164  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 89853.8us
I20260709 12:10:24.544099  8829 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.537276  8835 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:24.539197 10324 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.541141  8758 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:24.544257  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:24.543188  8832 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:24.549553  8832 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.469256 10689 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.553061  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:24.555452  8905 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.441542 10912 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.559190  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.561651  8827 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:24.546408 10324 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.563310  8900 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:24.560317  8829 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.564502  8829 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.545428 10881 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.541918 10566 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.543563  8831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52186
I20260709 12:10:24.572341  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.572463  8831 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:24.573027  8831 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.573493  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.569229  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.541829 10758 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.566984  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:24.576393  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.547478 10821 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.576846  8827 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:24.578691  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.581797  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.582434  8905 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:24.564549  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:24.585237  8801 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.568583 10881 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.587599  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.553561 10954 consensus_queue.cc:1059] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:24.569883 10952 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.590914  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.586705  8834 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:24.605540  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.603565 10324 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.590566  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.587035  8831 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.590922 10835 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.561997 10689 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.625092  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.625682  8831 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:24.599169  8833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 1782) took 2011 ms (client timeout 1973 ms). Trace:
I20260709 12:10:24.626806  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.601612  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:24.627979  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.629073  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.629995  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.601908  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.632174  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.632818  8905 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.632982  8900 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
W20260709 12:10:24.626382  8833 rpcz_store.cc:269] 0709 12:10:22.587461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.607912 (+ 20451us) service_pool.cc:224] Handling call
0709 12:10:24.598991 (+1991079us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54000d93d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:24.599095 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4268186880}
I20260709 12:10:24.557209 10926 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.592962 10870 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.593374 10791 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.596444 10881 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.642314  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.601966 10937 raft_consensus.cc:2243] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:24.591075 10973 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.640607  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.655351  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.666743  8833 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.655941 10855 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.583983 10566 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.666759 10324 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:24.671753  8907 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.655102 10976 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:10:24.672192 10324 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.669181  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.638437 10931 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.673365  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:24.670231  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 78884.8us
I20260709 12:10:24.674209  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.681216  8831 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.673038  9489 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.662514 10911 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.648783 10878 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.652164 10948 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.648406 10835 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.647292 10967 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.646891  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.687274 10324 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.694142 10566 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.693979 10770 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.695956 10770 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:24.686118  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.613330 10952 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.595983 10965 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.636348 10706 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:24.692190 10967 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.683940 10878 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.689456 10911 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.706393 10937 raft_consensus.cc:2272] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:24.689334 10659 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:24.669198 10870 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.658736 10904 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.672005 10934 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.735937 10934 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.736433 10934 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.741256 10706 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.741883 10706 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:24.743091 10706 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.746601 10842 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.686695 10779 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.714805  8831 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:24.748395  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 106177us
I20260709 12:10:24.679333 10705 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.749176  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.752914  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.755389  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.753553  8905 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:24.756506  8831 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.727945 10878 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.723795  8833 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:24.707211 10978 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.686045 10796 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:24.689692 10973 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:24.730388  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.735378 10904 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.691181  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:24.765406  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.748977 10927 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.774317 10904 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.784968 10870 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.774504 10948 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.775079 10967 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.775264 10968 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.790356 10911 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:24.777901 10983 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:10:24.777181  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:24.776139  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.799862  8833 raft_consensus.cc:2393] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:24.756000 10891 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.779878 10973 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.751570 10779 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.758924 10980 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.751763 10931 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.751899 10705 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.781164 10835 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.782845 10796 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:24.783043  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91918.3us
I20260709 12:10:24.766310 10912 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:24.837476  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.682731 10821 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.778478  8831 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:24.752224 10706 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.831101  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 180343us
I20260709 12:10:24.863375  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.831558  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.835506  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:24.864143  8831 raft_consensus.cc:2368] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:24.864393  8905 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.746601 10934 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.838303  8906 raft_consensus.cc:2410] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:24.838578  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.861663  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:24.864953  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:24.868314  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.865010  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:24.870113  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:24.869021  8831 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:24.877502  8902 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:24.882431  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50946us
I20260709 12:10:24.798636 10948 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:24.889251  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:24.890256  8833 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:24.891647  8833 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:24.868848  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.826889 10927 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.898541  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.910756  8829 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:24.830657 10779 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.828925 10758 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.833537 10705 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.888882 10988 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.839118 10931 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.929319 10842 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:24.930510 10988 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.931072 10988 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.931525 10988 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.931717 10931 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.931944 10881 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.936708 10881 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:24.933130 10948 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.888526 10782 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:24.938679 10904 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:24.939394 10796 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.940042 10796 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.941154 10796 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:24.837986 10581 consensus_queue.cc:1059] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:10:24.916420 10986 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.943964 10986 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:24.829860  9517 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:24.862233 10980 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:24.950497  8829 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:24.959894  8905 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
W20260709 12:10:24.945760 10805 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:24.965920  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:24.867035 10891 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:10:24.917704 10967 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:24.983958  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:24.996136  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.998123  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.999208  8905 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:24.954274 10926 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:25.000662  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.000555  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.003468  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.005172  8904 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:25.004582  8905 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:24.955029 10980 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:25.006939  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 142074us
I20260709 12:10:25.009066  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.011230  8908 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.007090  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:24.975821 10881 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.980279 10911 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.944428 10927 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.030370  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:24.947963 10758 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.032508  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:25.047096  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 148648us
I20260709 12:10:25.047628  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:25.054775 10758 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.012020 10910 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.063654  8801 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.042524 10937 ts_tablet_manager.cc:1916] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:24.997767 10967 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:25.058269  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 92431.5us
I20260709 12:10:25.071704  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:25.058446 10904 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.038003 10881 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.058063 10952 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.085947 10758 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.086548 10758 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:25.087852 10758 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.062427 10910 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:25.090960 10984 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:10:25.090822 10967 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.092530  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.067143 10761 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:25.104031  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.069540 10948 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:25.067596 10870 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.068256 10581 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.095141  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.095587  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.127408  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.098131  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.127950  8828 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.129168  8725 leader_election.cc:400] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:25.126407  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.135983  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:25.138391  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet 93fd9eae511442cda809efae9c60a8dd: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:25.140965  8829 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:25.141505  8725 leader_election.cc:403] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:25.141817  8833 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:25.075839 10986 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.130903 10779 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.158874 10938 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:25.159358 10779 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.159484 10938 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:25.161341  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68885.7us
I20260709 12:10:25.131832  8799 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.165191  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.155789  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:25.152421 10927 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.169538  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.129433 10581 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.167960  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.151479 10705 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.141332 10948 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.170225  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.177265  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.177390  8751 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.171839  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.178709  8752 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:25.172194  8801 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.172346  8833 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:25.181277  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.183898  8833 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:25.182559  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:25.145949 10994 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:10:25.185089  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.142139 10941 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:25.137001 10979 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.203369  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.123996 10952 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:25.143131 10870 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.125265 10910 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.153956 10881 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.209254  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.169409 10904 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.170785 10927 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.212299  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.225492  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.225620  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.187032 10791 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.174031 10705 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.171361 10581 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.193171 10855 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.188165 10934 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.206285 10926 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:25.279865  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60253.4us
I20260709 12:10:25.281039  8828 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:25.223104  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.282743  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.283022  8756 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:25.283253  8759 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.160719 10998 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.142422 10761 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.169661 11002 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.209478 10870 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.299602  8751 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:25.175789 10821 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:10:25.307657  8754 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:25.168924 10978 consensus_queue.cc:1059] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:10:25.192008 10770 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
W20260709 12:10:25.313072  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 90038.5us
W20260709 12:10:25.298663 10994 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:10:25.318029  8754 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:25.278543 10826 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.301321 10984 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:10:25.303900 10968 consensus_meta.cc:287] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 12:10:25.335924 10926 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.286283 10941 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:25.337261 10926 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.337261 10941 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.340763 10761 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.210510 10952 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.342716  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.350018  8752 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:25.343590  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.341827  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.387547  8829 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.388795  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.390846  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.393121  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.393826  8830 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.291097 10927 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.330123 10835 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.390609 10761 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.408428  8752 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:25.411482  8829 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:25.418226  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.418422 10927 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.348992 10826 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.402258 10835 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:25.423461  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.435220  8829 raft_consensus.cc:2410] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.441236  8830 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
W20260709 12:10:25.423435 11001 log.cc:927] Time spent T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:10:25.443650  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.445755  8830 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:25.447101  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.450407  9489 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:25.458343 10706 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.003s
I20260709 12:10:25.460980 10909 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.461652 10909 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:25.462605 10909 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:25.460610 10878 consensus_meta.cc:287] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 12:10:25.465593 10878 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.468415  8760 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:25.470641 10988 consensus_meta.cc:287] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 12:10:25.471153 10988 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.472299  8753 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.466892 10998 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:25.472899 10938 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.473727 10878 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.423900 10761 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:25.480770  8758 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:25.481581 10761 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.483337  8754 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:25.490195 10826 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.436470 10835 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.497080  8751 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:25.498909  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 276283us
I20260709 12:10:25.490929 10999 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.512519  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:25.507570 11000 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 12:10:25.528162  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1646) took 1207 ms (client timeout 1545 ms). Trace:
W20260709 12:10:25.528855  8835 rpcz_store.cc:269] 0709 12:10:24.321148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.326389 (+  5241us) service_pool.cc:224] Handling call
0709 12:10:25.527878 (+1201489us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001fe5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:25.528063 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465912704}
I20260709 12:10:25.509845 10967 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.530287  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.535658  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.533492 10999 raft_consensus.cc:697] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:25.538817 10999 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.536939  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.494897 10980 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.545480  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.551633  8755 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.553169  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.555294  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.557083 10952 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.559764  8835 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.561120  8835 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.562709  8835 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.564198  8835 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.567224  8835 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:25.530589 10916 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:25.543561 10967 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.569772 10967 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.577675 10581 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.578032  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.548143 10835 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.578923  8751 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:25.580932 10835 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.581382 10762 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.581720 10904 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.583294 10581 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.585250  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.586558  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.586606 10980 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.587188  8905 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.573326 10689 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.589311  8831 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.589488 10988 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.603286  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.603310  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.581827 10762 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:25.605252 10762 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.606446 10762 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.641888  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.644960  8835 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:25.650180  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.658717  8905 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:25.628155 10980 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:25.636667 10689 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:25.660656  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 147064us
I20260709 12:10:25.667069  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.669757  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.670600  8905 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.665402 10689 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.677802  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:25.678045  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:25.679505  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.680727  9524 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.665970 10980 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.685961  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:25.686133  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.675812 10689 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.690606  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.691318  8900 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:25.692227  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.693776  9524 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.695941 10761 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.677055 10870 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.698534 10870 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.699333  8833 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:25.699981  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 274) took 1302 ms. Trace:
I20260709 12:10:25.700449  8832 rpcz_store.cc:276] 0709 12:10:24.397726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.551543 (+153817us) service_pool.cc:224] Handling call
0709 12:10:24.551918 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.695584 (+143666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.695616 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.695657 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.695688 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.699749 (+1004061us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000d7fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:25.699796 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.699921 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329914112}
I20260709 12:10:25.701776  8828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:25.702406  8828 raft_consensus.cc:606] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:25.702696  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.702754  8828 raft_consensus.cc:614] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:25.665413 10910 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.719008 10910 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.704066 10980 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.709298  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:25.722460 11009 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 12:10:25.723197  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.724439  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.724853  8829 raft_consensus.cc:2410] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:25.726864  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 281) took 1051 ms. Trace:
I20260709 12:10:25.709452  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.727473  8834 rpcz_store.cc:276] 0709 12:10:24.675663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.958286 (+282623us) service_pool.cc:224] Handling call
0709 12:10:24.958596 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.083923 (+125327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.083960 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.084003 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.084035 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.726452 (+642417us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400389ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:25.726541 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.726770 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287565568}
I20260709 12:10:25.710887 10962 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:25.761543  8752 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.731232 10937 ts_tablet_manager.cc:1929] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:25.726457  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.766698 10937 log.cc:1199] T 16a04653cca743d0966d20df2225c35d P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/16a04653cca743d0966d20df2225c35d
I20260709 12:10:25.766875  8902 raft_consensus.cc:3055] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:25.767314  8902 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.768347 10937 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43806 (request call id 81) took 2887 ms. Trace:
I20260709 12:10:25.768180  8902 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.769579  8902 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.770478 10965 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.770838  8799 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.771613 10566 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.773398 10940 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.778250  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1797) took 1368 ms. Trace:
I20260709 12:10:25.778806  8826 rpcz_store.cc:276] 0709 12:10:24.410252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.580071 (+169819us) service_pool.cc:224] Handling call
0709 12:10:24.580341 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.749938 (+169597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.749971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.750502 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.944537 (+194035us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.956117 (+ 11580us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.956739 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.777697 (+820958us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001fead4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:25.777762 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.777861 (+    99us) raft_consensus.cc:1685] finished
0709 12:10:25.777985 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.778169 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":326,"prepare.queue_time_us":11581,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":11350,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":28068,"spinlock_wait_cycles":389093760,"thread_start_us":148306,"threads_started":1,"wal-append.queue_time_us":286722}
I20260709 12:10:25.768836 10937 rpcz_store.cc:276] 0709 12:10:22.928317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.011941 (+ 83624us) service_pool.cc:224] Handling call
0709 12:10:23.637921 (+625980us) ts_tablet_manager.cc:1151] Deleting tablet 16a04653cca743d0966d20df2225c35d
0709 12:10:24.216997 (+579076us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:25.488292 (+1271295us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:25.731057 (+242765us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:25.768243 (+ 37186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340143,"tablet-delete.queue_time_us":561709,"thread_start_us":379273,"threads_started":1}
W20260709 12:10:25.741969 11015 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.300s	user 0.004s	sys 0.000s
I20260709 12:10:25.743036 10964 raft_consensus.cc:3055] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.754735 10996 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.756690 10761 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.752143 10689 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.754782  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:25.766218  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.788235  8826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:25.789175  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.800990 10964 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:25.790728  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.807006  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.806895 10964 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.808072 10964 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.808228  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.808740 10996 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.809317 10689 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.810006  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:25.810623  8759 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.811100 10996 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.811237  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.814271  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:25.791572  8905 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
W20260709 12:10:25.788041  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 50915.6us
I20260709 12:10:25.802035  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1921) took 1277 ms. Trace:
I20260709 12:10:25.816082  8907 rpcz_store.cc:276] 0709 12:10:24.525094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.525515 (+   421us) service_pool.cc:224] Handling call
0709 12:10:24.525793 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.676670 (+150877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.801775 (+1125105us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540009c4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:25.801968 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335066496}
I20260709 12:10:25.806707 10936 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.812295  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.821823  9522 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.821911  8909 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.824312  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.825901 10805 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.828228 10566 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.821318 10835 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.803028 10762 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:25.832104 10805 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.826872  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.829059 10689 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.833524  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.833952 10826 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.834764 10826 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:25.835216  8872 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.821161 10761 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.819366  8902 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:25.844244 10997 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.844796 10997 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:25.845755 10997 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.852769 10842 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.853397 10936 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.854175 10936 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.853856 10842 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:25.854687 10936 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.852656 10926 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:25.855013 10842 raft_consensus.cc:3055] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.856403  8759 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:25.828961 10978 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.860239  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.866174 10781 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:25.890802  9517 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.858343 10842 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.895439  8756 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.897806  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:25.849682 10962 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:25.856206 10835 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:10:25.894513 10977 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:25.868419 10985 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:25.878000 10689 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.907536  8827 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.906801  8826 raft_consensus.cc:606] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:25.897156 10805 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.916968 10805 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.876257 10930 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:25.919355 10805 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.920100 10936 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:25.911520 10962 raft_consensus.cc:3055] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.920936 10962 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.921800 10962 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.922933 10962 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.924926 10842 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.925885 10821 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.926642 10842 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.927350 10985 consensus_queue.cc:1243] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer 005ae7a1e140481db6cc04faeb268d9c log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:25.926460 10821 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.928305 10930 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:25.935801  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet 1af6a99f3fc34f97a6aead96582b77eb: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:25.938159  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.939030  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.939638  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.940202  8905 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.940286  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.940944  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.941180  8827 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:25.941926  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 72288.9us
I20260709 12:10:25.941982  8907 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.942785  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.942862  8909 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.944383  8909 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.936277 10930 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.947386  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.949730  8724 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.951850  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.954077  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.955523  8907 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:25.956983  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.956367  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.960431  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.961139  8831 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.962203  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.962263  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.963243  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:25.963508  8832 raft_consensus.cc:2368] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:25.928589 10781 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.947276 11003 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.934361 10965 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.964751  8904 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:25.967232  8830 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.978843  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.979112  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.968407  8905 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:25.965713  8907 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:25.980014  8901 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:25.967926  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:25.981419  8832 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:25.970932  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:25.947007 10930 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.989143  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:25.979452  8904 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.969599  8831 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:25.983955  8830 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:25.977238  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:25.985770  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.986001  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.987416  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.951547  8909 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.999202  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:26.001235  8835 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.002848 11002 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:26.003674 11002 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:26.003845 10954 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.006155  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:25.964663 10781 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:25.965173 10941 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.950821 10988 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.008353 10988 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.010849 10988 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:25.965462 10938 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.012312  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:25.950690 10878 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.011166 11031 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.022256  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:26.018924  8832 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.951022 10689 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:26.014482  8909 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.024940  8907 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:26.019694 10938 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.980748 10826 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.982717 10940 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.034158  8755 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:10:26.028888  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:26.036023  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:26.037118  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:26.029947  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:26.037752  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:26.040859  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.042901  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:26.043655  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 79445.5us
I20260709 12:10:26.047864  8724 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:25.989143 10706 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:10:26.040072 10930 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.044025 10838 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.053557  8759 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.055172 10689 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.056787 11002 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:25.989874 11003 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.061964 10821 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:26.044663 10940 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:25.997228 10965 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.064724 10940 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.064915 10965 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.067724  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 370) took 1001 ms. Trace:
I20260709 12:10:26.033845 10968 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:10:26.077672  8754 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:26.040467 10566 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.080289 10936 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:26.045083 10973 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:26.049793 10995 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:26.053629 10838 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:26.089293 10838 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.091511 10978 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:26.094754 10761 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.099283  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.101650 10998 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:26.102365 10998 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.102829  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:26.106349 10938 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.106622  9521 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:26.108152 10706 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.108795 10706 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:26.109872 10706 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.028400 10878 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:26.114149  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.115176 10878 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.076803 10826 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:26.068189  8760 rpcz_store.cc:276] 0709 12:10:25.066334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.066571 (+   237us) service_pool.cc:224] Handling call
0709 12:10:25.066806 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.469039 (+402233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.067470 (+598431us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540033e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:26.067656 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922958592}
W20260709 12:10:26.108317  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.117914  9523 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:26.122926  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35690 (request call id 423) took 1487 ms. Trace:
I20260709 12:10:26.123968  9523 rpcz_store.cc:276] 0709 12:10:24.635892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.637202 (+  1310us) service_pool.cc:224] Handling call
0709 12:10:25.897634 (+1260432us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:10:26.122855 (+225221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22598400}
I20260709 12:10:26.032734 10835 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.126677  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.138182  8830 raft_consensus.cc:2410] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:26.134536  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:26.138741  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 76817.5us
I20260709 12:10:26.138973  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.129629  8907 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:26.132946  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60422.3us
I20260709 12:10:26.140226  9489 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.140616  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.141502  8909 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:26.128270  8832 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:26.142932  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:26.143699  8909 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:26.145251  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:26.146731  8907 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.148758  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.149892  8829 raft_consensus.cc:2410] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:26.081542 10936 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.152465  8901 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:10:26.160921  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 113160us
I20260709 12:10:26.151077  8909 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.155715  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.081561 10973 raft_consensus.cc:697] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:26.162786  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.161993  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.168468 10940 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.092406 10978 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:26.160151 10706 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.182209  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.156891 10936 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:26.187501 10581 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.165994 10996 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.171725 10878 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.163105 11032 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:26.190750  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.144508 10964 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:26.158607 10999 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:26.178133 10705 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:26.227994  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 215750us
I20260709 12:10:26.179656 10821 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:26.201663 11032 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:26.253595  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 85547.9us
I20260709 12:10:26.255146  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:26.252903  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44351.9us
I20260709 12:10:26.227531 10940 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.264616  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:26.265240  8760 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.226824 10910 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.234112 10998 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.210589 11012 consensus_queue.cc:1059] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:26.263351  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:26.241014 10948 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:26.264053  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.266577  8826 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:26.261739 11035 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:26.267289  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:26.289230  8755 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:26.267395  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.290407  8829 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:26.268971 10931 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:26.270505  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.253604 11032 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.272282 10979 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:26.248881 10835 consensus_queue.cc:1059] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:26.362875 10978 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:26.363256 10835 raft_consensus.cc:3055] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:26.363899 10835 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:26.365103 10835 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.366626  9519 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:26.276329  8874 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
W20260709 12:10:26.262838  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 98517.6us
I20260709 12:10:26.367779  8874 leader_election.cc:403] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:26.283515  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 148581us
W20260709 12:10:26.368513  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 92342.7us
I20260709 12:10:26.317894  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:26.370087  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52339us
I20260709 12:10:26.266515 10973 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:26.372370  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:26.373311  8906 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:26.374122 11002 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.374507 11002 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.342996 10997 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.346354 11003 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.383327  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:26.355007 11026 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:10:26.335870  8831 raft_consensus.cc:2393] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 2: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:26.374938  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 95039.7us
W20260709 12:10:26.386373  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 142356us
I20260709 12:10:26.375887  8904 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:26.366792 10835 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:26.370384  8874 leader_election.cc:400] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:26.390597  8874 leader_election.cc:403] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.264582 10878 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:26.380729  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61681.1us
I20260709 12:10:26.392477  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:26.351191 11042 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:10:26.374953  8829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
W20260709 12:10:26.385442  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 152039us
I20260709 12:10:26.393117  8725 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:26.227061 10826 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.399227  8828 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:26.276168 10930 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:10:26.382546 11002 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.329970 10965 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:10:26.407073  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.282997 10910 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.400857 11034 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4.
I20260709 12:10:26.393392 11039 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:26.423894  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:26.429405  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:26.443034  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.401774 10948 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.383641 10761 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:26.447000  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:26.439687  8760 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:26.405323 10689 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.412895 10941 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:26.465106  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:26.458671  8829 raft_consensus.cc:606] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:26.466660  8829 raft_consensus.cc:614] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:26.462523  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:26.467350  8904 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.467584  9523 raft_consensus.cc:2393] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:26.405054 10954 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:26.464152  8801 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:26.401885 10940 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:26.441820 10908 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.437638 11040 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.490408 10838 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.493002  9524 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:26.505290 11003 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.478431 10993 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:26.506069 10842 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:26.510283  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 93954.2us
I20260709 12:10:26.461427 10998 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.441403 10878 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:10:26.552048  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:26.553783  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 154076us
I20260709 12:10:26.554122  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:26.568148  8905 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:26.555074  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:26.472008 10968 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:26.573009  8835 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:26.461156 10930 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:10:26.487315  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:26.583266 11045 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:26.585587 10910 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.598245 10910 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.598547  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:26.600029 11022 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.600493 11022 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:26.480856 10954 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.602602  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 1802) took 2007 ms. Trace:
I20260709 12:10:26.602942 10954 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.514395 11003 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.603071  8827 rpcz_store.cc:276] 0709 12:10:24.595606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.596792 (+  1186us) service_pool.cc:224] Handling call
0709 12:10:26.602367 (+2005575us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001fe0d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:26.602534 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992766720}
I20260709 12:10:26.603901 11003 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.453229 10877 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:26.548936 10842 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:26.591118 10936 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.549679 11040 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:26.563097 10998 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.592615 10911 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.595219 10968 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.607915 10842 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.608956 10838 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.609073  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:26.601657 11022 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:26.610525  8872 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:26.603904  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:26.614476  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.614710 10962 consensus_meta.cc:287] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.003s
I20260709 12:10:26.512153 10978 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:10:26.616245 11032 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.640880 10998 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.654364  8909 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:26.654825  8909 pending_rounds.cc:85] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 1
I20260709 12:10:26.644747  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:26.645454  8827 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.639859 10911 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:26.649281  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.477371 10689 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:26.652520  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 43568.2us
W20260709 12:10:26.658432  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 212719us
I20260709 12:10:26.655108  8909 pending_rounds.cc:107] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:26.659767  8909 raft_consensus.cc:2889] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.661239  8827 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:26.662035  8875 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:26.651345 10936 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.663666  8827 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:26.651889 10930 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:26.663280  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 199236us
W20260709 12:10:26.671643  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 205406us
W20260709 12:10:26.710434  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.681628  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:26.675037  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.714341  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:26.716120  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:26.716547  8755 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:26.717168  8756 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:26.708146  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 260951us
I20260709 12:10:26.768885  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:26.773947  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.776070  8827 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:26.818925  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:26.822091  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53490.9us
W20260709 12:10:26.822484  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 53690.9us
I20260709 12:10:26.822817  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:26.663312 11022 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.658902 11053 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.665619 10962 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:26.824340  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 57088.3us
I20260709 12:10:26.835325  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:26.836166  8759 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:26.666285 10878 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:26.717608 10930 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.833148 10962 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.856319  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:26.843713 11015 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:10:26.843511 11053 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:26.850853 10930 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.851449  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:26.841084 10911 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:26.881907 10911 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.885838 11037 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.614s	user 0.006s	sys 0.003s
I20260709 12:10:26.888962 11061 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.889551 11061 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.889753 11053 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.865834 10962 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.882196 10734 consensus_queue.cc:1175] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd116b86a1e4445c994a361f776beba1" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 12:10:26.901067 10838 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.849231 10878 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:26.910933 10805 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:26.918100 10973 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.834757 11040 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:26.950116 11059 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.950731 11059 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.951119 11059 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.932128 11002 consensus_meta.cc:287] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.002s
I20260709 12:10:26.926940 11032 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.962716 10910 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:26.965265 11050 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:10:26.964277  8875 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0e4c6e5758d4fb18617b5b7c30cd334. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:10:26.973026  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 140217us
I20260709 12:10:26.995057  9519 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:26.996860 10689 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.010681 10878 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:26.979624 10978 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.017086 10978 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.019687 10978 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:26.955142 10973 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.018059 11003 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.023378  8834 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:27.024006 10973 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:27.026247  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.029222  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:26.966442 11002 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.036644 10973 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.030042  9519 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:27.039535 11002 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.040951  8828 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:27.041889  8875 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:27.247044  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.254477  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.255192  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.272835  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1695) took 1256 ms. Trace:
I20260709 12:10:27.273479  8835 rpcz_store.cc:276] 0709 12:10:26.016181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.016391 (+   210us) service_pool.cc:224] Handling call
0709 12:10:27.272388 (+1255997us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540037b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:27.272545 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221171968}
I20260709 12:10:27.252480 11002 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.252127 10912 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.267762 10948 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:27.264432 10878 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:27.285990 11031 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.319593 11003 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.317147 10912 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.304270 11041 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:27.334910  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 458808us
I20260709 12:10:27.325111 10878 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.325320 11059 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.324810 10948 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.320788 11002 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.329419 10986 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:27.351859 10998 consensus_meta.cc:287] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.002s
W20260709 12:10:27.332787 11033 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.758s	user 0.005s	sys 0.018s
I20260709 12:10:27.360978  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:27.361775  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:27.380348  8759 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:27.363101  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:27.381498  8760 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 1.
I20260709 12:10:27.363773  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:27.355820 10930 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.354163 10912 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.369462  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:27.374876  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:27.376924  8754 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:27.382576  8751 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:27.383782  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:27.360495 10988 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:27.365139 11061 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.329419 11031 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.398326 11059 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.370355 10986 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:27.404958  8830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:27.405912  8906 raft_consensus.cc:2368] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5.
I20260709 12:10:27.406266  8830 raft_consensus.cc:606] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:27.406796  8830 raft_consensus.cc:614] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:27.404937  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:27.412549  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1684) took 1454 ms. Trace:
I20260709 12:10:27.413137  8833 rpcz_store.cc:276] 0709 12:10:25.957724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.958751 (+  1027us) service_pool.cc:224] Handling call
0709 12:10:25.959038 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.967704 (+  8666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.967736 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.968245 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.130282 (+162037us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:26.130344 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.130447 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.030267 (+899820us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:27.399241 (+368974us) raft_consensus.cc:1685] finished
0709 12:10:27.399268 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.412448 (+ 13180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8289,"raft.queue_time_us":23817,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3833,"spinlock_wait_cycles":218658048,"thread_start_us":161639,"threads_started":1,"wal-append.queue_time_us":281384}
I20260709 12:10:27.409265 11061 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.419406 11061 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.419764 11061 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.405645 10985 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.420576 10985 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.423435 10985 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:27.435875  8833 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.447978  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:27.450331  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:27.451406  8830 raft_consensus.cc:2393] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:27.382160 10998 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.365356 11041 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.405019 11052 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:27.417811 11059 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.396418 10988 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.496874  8757 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:27.509250  8831 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.485996 11052 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.525108 11052 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.525808 11052 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.466976 11059 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.538730  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:27.539558  8831 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:27.518245 11065 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.485652 10770 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:10:27.497500 10826 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:27.486394 10936 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:27.531183 10938 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.535326 11059 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.527513 11080 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:27.533636 10698 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.551571  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:27.558652  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 72165.2us
I20260709 12:10:27.485628 10986 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:27.633674  8801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.132:32899 timed out after 1.932s (SENT) [suppressed 6 similar messages]
I20260709 12:10:27.526412 11052 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.622126 10948 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.619930 10911 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:27.548990 11065 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.632727 10878 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.634119 11076 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.680495 10911 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:27.685523 11075 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:10:27.690274 11065 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.615350 10938 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.654906 11002 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.701578  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:27.728622  8902 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:27.706441  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:27.729547  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:27.730494  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:27.731670  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:27.707614  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:27.627198 10985 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:27.735770  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:27.734987  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:27.670538 10930 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:27.625944 11080 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.629321 10698 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.680115 10986 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.678719 10948 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.691768 11022 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.691962 10911 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.708066 11076 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.757877  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:27.691978 11031 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.774212  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:27.743286 10770 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:27.783234  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:27.762811 10998 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:27.807963  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 184590us
I20260709 12:10:27.775928 11076 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:27.819229  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.764233 10948 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.782845 10988 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:27.834601  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 214110us
I20260709 12:10:27.769804 11022 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:27.839521  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 205874us
I20260709 12:10:27.826206 10979 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:27.856154  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:27.816212 11085 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.831118 10985 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:27.833370 10911 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:27.836850 11087 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.836511 10998 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.854933 11090 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:27.873662 11086 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:27.884999 11022 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.889093  8752 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:27.857252 10826 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:27.864723 11077 log.cc:927] Time spent T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 12:10:27.890515  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 107418us
I20260709 12:10:27.856879 11040 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:27.899952  8724 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:27.887171 11090 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.871407 10911 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.869707 10985 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.916967 10911 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.918401 10985 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:27.903019 11040 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.886652 11087 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.866072 10979 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.893582 11061 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.900141 10826 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:27.907511 11083 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.903230 10998 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:27.956351  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:27.932243 10698 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.958287 11041 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:27.962731 11061 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.971460 11081 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:27.972163 11081 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.978844 10979 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:27.955673 11052 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:27.984664 11081 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.985241 11081 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:27.985689 11081 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:27.987627 11081 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:27.913563 11090 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.014955 10826 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.057902 10826 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:28.064199 10826 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.065995 11076 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.066546 11076 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:28.061187 10962 consensus_meta.cc:287] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.146s	user 0.015s	sys 0.001s
W20260709 12:10:28.072057 10912 consensus_meta.cc:287] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.001s
I20260709 12:10:28.116611  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:27.987985 11059 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.105446 11076 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.117494  9525 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:28.149021  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:28.104561 10962 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.165086 11061 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:28.179543  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 342967us
I20260709 12:10:28.180719  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:28.181339  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:28.182579 11061 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.173637 10781 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.188161 11061 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.188793 10781 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.118304 10912 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.188090  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:28.196712  9519 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:28.196985 10826 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.199304  8875 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:28.200318 10826 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.200815 10826 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.201241 10826 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.203382  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:28.204164  9519 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:28.205348  8875 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:28.206235 10796 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.206663 10796 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:28.207055 10796 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.174363 11076 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:28.214485 10998 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:28.214193 11104 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.216280  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:28.217535  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.182251 11059 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.218361 10998 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.226438 10998 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.226517 10962 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.227197 11061 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.220956 11076 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.228431  8830 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:28.230206 11076 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:28.440140  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.247225 10826 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.843683 10826 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:28.729472 11083 consensus_meta.cc:287] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.797s	user 0.002s	sys 0.010s
I20260709 12:10:28.846726 11083 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:28.248456 11090 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.336732 11103 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.856755 11103 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.336508 10998 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:28.860461 10998 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:28.863117 10998 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.647146 11061 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.234292  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:28.541970 10986 consensus_meta.cc:287] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.772s	user 0.003s	sys 0.008s
W20260709 12:10:28.845854 10781 consensus_meta.cc:287] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.002s
I20260709 12:10:28.509887 10698 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.473227 10762 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.705699 10912 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:28.911612 10796 consensus_meta.cc:287] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 12:10:28.912873 11111 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.922883 10762 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.927323 10762 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:28.922504 10698 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.931963 10698 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.932770 11111 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.915561 11103 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.935791 11111 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.922111 10796 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:28.939163 10796 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:28.913252 11090 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:28.370302  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 401) took 1060 ms. Trace:
I20260709 12:10:29.034070  8756 rpcz_store.cc:276] 0709 12:10:27.309447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.309629 (+   182us) service_pool.cc:224] Handling call
0709 12:10:27.310127 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.380354 (+ 70227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.380403 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.380467 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:27.380520 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.369851 (+989331us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54001a2cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:28.369923 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.370207 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160785664}
I20260709 12:10:29.038962  8908 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:29.044358  8754 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:29.048350  8751 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:29.054565  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:29.056249  9519 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.084479  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:29.085837  9525 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.090406  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:29.101310  9523 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.105651  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.107299  8756 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:29.118589  8751 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.126688 11003 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.127075  8755 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:29.128019 11003 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.132164 11003 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.134999 11003 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.135995 11003 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.137195 11061 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.138422 11061 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.140394 11003 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.141669 11061 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:29.147692  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.161062 11090 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.183178 11110 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.161754  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.197414 11090 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.197925 11110 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.198844  8751 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 2.
I20260709 12:10:29.183244 11083 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.202805 11083 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.204957 11090 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.210093 11083 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.220855  9525 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:29.222538 11061 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:29.223555 11061 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.225124  9523 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:29.224246  8875 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:29.232678 10926 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.233172  8755 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:29.233464 10926 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:29.233314 11061 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.234998  8875 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:29.237179 10796 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.235035  8754 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.215955 11003 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.241560 10842 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.244153  8756 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.237851 10796 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:29.248733 11110 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.244314 11031 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.260321 11031 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:29.262032 11031 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.263479 11031 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.264442  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:29.249276 10796 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.275585  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.277299  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:29.278528  8755 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:29.274214  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:29.290735  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35690 (request call id 429) took 2845 ms (client timeout 1932 ms). Trace:
W20260709 12:10:29.291297  9524 rpcz_store.cc:269] 0709 12:10:26.445276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.446737 (+  1461us) service_pool.cc:224] Handling call
0709 12:10:29.290265 (+2843528us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54005c1cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:29.290519 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88900992}
I20260709 12:10:29.292593  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:29.301329  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1696) took 2731 ms. Trace:
I20260709 12:10:29.301957  8832 rpcz_store.cc:276] 0709 12:10:26.569715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.572504 (+  2789us) service_pool.cc:224] Handling call
0709 12:10:26.574423 (+  1919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.653316 (+ 78893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.653365 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.653424 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.653471 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.300543 (+2647072us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54003aacd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:29.300670 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.301085 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180793216}
I20260709 12:10:29.304839 10838 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.305830 10838 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.237303 10926 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.293543  8829 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:29.297802  9525 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.319597  8751 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:29.296898 11003 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.332085 11115 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.332186  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.333515  8755 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:29.333216 11115 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.334147 11003 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.334939 11003 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.335848  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.336020 11003 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.336781  8755 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:29.317068  9519 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:29.348062  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:29.346895  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.349720 11085 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.347082  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.350682 11085 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.352018  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:29.353901  8755 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:29.342839 10838 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.353888  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:29.361806  8875 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:29.362682  8826 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:29.364269  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.365155  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:29.361807  8829 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:29.370410 11003 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.370630 11085 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.371618 11085 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:29.346000 11115 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.377408  9525 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:29.378626 11095 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.379436 11095 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:29.381692  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.382457  9525 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:29.386662  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:29.372509 11085 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.390695 11110 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.391158 11110 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.391501 11110 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.395035  8756 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:29.393167 11085 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.397503  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1954) took 1692 ms. Trace:
I20260709 12:10:29.397743 10912 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.404282 10912 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:29.401208  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.397948  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.410558 11095 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.398411 10781 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.414767 10781 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.415258 10912 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.418658  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:29.419312  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:29.419993  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:29.419776 10781 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:29.421702 11104 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.422183 11104 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.422756 11104 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.422905  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.422173  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.425163  9519 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:29.426755  8875 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:29.419883 11006 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.427733 11006 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.428135 11006 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.398082  8907 rpcz_store.cc:276] 0709 12:10:27.704503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.704619 (+   116us) service_pool.cc:224] Handling call
0709 12:10:27.704984 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.727577 (+ 22593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.727604 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:27.741456 (+ 13852us) log.cc:844] Serialized 52 byte log entry
0709 12:10:27.867427 (+125971us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:27.894492 (+ 27065us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.256239 (+1361747us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b180045dc60. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3bb3b3c7 00007fce3814d9a7 00007fce3815d0bf 00007fce3815d038
0709 12:10:29.256709 (+   470us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.309991 (+ 53282us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b180045dc60. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:10:29.373790 (+ 63799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.396783 (+ 22993us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.396916 (+   133us) raft_consensus.cc:1685] finished
0709 12:10:29.396936 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.397180 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1354547,"prepare.queue_time_us":1390583,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":108,"raft.queue_time_us":35847,"raft.run_cpu_time_us":583,"raft.run_wall_time_us":21209,"spinlock_wait_cycles":22256768,"thread_start_us":153406,"threads_started":2,"wal-append.queue_time_us":276117,"wal-append.run_cpu_time_us":2431,"wal-append.run_wall_time_us":1002462}
I20260709 12:10:29.436666  8901 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:29.456077 10948 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:29.464013 11110 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.469398  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:29.470144  9525 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:29.477388 10842 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.488085 10842 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:29.474553 10781 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.489045 10842 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.489236 10781 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:29.477725 10912 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.494489 10912 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:29.492337 10781 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:30.082948 10566 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:30.074775 11110 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:30.071640 10926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.028s	sys 0.027s
I20260709 12:10:30.072726 11116 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:30.165452 11095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.007s	sys 0.006s
W20260709 12:10:30.380116 11095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.007s	sys 0.007s
W20260709 12:10:30.354682 10926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.028s	sys 0.028s
W20260709 12:10:30.381841 11104 consensus_meta.cc:287] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.959s	user 0.012s	sys 0.000s
I20260709 12:10:30.460192 10912 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:30.295334 10566 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.393527 11116 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.569095 11122 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:30.466485 10855 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:30.467484 11104 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:30.702008 11135 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:30.702769 11104 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:30.702883 11135 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.705716 11135 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.706291 11135 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:30.706926 11135 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:30.694864 10855 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.709231 11135 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:30.711871 10855 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.698624 11122 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.713114  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1574) took 1429 ms. Trace:
I20260709 12:10:30.713524  8754 rpcz_store.cc:276] 0709 12:10:29.283338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.288193 (+  4855us) service_pool.cc:224] Handling call
0709 12:10:29.309185 (+ 20992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.309933 (+   748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.309976 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.310816 (+   840us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.339151 (+ 28335us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:29.339210 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.339313 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.712886 (+1373573us) raft_consensus.cc:1685] finished
0709 12:10:30.712913 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.713038 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3892,"raft.run_cpu_time_us":512,"raft.run_wall_time_us":33411,"thread_start_us":27768,"threads_started":1,"wal-append.queue_time_us":38170,"wal-append.run_cpu_time_us":3122,"wal-append.run_wall_time_us":1109899}
I20260709 12:10:30.714756 11122 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.717406 11116 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.699186 11127 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:30.724798 11127 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.722604 10566 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.728915 11127 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:30.729769 10842 consensus_meta.cc:287] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.240s	user 0.013s	sys 0.000s
I20260709 12:10:30.730511 10842 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:30.733686 10842 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:25.945451  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 16a04653cca743d0966d20df2225c35d (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:10:30.739404  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 146) took 9971 ms. Trace:
W20260709 12:10:30.740304 11006 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 1.312s	user 0.010s	sys 0.005s
I20260709 12:10:30.748795 11006 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:30.749356  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:30.750500  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:30.750578 11136 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:30.741865  8642 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 4.80573e+06us
I20260709 12:10:30.751427 11127 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:30.747153  8830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 319) took 2531 ms (client timeout 1978 ms). Trace:
I20260709 12:10:30.739955  8657 rpcz_store.cc:276] 0709 12:10:20.769154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.769415 (+   261us) service_pool.cc:224] Handling call
0709 12:10:30.739068 (+9969653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.783807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.937830 (+154023us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.939378 (+  1548us) write_op.cc:435] Acquired schema lock
0709 12:10:23.941137 (+  1759us) tablet.cc:662] Decoding operations
0709 12:10:24.091246 (+150109us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:24.100550 (+  9304us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:24.100588 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:24.101284 (+   696us) tablet.cc:701] Row locks acquired
0709 12:10:24.101303 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:24.101463 (+   160us) write_op.cc:270] Start()
0709 12:10:24.101591 (+   128us) write_op.cc:276] Timestamp: P: 1783599024101414 usec, L: 0
0709 12:10:24.101612 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:24.104713 (+  3101us) log.cc:844] Serialized 3214 byte log entry
0709 12:10:24.713751 (+609038us) op_driver.cc:464] REPLICATION: finished
0709 12:10:25.761967 (+1048216us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b54002fc028. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3e4ff9e1 00007fce3e4fe64c 00007fce3bb7a845 00007fce3bb7ed61 00007fce3bb7ed19 00007fce3bb7eca9 00007fce3bb7ec71 00007fce3bb7de9d 0000000000388634 0000000000388479 00007fce35056475
0709 12:10:25.762056 (+    89us) write_op.cc:301] APPLY: starting
0709 12:10:25.762149 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:25.762364 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:25.762387 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:25.765853 (+  3466us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:25.766059 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:25.766108 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:25.766370 (+   262us) log.cc:844] Serialized 65 byte log entry
0709 12:10:25.874074 (+107704us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.879922 (+  5848us) write_op.cc:454] Released schema lock
0709 12:10:25.897447 (+ 17525us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:25.928742 (+ 31295us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.936190 (+  7448us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2398531,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":202522,"apply.run_cpu_time_us":27980,"apply.run_wall_time_us":985828,"num_ops":8,"prepare.queue_time_us":415091,"prepare.run_cpu_time_us":70783,"prepare.run_wall_time_us":470612,"raft.queue_time_us":221743,"raft.run_cpu_time_us":24868,"raft.run_wall_time_us":223444,"replication_time_us":579222,"spinlock_wait_cycles":10466560,"thread_start_us":837400,"threads_started":5,"wal-append.queue_time_us":371513,"wal-append.run_cpu_time_us":54737,"wal-append.run_wall_time_us":2358838}]]}
W20260709 12:10:30.752291  8760 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.009s	sys 0.017s
I20260709 12:10:30.752173 11127 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.752975 11127 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.752252  8830 rpcz_store.cc:269] 0709 12:10:28.215928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.216056 (+   128us) service_pool.cc:224] Handling call
0709 12:10:30.746513 (+2530457us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b540038a4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:30.746862 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20471040}
W20260709 12:10:30.753230  8760 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.442s	user 0.009s	sys 0.017s
I20260709 12:10:30.751513 11006 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.751185 11136 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:30.760975 11136 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.762070 11127 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.764945 11127 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.770056 11073 raft_consensus.cc:993] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:30.770674 11073 raft_consensus.cc:1081] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:30.780531 11136 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:30.781180 10938 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.783842 11136 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.879705 11080 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:30.960987 10689 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:30.962028 10689 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:30.965993 11040 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.121616 10689 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.144909 10968 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.175429  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 317) took 3729 ms. Trace:
I20260709 12:10:31.175824  8827 rpcz_store.cc:276] 0709 12:10:27.445505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.446263 (+   758us) service_pool.cc:224] Handling call
0709 12:10:27.446611 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.259761 (+1813150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.259806 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.259855 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.259895 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.175055 (+1915160us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000e4f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:31.175094 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.175270 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169013504}
W20260709 12:10:29.470821  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 44334.1us
W20260709 12:10:31.191821  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.193014  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.195488  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 330) took 1812 ms. Trace:
W20260709 12:10:31.195849  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.196044  8826 rpcz_store.cc:276] 0709 12:10:29.383334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.412682 (+ 29348us) service_pool.cc:224] Handling call
0709 12:10:31.194779 (+1782097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.195049 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.195080 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.195158 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:31.195196 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.195256 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.195391 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:31.197378  9488 connection.cc:256] RPC call timeout handler was delayed by -1.4730422089999138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 12:10:31.197988  9488 connection.cc:256] RPC call timeout handler was delayed by -1.4245844129998204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 12:10:31.213407 11087 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.254680  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:31.255695  8801 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:31.258371 11136 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.258414  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.259155 11136 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.260967  9525 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:31.262442  8724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.916s	user 0.016s	sys 0.019s
W20260709 12:10:31.263068  8724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.016s	sys 0.019s
I20260709 12:10:31.262742  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.265700 11136 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.266367 11136 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.267380 11136 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.270717 11136 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.271313 11127 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:31.272377  8799 connection.cc:256] RPC call timeout handler was delayed by -1.7653728819998378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 12:10:31.272770 11127 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:31.272926  8799 connection.cc:256] RPC call timeout handler was delayed by -1.616872881999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:10:31.273360  8799 connection.cc:256] RPC call timeout handler was delayed by -1.5835728819999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:10:31.273792  8799 connection.cc:256] RPC call timeout handler was delayed by -1.482860171999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:10:31.274119  8799 connection.cc:256] RPC call timeout handler was delayed by -1.4374761409999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
I20260709 12:10:31.273995 11127 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.278204 11136 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.278715 11136 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.281632 11136 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.280545  8724 connection.cc:256] RPC call timeout handler was delayed by -1.9802698210000926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:10:31.284863  8724 connection.cc:256] RPC call timeout handler was delayed by -1.6859088360001806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:10:31.285254  8724 connection.cc:256] RPC call timeout handler was delayed by -1.6031698209999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:10:31.285573  8724 connection.cc:256] RPC call timeout handler was delayed by -1.4710210709999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:10:31.285907  8724 connection.cc:256] RPC call timeout handler was delayed by -1.3043088360002457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 12:10:31.289812  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.290766  9525 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:31.292390  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.302675 10998 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.303437 11136 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:31.305101  8828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1698) took 4734 ms (client timeout 2189 ms). Trace:
W20260709 12:10:31.305585  8828 rpcz_store.cc:269] 0709 12:10:26.570352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.598209 (+ 27857us) service_pool.cc:224] Handling call
0709 12:10:31.304619 (+4706410us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54001edcd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:31.304885 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015135488}
W20260709 12:10:31.285921  8901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 1958) took 3580 ms (client timeout 2234 ms). Trace:
W20260709 12:10:31.307401  8835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.953s	user 0.011s	sys 0.013s
W20260709 12:10:31.307924  8835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.954s	user 0.011s	sys 0.013s
I20260709 12:10:31.308853  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1706) took 3849 ms. Trace:
I20260709 12:10:31.309206  8835 rpcz_store.cc:276] 0709 12:10:27.459941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.460072 (+   131us) service_pool.cc:224] Handling call
0709 12:10:27.496170 (+ 36098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.528044 (+ 31874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.528100 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.528776 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.353610 (+1824834us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18004535e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:10:31.308314 (+1954704us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.308368 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.308490 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.308529 (+    39us) raft_consensus.cc:1685] finished
0709 12:10:31.308544 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.308804 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22203,"raft.queue_time_us":31361,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":11649,"spinlock_wait_cycles":5260032,"thread_start_us":1954476,"threads_started":1,"wal-append.queue_time_us":1964054,"wal-append.run_cpu_time_us":3735,"wal-append.run_wall_time_us":1017505}
W20260709 12:10:31.307603  8901 rpcz_store.cc:269] 0709 12:10:27.705746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.707346 (+  1600us) service_pool.cc:224] Handling call
0709 12:10:31.285611 (+3578265us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400117954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:31.285794 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3917725440}
I20260709 12:10:31.268530  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 1945) took 5327 ms. Trace:
I20260709 12:10:31.312320  8908 rpcz_store.cc:276] 0709 12:10:25.943527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.943955 (+   428us) service_pool.cc:224] Handling call
0709 12:10:25.952261 (+  8306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.039982 (+3087721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.268204 (+2228222us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b540019b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:31.268453 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7094995200}
I20260709 12:10:31.303483 10998 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.313694 11136 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.314528 11136 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.315104 11136 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.315637 10998 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.316361 10998 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.386477  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:31.383131 10998 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.387729  9525 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:31.389572 10998 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.390257 10998 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:31.390799 10998 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.393410 11054 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.394160 11054 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.328315 11061 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:31.401409 10998 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.381867 10689 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:31.402139 10998 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:31.402556 10689 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.403776  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1550) took 5375 ms. Trace:
I20260709 12:10:31.405092 10689 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:31.405616  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.402060 11087 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:31.421459  9489 connection.cc:256] RPC call timeout handler was delayed by -1.4108577740000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:10:31.421216 11087 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.423030 11097 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.423753 11087 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.423638 11097 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.404209  8752 rpcz_store.cc:276] 0709 12:10:26.027931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.028060 (+   129us) service_pool.cc:224] Handling call
0709 12:10:26.119922 (+ 91862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.889720 (+1769798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.403225 (+3513505us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54000389d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:31.403552 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4068057344}
I20260709 12:10:31.426740 11097 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.402782 10998 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:31.561426  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 120170us
W20260709 12:10:31.419080  8799 connection.cc:256] RPC call timeout handler was delayed by -1.3235208969997529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:10:31.562549  8799 connection.cc:256] RPC call timeout handler was delayed by -1.2630611109998426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:10:31.409556  8726 connection.cc:256] RPC call timeout handler was delayed by -1.9256063230000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 12:10:31.428486  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:31.430013 11054 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.424343 11087 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.430348  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:31.617852  8835 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.431753  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.432112  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.433184  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.434234  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.434283  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:31.435865  8829 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:31.437165  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:31.437814  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1570) took 2205 ms. Trace:
I20260709 12:10:31.438424  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:31.418555 11073 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.659364  8827 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:31.607865  8828 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:31.667223  8832 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:31.676870  8830 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.674795  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 178584us
W20260709 12:10:31.731233  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 72289.8us
W20260709 12:10:31.608251  8726 connection.cc:256] RPC call timeout handler was delayed by -1.5714325430001281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:10:31.616245  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 264804us
W20260709 12:10:31.661554  8799 connection.cc:256] RPC call timeout handler was delayed by -1.0180593469999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:10:31.736790  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.737447  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.737991  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.659857  8760 rpcz_store.cc:276] 0709 12:10:29.234336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.236243 (+  1907us) service_pool.cc:224] Handling call
0709 12:10:29.236845 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.311019 (+ 74174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:30.753860 (+1442841us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.760460 (+  6600us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.760519 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:30.760572 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.437547 (+676975us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b54000398d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:31.437595 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.437733 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57557,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":4592,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"spinlock_wait_cycles":169233664,"thread_start_us":1443465,"threads_started":2,"wal-append.queue_time_us":4637}
I20260709 12:10:31.670313 11054 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:31.670959 11136 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.753212  8828 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:31.743186 11087 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.754405 10998 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.755118 10998 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.670826 11073 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.755947 10998 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:31.757123  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 327788us
I20260709 12:10:31.769670  8799 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:31.778018  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:31.780836  9519 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.782137  8828 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:31.784926 11136 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.785173  8799 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:31.786227 11136 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.784482  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.764847 11054 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.789685 11054 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.756515 11087 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:31.790194  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.786957  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:31.796706  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:31.797431  8760 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:31.798346  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.799697  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:31.790556 11087 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:31.800913  8828 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:31.801088 11087 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:31.802825  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:31.805709  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1687) took 5846 ms. Trace:
I20260709 12:10:31.806563  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:31.805192 10998 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.806113  8834 rpcz_store.cc:276] 0709 12:10:25.958637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.959354 (+   717us) service_pool.cc:224] Handling call
0709 12:10:26.602544 (+643190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.023773 (+421229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.061011 (+2037238us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54001fe0d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:31.805248 (+2744237us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54001fe0d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:31.805480 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445937280}
I20260709 12:10:31.803594 11087 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:31.810590  8760 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:31.812743  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.820060  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.839557  8754 raft_consensus.cc:2410] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:31.858826  8835 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:31.872867  8830 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:31.821030 11073 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:31.905941  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 116448us
I20260709 12:10:31.840152 11136 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.883074  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.879853 11087 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.960996  9523 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:31.966743  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:31.970932  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.971205 11089 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:31.971802 11089 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:31.972074  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.973469  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.973984 11089 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:31.974085  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:31.972471  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.980540  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.107631  8754 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.107890  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.956660  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.108798  8755 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.108912  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.109288  9516 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:32.109776  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.993017  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:31.982975  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:32.110236  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.110702  9519 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.111123  8759 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:31.997005  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.111284  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.111714  8834 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:32.112074  9518 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:32.116112  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.117213  9517 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.089475 11154 ts_tablet_manager.cc:933] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:32.089345  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 120741us
I20260709 12:10:32.093047 11089 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.122504  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:32.122952  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.123152  8828 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.123596  8759 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.123636 11089 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.105533  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.105792  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.110980  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.124352 11089 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.125679  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.126624 11089 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:32.126844  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:31.996800  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:31.974751  8758 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.127533  8827 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.092892  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 91643.5us
I20260709 12:10:32.118634  8834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:32.133216  8834 raft_consensus.cc:606] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:32.133618  8834 raft_consensus.cc:614] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:32.110260  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.127214 11089 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.127899  8757 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:32.136078  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.141261  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.143872  8758 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:32.144905  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.147820  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.148197 11083 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.149501  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.151559  8830 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:32.145937  8754 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.154340  8760 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:32.156643 11089 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.159138  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.163251  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:32.168512  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.168028  9487 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:32.170251 10779 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.171139 10779 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:32.172504 10779 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.176749  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:32.166298  9519 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:32.181241  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:32.183621  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:32.185863 11073 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.186313 10998 raft_consensus.cc:3055] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.192291 11073 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:32.193564 11073 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:32.197081 11132 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 1.564s	user 0.014s	sys 0.000s
I20260709 12:10:32.198236 11136 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:32.209805  8753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.889s	user 0.007s	sys 0.040s
W20260709 12:10:32.210461  8753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.897s	user 0.007s	sys 0.040s
I20260709 12:10:32.211723  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:32.191197 11089 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:32.188819 10998 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:32.213794  8906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1535) took 5531 ms (client timeout 2031 ms). Trace:
W20260709 12:10:32.214196  8906 rpcz_store.cc:269] 0709 12:10:26.681755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.822486 (+140731us) service_pool.cc:224] Handling call
0709 12:10:32.213384 (+5390898us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54003d1b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:32.213579 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331201280}
I20260709 12:10:32.214628 10998 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.215970 11154 tablet_copy_client.cc:323] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:10:32.221262  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:32.222707  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:32.225180  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:32.242851  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 70390.5us
I20260709 12:10:32.247457  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.248178  8751 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.257568  8726 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:32.259653  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1569) took 3032 ms. Trace:
I20260709 12:10:32.268541 10931 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:10:32.311453  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 54021.5us
W20260709 12:10:32.268007  8874 connection.cc:256] RPC call timeout handler was delayed by -3.562390816000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 12:10:32.313184  8874 connection.cc:256] RPC call timeout handler was delayed by -2.9114355090000572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:10:32.313771  8874 connection.cc:256] RPC call timeout handler was delayed by -2.8934355090000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:10:32.314209  8874 connection.cc:256] RPC call timeout handler was delayed by -2.8781355090000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:10:32.263167  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:32.314656  8874 connection.cc:256] RPC call timeout handler was delayed by -2.8430355089999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:10:32.265188  8799 connection.cc:256] RPC call timeout handler was delayed by -1.56835981800009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 12:10:32.315605  8874 connection.cc:256] RPC call timeout handler was delayed by -2.8151355089999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:10:32.316262  8799 connection.cc:256] RPC call timeout handler was delayed by -1.5035598179999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 12:10:32.316509  8874 connection.cc:256] RPC call timeout handler was delayed by -2.5883355089999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:10:32.316648  8799 connection.cc:256] RPC call timeout handler was delayed by -1.3910598180000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:10:32.316993  8874 connection.cc:256] RPC call timeout handler was delayed by -2.4425355089999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:10:32.315544  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52459.2us
W20260709 12:10:32.317056  8799 connection.cc:256] RPC call timeout handler was delayed by -1.3559598179999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:10:32.317469  8874 connection.cc:256] RPC call timeout handler was delayed by -2.374135509000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:10:32.317596  8799 connection.cc:256] RPC call timeout handler was delayed by -1.3343598180001663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:10:32.317860  8874 connection.cc:256] RPC call timeout handler was delayed by -2.3345355090000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:10:32.317956  8799 connection.cc:256] RPC call timeout handler was delayed by -1.2182598179999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:10:32.318259  8874 connection.cc:256] RPC call timeout handler was delayed by -1.8791355089999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2669s for a response
W20260709 12:10:32.318346  8799 connection.cc:256] RPC call timeout handler was delayed by -1.1831598180001492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 12:10:32.318684  8874 connection.cc:256] RPC call timeout handler was delayed by -1.78193550900005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2777s for a response
W20260709 12:10:32.319162  8874 connection.cc:256] RPC call timeout handler was delayed by -1.3256355089999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3284s for a response
W20260709 12:10:32.318747  8799 connection.cc:256] RPC call timeout handler was delayed by -1.1696598180001274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:10:32.319617  8799 connection.cc:256] RPC call timeout handler was delayed by -1.05535981800017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:10:32.320290  8799 connection.cc:256] RPC call timeout handler was delayed by -1.0463598180001554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 12:10:32.320075  8726 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:32.323366  8872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.857s	user 0.018s	sys 0.021s
W20260709 12:10:32.326478  8872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.860s	user 0.018s	sys 0.021s
I20260709 12:10:32.335626 10999 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.336417 10999 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.260187  8753 rpcz_store.cc:276] 0709 12:10:29.227386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.227566 (+   180us) service_pool.cc:224] Handling call
0709 12:10:29.232853 (+  5287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.233431 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:29.266059 (+ 32628us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.259257 (+2993198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.259319 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:32.259373 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.259443 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.259574 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45288,"prepare.queue_time_us":103804,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3299,"thread_start_us":2945266,"threads_started":2,"wal-append.queue_time_us":1424053,"wal-append.run_cpu_time_us":1194,"wal-append.run_wall_time_us":1016048}
I20260709 12:10:32.295461  8828 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:32.338636  8827 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:32.339253  8834 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:32.288196 11149 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:32.263367  9546 debug-util.cc:398] Leaking SignalData structure 0x7b0800171540 after lost signal to thread 7581
I20260709 12:10:32.336951 10999 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.354696  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.357904 11039 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:32.358774 11039 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.358609  8658 catalog_manager.cc:5697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.361415 11039 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:32.361627  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08002bcf60 after lost signal to thread 8692
W20260709 12:10:32.362097  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd1e0 after lost signal to thread 8706
W20260709 12:10:32.363847  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb100 after lost signal to thread 8784
W20260709 12:10:32.364233  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb440 after lost signal to thread 8785
I20260709 12:10:32.365581  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.365636  8658 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.369776  8906 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:32.371031  8904 raft_consensus.cc:1240] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.370047  8751 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:32.372800  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.373046  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:32.374357  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 61621.7us
I20260709 12:10:32.374898  8907 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:32.375286  8907 pending_rounds.cc:85] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 3
I20260709 12:10:32.375543  8907 pending_rounds.cc:107] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:32.375865  8907 raft_consensus.cc:2889] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:32.376754 11089 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:32.377209  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.377460 11089 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.378986  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.379719  8900 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.379875 11089 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:32.382915  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.383659  9522 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:32.383978  9519 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:32.384829  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:32.383157  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.386098  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:32.386998  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.387324  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.387993  8909 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.388041  8875 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:32.389215  8875 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:32.391057 11089 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.391607 11089 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:32.391638 11156 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.392299 11156 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.392699 11156 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.392840 11089 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.395063  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.395860  8901 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:32.396584  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.396849  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.398036  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.397384  8754 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.398274  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.398196  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.402890  8756 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.398976  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.397251  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.399037  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.399984  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.400694  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.400951  8753 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.406733  8907 raft_consensus.cc:2410] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:10:32.412241  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55144.2us
I20260709 12:10:32.412392  8900 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.413585  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.414259  8758 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
W20260709 12:10:32.416487  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.454097  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.455098  8753 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:32.454198  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.457084  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.415409  8757 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.454137  8908 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.446931  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.465723  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.466706  8758 raft_consensus.cc:2410] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:32.403071 11114 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.468979  8903 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:32.468914  8798 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.692s (SENT)
I20260709 12:10:32.473351  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.476171  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.476413  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.476933  8754 raft_consensus.cc:2376] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5. Re-sending same reply.
W20260709 12:10:32.476969  8798 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.703s (SENT)
I20260709 12:10:32.474059  8752 raft_consensus.cc:2376] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:32.478065  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.413462 11039 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:32.479521  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.483042  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.475109  8751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43816
W20260709 12:10:32.501941  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08003a35a0 after lost signal to thread 8859
W20260709 12:10:32.503736  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9ae0 after lost signal to thread 8933
W20260709 12:10:32.504170  9546 debug-util.cc:398] Leaking SignalData structure 0x7b080032bc80 after lost signal to thread 8934
I20260709 12:10:32.564670  8751 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:32.565263  8751 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.564612  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.566267  8758 raft_consensus.cc:2376] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6. Re-sending same reply.
W20260709 12:10:32.566586  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 86700.4us
W20260709 12:10:32.567408  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46135.2us
I20260709 12:10:32.569017  8759 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:32.480885  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:32.567169  8904 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.570410  8909 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:32.571607  8756 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:32.570967  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:32.573297  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 96356.7us
I20260709 12:10:32.573936  8760 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:32.574241  8798 leader_election.cc:336] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.780s (SENT)
I20260709 12:10:32.575395  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.574811  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:32.623065  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.623880  8758 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.625007  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.625589 10954 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.626021  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35690 (request call id 451) took 1207 ms. Trace:
I20260709 12:10:32.626405  9524 rpcz_store.cc:276] 0709 12:10:31.418595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.577815 (+1159220us) service_pool.cc:224] Handling call
0709 12:10:32.625947 (+ 48132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.637320  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.638545  8760 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:32.640396  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.646341  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.647181  8755 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:32.635222 11073 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.653107  9524 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.652985  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.655645 11054 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.656482 10998 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.657965  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.665472  8751 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.665186  8758 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
W20260709 12:10:32.666944  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 311345us
W20260709 12:10:32.670547  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.667975  8798 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.844s (SENT) [suppressed 57 similar messages]
I20260709 12:10:32.677181 11156 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:32.644241  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08003455a0 after lost signal to thread 9549
I20260709 12:10:32.685647  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.692301 11156 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:32.696120  8758 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
I20260709 12:10:32.701277  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.702224  8903 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.709595  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.711722  8909 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:32.713254 11158 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:32.703845 10999 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.717341  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:32.722421  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:32.723289  8828 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.724690  9521 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.725620  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 555) took 1293 ms. Trace:
I20260709 12:10:32.725960  9521 rpcz_store.cc:276] 0709 12:10:31.432063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.436753 (+  4690us) service_pool.cc:224] Handling call
0709 12:10:32.497301 (+1060548us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:32.572791 (+ 75490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.725282 (+152491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.725535 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7045888}
W20260709 12:10:32.727747 11166 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:32.729260  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1715) took 1069 ms. Trace:
I20260709 12:10:32.729650  8831 rpcz_store.cc:276] 0709 12:10:31.660058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.361190 (+701132us) service_pool.cc:224] Handling call
0709 12:10:32.361776 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.362208 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.362241 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.363382 (+  1141us) log.cc:844] Serialized 506 byte log entry
0709 12:10:32.412216 (+ 48834us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:32.412466 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.416885 (+  4419us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.728910 (+312025us) raft_consensus.cc:1685] finished
0709 12:10:32.728931 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.729061 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":47256,"threads_started":1,"wal-append.queue_time_us":261096}
I20260709 12:10:32.730396  8751 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:32.733552 11087 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.734704 11087 raft_consensus.cc:3055] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.735137 11087 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:32.732311 10999 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:32.744107  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.745038  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.745378  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.745293  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.745946  8908 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:32.746398  8904 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.746968  8909 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:32.746376  8907 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.750939  8828 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:32.756135  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.760285  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:32.761137 10891 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.761941 10891 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.762748 11155 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.763343 11155 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:32.766786  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62681.1us
I20260709 12:10:32.766212  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:32.765021  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.767099  8827 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:32.772859  8798 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.922s (SENT)
W20260709 12:10:32.773694  8798 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.976s (SENT)
I20260709 12:10:32.775691  8903 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:32.774362  8798 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.991s (SENT)
I20260709 12:10:32.764530 10891 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:32.791822  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.736232 11087 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.799568  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.800765  8903 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:32.801178 10993 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.800777 11039 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:32.804260 11039 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.804749 11039 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:32.764357 11155 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:32.805310 11171 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:32.805755 11039 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.806922 11089 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:32.807524 11089 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:32.809579  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.811015  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.816095  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.817796  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.817926  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.818105  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.818863  8900 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.807153 11039 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.789145 10891 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:32.822480  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.823109  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.824579  8904 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:32.826999  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:32.827980  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.828754  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.829474  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.830922 10891 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.831336 10891 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:32.832269 10891 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.842280  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:32.843181  8900 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.844311  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.847708  9488 leader_election.cc:336] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.641s (SENT)
I20260709 12:10:32.848515  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:32.835256 11165 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
W20260709 12:10:32.852191  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.854216 10891 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.855614  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:32.857455  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:32.836273 11159 log.cc:927] Time spent T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 12:10:32.870359 11063 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.877386 11089 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:32.866458  8755 raft_consensus.cc:2376] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5. Re-sending same reply.
I20260709 12:10:32.887121  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.888067  8751 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.891727  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:32.892442  8798 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.118s (SENT)
I20260709 12:10:32.892995  8907 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
W20260709 12:10:32.894023  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.902064  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.898699  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:32.886453 11087 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.906477  8798 leader_election.cc:336] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.128s (SENT)
I20260709 12:10:32.908481  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:32.909015  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 93871.4us
I20260709 12:10:32.911607  8901 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.921144  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.921411  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.924669  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.927677  8755 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.925163  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.925064  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:32.926529  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.929037  8829 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:32.909714  8907 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.925450  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.928996  8756 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:32.930251  8834 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:32.927700  8760 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:32.932490  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:32.928423  8798 leader_election.cc:336] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.139s (SENT)
I20260709 12:10:32.936621  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:32.946282  8751 raft_consensus.cc:2376] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
I20260709 12:10:32.947163  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:32.952399  8828 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.927855  8831 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:32.953567  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:33.006048  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.954497  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.047348  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.000998  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:32.975353  8798 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.195s (SENT)
I20260709 12:10:33.057705  8830 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:32.991948  8829 raft_consensus.cc:2410] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:33.048002  8900 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:32.916455 11089 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:33.068066  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 92779.7us
I20260709 12:10:33.022126  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:33.048996 11172 log.cc:927] Time spent T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:10:32.963204  8724 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.534s (SENT)
W20260709 12:10:32.932720 11177 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.091s	user 0.002s	sys 0.002s
W20260709 12:10:33.081946  8798 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.227s (SENT)
I20260709 12:10:33.083235  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:32.970376 10936 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:33.088289  8798 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.241s (SENT)
I20260709 12:10:33.089490  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.089649  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:32.991065 11170 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.097843 11143 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.098050  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.100291  8834 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:33.105463  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:33.106024  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 217464us
I20260709 12:10:33.106406  8830 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.073911 11039 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:33.108469  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.107473  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.190640  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.117604  9521 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.117297  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.184298  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.198764  8900 raft_consensus.cc:2368] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5.
I20260709 12:10:33.154755  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.121433  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:33.128280  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 165101us
W20260709 12:10:33.112382 11178 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:10:33.208654  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.099546 11170 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.210820  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.211026  8832 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.210894  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.111989 10998 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.216516  8724 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.559s (SENT)
I20260709 12:10:33.225468 11187 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:33.226513 11090 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.227025 11090 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.229404  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.231011  8904 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:33.229321 11090 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:33.225543 11180 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:10:33.234242  8901 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:33.234074  8826 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.237208  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.237658  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.238059  8902 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:33.238255  8904 raft_consensus.cc:2376] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4. Re-sending same reply.
I20260709 12:10:33.239099  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.238883  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.247895  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.250936  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:33.251543  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 144837us
I20260709 12:10:33.251744  8904 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:33.252449  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.252707  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.252707  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.254184  8874 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.256106  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.253849  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.257124  8904 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:33.257959  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.259016  8902 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
I20260709 12:10:33.259591  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.260021  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.260854  8902 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:33.261814  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.263875 11187 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.264688 11187 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.265311 11187 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.265725 11187 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:33.267299  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:33.267917  8830 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.268211  8830 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:33.269068  8830 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.269966  8830 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.270169  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:33.272251  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.272573  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.273422  8909 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.273895  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.273186  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.214238 11170 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.277240  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.273867  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.278165  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.278462  8900 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:33.280869  8758 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.283928  8902 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.286464  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:33.287968  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.289340  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.110824 10936 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:33.292003  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.293354  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.293496 10936 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:33.294407  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.295110  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:33.296059  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.296980  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet d0e4c6e5758d4fb18617b5b7c30cd334 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:10:33.163007 11039 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:33.298025  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.306509  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.303890  8830 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:33.307427  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:33.307937  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 355089us
I20260709 12:10:33.308151  8909 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.299325  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.296576  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:33.309731  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.311486  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.318504  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.319180  8835 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:33.319834  8904 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.322715  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.323346  8826 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:33.323782  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.325942  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.331226  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.331697  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.332348  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.332757  8909 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.333493  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.333864  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.334569  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.334614  8909 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:33.350198  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.345806  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.351738  8901 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:33.352674  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.353941  8901 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:33.354508  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:33.356217  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44827.4us
I20260709 12:10:33.356323  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.357348  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:33.354873  9488 leader_election.cc:336] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.573s (SENT)
I20260709 12:10:33.353273  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.358112  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.359534  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:33.362332  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.363267  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.310715 11073 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.306154 11143 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.305899 10954 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:33.366354  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.266630 11187 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.318435 11136 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:33.369225  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.377465  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.326745  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet d0e4c6e5758d4fb18617b5b7c30cd334 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-d0e4c6e5758d4fb18617b5b7c30cd334
I20260709 12:10:33.353843 11171 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.386796  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.379756  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.326819 10936 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.322480 11114 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.394215  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.395021  8900 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:33.378794  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.355815 11175 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.365072 10931 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.395860  8909 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:33.378108 10954 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.382934 11136 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:33.394415  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:33.373328 10891 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:33.365605 11155 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:33.426417  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.394184 11114 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.390077 11063 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.438930  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.440428  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.441596  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.442117  8905 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.422820  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.402091 11175 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:33.432430  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 75160.9us
I20260709 12:10:33.427138 11136 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.402376 10931 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.406353  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.484140  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:33.475274  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 148041us
W20260709 12:10:33.478780  8785 heartbeater.cc:646] Failed to heartbeat to 127.7.102.190:46065 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.102.190:46065 timed out after 15.000s (SENT)
I20260709 12:10:33.479425 11063 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.405010 11143 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.480340  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.487718  8909 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:33.397202 10936 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.434311 10954 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:33.474844  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 151112us
I20260709 12:10:33.489205  8900 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.440461 11188 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:33.563906  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 152778us
W20260709 12:10:33.561807  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 206361us
W20260709 12:10:33.610574  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 137626us
W20260709 12:10:33.610610  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.579301  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.494351  8905 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:33.583235  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.437686 11114 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:33.572206  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 86399.5us
I20260709 12:10:33.476169 11175 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.569573  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 147450us
I20260709 12:10:33.617843  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.609403  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.617627  8909 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:33.619120  8905 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.488606 10931 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.499135 11087 consensus_meta.cc:287] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.003s
I20260709 12:10:33.633261  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.494701 11073 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:33.637638  8900 raft_consensus.cc:2410] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:33.626573  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.637195  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.639933  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:33.548225 11201 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.641250  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.641613 11156 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:33.625119 11204 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.655967  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.654531  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.656816  8905 raft_consensus.cc:2376] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5. Re-sending same reply.
I20260709 12:10:33.499789 11143 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:33.654932 11203 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:33.635924 11190 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:10:33.693985  8830 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.694659  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:33.684146  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.684659  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.685779  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:33.696165  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.696987  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:33.686489  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 311939us
I20260709 12:10:33.700264  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.700776  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.700941  8905 raft_consensus.cc:2376] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4. Re-sending same reply.
I20260709 12:10:33.696727  8900 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 2.
W20260709 12:10:33.705143  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68072us
I20260709 12:10:33.705936  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:33.707094  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 80596.9us
I20260709 12:10:33.707583  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:33.708443  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.703500  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.683238 11143 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.713883  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.714461  8900 raft_consensus.cc:2410] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:33.715051  8901 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.716181  8908 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.713884  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:33.717830  8905 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:33.721124  8908 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.682958 11204 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:33.723970  8908 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.700278 11039 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:33.686945 11203 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:33.725477  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:33.706349 11171 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.743990 11203 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.756383 11195 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:10:33.735083 11204 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.759492  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 119620us
I20260709 12:10:33.768733  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.770268  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.771631  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:33.760854  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47712.3us
I20260709 12:10:33.683419 11201 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:33.747124 11089 consensus_meta.cc:287] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.671s	user 0.002s	sys 0.009s
I20260709 12:10:33.718812 11087 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:33.742901 11202 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:33.743784 11216 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.802541  8906 raft_consensus.cc:2410] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:33.816617 11211 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.817289 11211 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:33.819664 11211 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:33.820199 11211 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.820717 11199 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:33.821390 11199 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:33.822433 11199 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.803648 11202 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.835803  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 99885us
I20260709 12:10:33.816686 11090 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.848078  9488 leader_election.cc:336] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.903s (SENT)
I20260709 12:10:33.848946  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:33.834060 11211 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:33.858271  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 157103us
I20260709 12:10:33.866165  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.836037 11202 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.774020 11073 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.878621  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:33.881632 11220 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:33.874218 11216 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:33.883315 11216 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:33.883904 10931 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:33.867614 11207 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.886164 11216 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:33.888968  8909 raft_consensus.cc:2376] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3. Re-sending same reply.
W20260709 12:10:33.889534  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.878259 11197 log.cc:927] Time spent T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 12:10:33.901441  8904 consensus_meta.cc:287] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:10:33.905479  8904 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:33.907658  9521 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.877277 10891 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:33.909384  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 93507.3us
I20260709 12:10:33.923489  8900 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.922559  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:33.929843  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.930366  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:33.931668  8834 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:33.901180 10936 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:33.943652  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 329057us
W20260709 12:10:33.952008  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 83554.9us
W20260709 12:10:33.954905  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 183376us
I20260709 12:10:33.956337  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.894155 11209 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.198s
I20260709 12:10:33.938823 10998 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.951213  8830 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:10:33.958994  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.951167 11171 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:34.001149  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44877.4us
I20260709 12:10:34.002053  8725 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.954617 11087 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:34.014329  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 55475.8us
I20260709 12:10:34.022498  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.022655  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.000288 11090 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.024617  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:33.987623 11187 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 12:10:34.039309 11223 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:34.040657 10931 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.043687 11202 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.045655  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:34.004122 11171 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:34.049105 11171 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.009150 10891 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:34.050275 11231 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.050698 10891 consensus_queue.cc:1243] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:34.051721 11201 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.052101  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.053845 10931 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.054352  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.055243 10931 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.056252  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.058236 10931 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.062572  8724 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.062846 11136 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.063915  8829 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.024650 11237 raft_consensus.cc:2764] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:34.066159 11202 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.068863 10931 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.073335  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.069075  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:34.078042  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:34.083719  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58165us
I20260709 12:10:34.098598  9488 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.083412  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.113056  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.033301 11217 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:34.126482  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.135097  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51796.2us
W20260709 12:10:34.135529  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260709 12:10:34.137172  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.096282 11229 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.144927 11227 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:34.145675 10936 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.146091 11202 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.146776 11202 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.147210 11202 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.147535  8724 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.081425 10931 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:34.072986 11221 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.140861  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:34.138773 10998 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.134845 11187 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:34.135211 11114 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.008s
I20260709 12:10:34.026177 11218 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:10:34.152969  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.120512 11087 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.164958  8833 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:34.166036  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 449479us
I20260709 12:10:34.167176  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.149066 10779 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.151870 10931 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.146299 10936 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:10:34.173703  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.158533 11214 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.298s	user 0.002s	sys 0.000s
I20260709 12:10:34.154712 11209 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.076478 11175 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.184690  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.164449 11136 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.186870 11229 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.189421  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.192270  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.181998 11217 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.194015  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.196702 10705 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.197162 11175 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.197222 11051 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:34.197916 11103 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:34.199779 11212 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.440s	user 0.002s	sys 0.002s
I20260709 12:10:34.200268  8835 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.200932 11222 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.164165 11114 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.205132 10936 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.182531 11209 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:34.207095  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:34.209669 10954 consensus_meta.cc:287] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
W20260709 12:10:34.262108  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55140.3us
I20260709 12:10:34.211215  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:34.261451 11233 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:10:34.217590  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.262019 10954 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.182821 11073 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:34.250926  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.255013  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.255914  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.277987  8757 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.249217 11103 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:34.257030 11051 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:34.259153 11203 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:10:34.215735  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:34.263278  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52139us
I20260709 12:10:34.263648  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.218617  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.220655 11217 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:34.279313  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 131832us
I20260709 12:10:34.285598  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.247416 11090 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:34.278548  8753 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:34.261375 11209 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.285735  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 67233.3us
W20260709 12:10:34.262650 11170 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.952s	user 0.013s	sys 0.000s
I20260709 12:10:34.287654  8756 raft_consensus.cc:2368] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:34.265062 10779 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.295013  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.253645 11222 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:34.289112 11143 consensus_meta.cc:287] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.003s
I20260709 12:10:34.282056 11103 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.288147 11217 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.299986 11170 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.311844  8832 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:34.316920  8757 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:34.290977 11136 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.320380  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:34.321158  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 154051us
W20260709 12:10:34.322685  8799 leader_election.cc:336] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.548s (SENT)
W20260709 12:10:34.329351  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.313877 11222 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.314181 11175 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.284896 11202 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.299443 11090 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.338146  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:34.339900  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 76872.5us
I20260709 12:10:34.323195 11231 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.342916  8902 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:34.317436 10779 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:34.344871 11114 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.346686 11202 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:34.341301  8799 leader_election.cc:336] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.620s (SENT)
I20260709 12:10:34.289074 11203 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.285219 11073 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.350026  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.318992 11143 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.339747 11218 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.339169 11171 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.359882 11248 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.361881  8901 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:34.353266  8724 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.366099 11202 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.366166  8799 leader_election.cc:336] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.745s (SENT)
I20260709 12:10:34.367847  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:34.359138 11204 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.000s
I20260709 12:10:34.371526  8831 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:34.371800  8799 leader_election.cc:336] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.784s (SENT)
I20260709 12:10:34.375717 11171 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:34.371385 11237 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:34.367633 11114 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:34.353653 10779 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.378849 11073 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:34.380882  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:34.383082  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.382472 11203 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.363773 11218 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.392326  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.395553 11114 consensus_queue.cc:1243] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:34.373032 11246 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.392357 11051 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.371563 11204 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.397708 11090 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.398384  8752 raft_consensus.cc:2393] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:34.399206 11204 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.317404 11229 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.404471  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.405092  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.370436 11202 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.412813  8901 raft_consensus.cc:2393] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:34.417888  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.418179  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.418108  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:34.422066  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48418.2us
I20260709 12:10:34.394158 11218 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.427439  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.428068  8905 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.429162 11188 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.429672 11143 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.429767 11188 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.417158 11227 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.432195 11227 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.424252 11244 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.433681 11170 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.434432 11227 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.434513 11244 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.439801  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:34.446655  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 78044us
I20260709 12:10:34.447355  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.448124  8904 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.454258  8799 leader_election.cc:336] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.031s (SENT)
I20260709 12:10:34.454954  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.390430 11073 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.424782 11246 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.432595 11188 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.483649  9521 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.472208 11136 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.489915  8904 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:34.482324 11244 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:34.476485 10954 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:34.496111 11193 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:34.515018  8905 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
W20260709 12:10:34.517920  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 160174us
W20260709 12:10:34.517982  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 63768.4us
W20260709 12:10:34.518746  8872 connection.cc:256] RPC call timeout handler was delayed by -2.9747631669999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:34.520780  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.521821 10891 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:34.522140  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.522431 10891 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.523377  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.523980  8826 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:34.527429  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:34.474294 11246 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.530766 11246 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.532512  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.533483 11206 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.533898 11206 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.534828 11206 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.521834  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.537643  8830 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:34.537889  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.522763  8828 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.540418  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.540035  8834 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:34.519610  8799 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.808s (SENT)
I20260709 12:10:34.540694  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.541355  8900 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:34.542174  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.542982  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.543309  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.536244 11206 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.544957  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.546687  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.548085  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.548843  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.549556  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.549495 11209 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.542243  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.551936 11209 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.552567  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.553256  8900 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:34.553013 11089 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:10:34.556901 11103 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.559854  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.560616  8757 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:34.563524  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.565320  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.566437  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.566885  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.567566  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.568087  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.504205 11222 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.569101  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.570272 11222 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.570371  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.536929 10891 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.567811 11218 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.572105  8904 raft_consensus.cc:2393] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:34.573513 11248 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.565302  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.573997 11248 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.574947 11248 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.576819 11218 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.577564  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.578910  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.577916  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.582607  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:34.584023  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 64438.2us
I20260709 12:10:34.576400 11248 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.589946  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.590349  8758 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.594632  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.595301  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.596604  8900 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:34.597272  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.597700  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.598580  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.598603  8900 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:34.599968  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.600230  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.601872  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.603648  8835 raft_consensus.cc:2393] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:34.603739  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 1996) took 1234 ms. Trace:
I20260709 12:10:34.605830  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.617686  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.618436  8835 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:34.619192  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.610414  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.604321  8902 rpcz_store.cc:276] 0709 12:10:33.363242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.386536 (+ 23294us) service_pool.cc:224] Handling call
0709 12:10:34.586233 (+1199697us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540009c4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:34.586385 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180872064}
I20260709 12:10:34.625475  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.626091  8829 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.627465  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.628654  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:34.629751  8903 raft_consensus.cc:2368] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:34.630817 10936 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.636759 11073 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:34.645589 11240 log.cc:927] Time spent T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.348s	user 0.005s	sys 0.000s
I20260709 12:10:34.647517 11217 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.649250 11103 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.649863 11217 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.650914 11221 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.651084  8759 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:34.651355 11221 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:34.652381 11221 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.567636 10931 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.653867 11221 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.655481 10931 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:34.656723  8751 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.656504  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.659559  8827 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:34.659718  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:34.662940  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52642.1us
I20260709 12:10:34.664425  8760 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:34.667094  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:34.667894  8909 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.670342  8751 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:34.664048  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.677977  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:34.681003 11252 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.681425 11252 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.681803 11252 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.682235  8903 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.684183 11201 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:34.679574 11136 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:34.685025 11201 consensus_queue.cc:1243] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:34.685922 10954 consensus_queue.cc:1059] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.686381 11201 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.686774 10954 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.687124 10954 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:34.688010 11201 raft_consensus.cc:3055] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.688383 11201 raft_consensus.cc:740] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:34.693620  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.624557 11209 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.701583  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.695122  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.703996  8760 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
W20260709 12:10:34.706470  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 116597us
I20260709 12:10:34.709343  8828 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:34.679402 11199 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.714432 11209 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.720856 11222 consensus_queue.cc:1059] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:34.719895 11199 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:34.738749  8909 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:34.733253  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.729122 11209 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.721323 11250 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:34.728180 11258 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:34.725786 11170 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:34.729960 11136 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:34.761149 11258 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.761621 11258 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:34.761341 11136 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.762511 11258 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.763689 11258 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.765374 11218 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.765976 11218 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:34.767176 11218 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.748811 11222 consensus_queue.cc:1243] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:34.738365 11199 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.789320  8760 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.790249  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.790459  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.791533  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.791695  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.792409  8754 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:34.760356 11250 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.753973  8757 raft_consensus.cc:2410] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:34.793318 10931 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.794302  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.797030  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.774113  8829 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:34.783280 11252 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.792833 11250 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:34.793409 11229 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.796288 11187 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.798878 11039 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.800422  8754 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.772300 11269 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.801578  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.802440  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:34.724756 10954 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.833343  8724 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:34.803020  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.798732 11006 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.772891 11218 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.804220  8756 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:34.837710  8724 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:34.804258  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:34.758819  8752 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:10:34.829839  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:34.808734  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 150091us
I20260709 12:10:34.839071  8755 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:34.832551  8753 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:34.841477  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:34.809091 11224 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:34.844808  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.846328  9522 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:34.846941  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.838047 10931 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.862361  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.841431 11248 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:34.844012 11203 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.833231 11073 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:34.856516 11231 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.879108  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.856828 11269 raft_consensus.cc:2764] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:34.857322 10954 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.855791 11235 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.834272 11187 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.835605 11039 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.902532  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.908614  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.910409  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.886253 11248 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.887768 10931 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.914445  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:34.923789  8755 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.917053 11219 raft_consensus.cc:3055] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:34.920962 11259 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.921268  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:34.918535 11187 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:34.921311  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.921963 11188 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.889211 11203 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:34.912210 11221 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.929445  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:34.948537  8832 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.931071  8831 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:34.894299 11231 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:34.935055  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:34.936857  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 95357.1us
I20260709 12:10:34.928530  8907 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:34.955052  8907 pending_rounds.cc:85] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
I20260709 12:10:34.954993  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:34.955281  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.858952 11224 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:34.946692  8833 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.897209 11267 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:34.950347  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.955451  8907 pending_rounds.cc:107] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 5.6
W20260709 12:10:34.956792  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 67779.4us
I20260709 12:10:34.913982 11263 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.957453  8907 raft_consensus.cc:2889] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.941171  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:34.958376  8835 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:34.926203 11219 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:34.966205  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.968962 10931 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:34.976905  8799 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.977936 11269 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.978663  8799 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.978942 11224 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:34.979909 11216 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.980050 11249 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:34.980329  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.981264 11216 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.982151 11187 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.982582  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.983543 11216 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.985865  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.992002  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:34.992731 11216 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.995496  8799 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:34.996796 11216 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:34.962867 11073 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.997323 11170 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.999351 11248 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.001104 11216 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:35.002856 11228 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.000s	user 0.002s	sys 0.006s
I20260709 12:10:35.002728 11216 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.004007 11198 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.008378  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:35.010913 11271 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:35.011482 11221 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.012567  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 54849.4us
I20260709 12:10:35.013356  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:35.005600  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:35.014813  8798 leader_election.cc:336] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.064s (SENT)
I20260709 12:10:35.009114  8759 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:35.017608  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:35.019556  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:35.020251  8830 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.027855  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:35.030221  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:35.032042  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 149632us
I20260709 12:10:34.952054 10936 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.036698  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:35.009922 11252 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:35.037667 11249 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.035444 11274 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.035449 10779 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:35.136515  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 103685us
I20260709 12:10:35.040140 11227 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.145846 11269 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:35.147950  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 111254us
I20260709 12:10:34.961236 11259 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.033074 11073 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.238487  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:34.914816 11250 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:35.135658  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101750us
I20260709 12:10:35.237514  8830 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:35.034790 11143 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:35.163053  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 130843us
W20260709 12:10:35.252660  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 210479us
I20260709 12:10:35.154265 11224 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:35.168253 11249 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.169052 10936 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:35.274068  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:35.163798 11187 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:10:35.168526 11221 consensus_queue.cc:1059] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:10:35.173285 10779 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:35.281591  8759 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:35.030895  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:35.290012 11039 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:35.289830  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:35.179441 11269 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:35.292783  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:35.308542  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:35.254949 11143 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:35.277103 11249 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.256949 10998 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:35.275240 11254 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.271027 11216 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:35.281267 11073 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:35.340111 11277 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:35.275832 11231 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.343911 11201 consensus_queue.cc:260] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.257583 11225 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:35.350878  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:35.355904  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:35.179682 11203 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.179910 11199 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:35.305981  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:35.276556 11224 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.308686 11244 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:35.385265  8759 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:35.436375  8755 consensus_meta.cc:287] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
I20260709 12:10:35.482851  8906 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.396373  8904 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:35.421561  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:35.421483  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:35.471076  8832 consensus_meta.cc:287] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
W20260709 12:10:35.393553  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.360123  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 121751us
W20260709 12:10:35.396603  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 99938.7us
W20260709 12:10:35.577821  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 203201us
I20260709 12:10:35.323781 11143 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.416229 11263 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.632782 11218 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.792s	user 0.014s	sys 0.000s
I20260709 12:10:35.318118 11269 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.324862 11198 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.336s
W20260709 12:10:35.435354 11286 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:10:35.462877 10954 consensus_meta.cc:287] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.002s
W20260709 12:10:35.603305 11288 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:10:35.406038 11282 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:35.664381  8828 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.696771 11248 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.697502  8801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.009s
I20260709 12:10:35.644914  8755 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:35.688247  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:35.697870  8801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.011s	sys 0.009s
I20260709 12:10:35.649178  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:35.661535  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 310750us
W20260709 12:10:35.699400  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 523142us
I20260709 12:10:35.657934  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 391) took 1319 ms. Trace:
W20260709 12:10:35.675503  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 253524us
I20260709 12:10:35.293337 11089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40124 (request call id 7) took 9300 ms. Trace:
W20260709 12:10:35.699393  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50294.7us
W20260709 12:10:35.701912  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.701573  8725 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:35.373306 11039 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.702731  8832 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:35.700768  8907 rpcz_store.cc:276] 0709 12:10:34.338051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.338196 (+   145us) service_pool.cc:224] Handling call
0709 12:10:34.338591 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.957998 (+619407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.657664 (+699666us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540001ac54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:35.657866 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350659840}
W20260709 12:10:35.471642 11209 consensus_meta.cc:287] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.004s
W20260709 12:10:35.704552  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 55470.8us
I20260709 12:10:35.705089  8835 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.706350  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:35.712903  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:35.714639  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:35.653335 11188 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.597885 11283 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:35.666524 11198 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.661435 11258 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.716360  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:35.717821 11202 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.716416 11229 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:35.718410 11156 consensus_queue.cc:1059] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:35.719210  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:35.430539 10936 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.365633 11216 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.725807 11283 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.727236 11296 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.652411 11249 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.731197 11198 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:35.738560 11221 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:35.737356 11281 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:35.464208 10779 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.357327 11254 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.704051 11175 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.708897 11292 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.740270 11284 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.249s	user 0.003s	sys 0.002s
I20260709 12:10:35.705648 11089 rpcz_store.cc:276] 0709 12:10:25.981810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.048091 (+ 66281us) service_pool.cc:224] Handling call
0709 12:10:26.169946 (+121855us) log.cc:844] Serialized 506 byte log entry
0709 12:10:26.350240 (+180294us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:35.256903 (+8906663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60204,"raft.queue_time_us":196722,"raft.run_cpu_time_us":2613,"raft.run_wall_time_us":127539,"spinlock_wait_cycles":197271808,"thread_start_us":530696,"threads_started":2,"wal-append.queue_time_us":75970,"wal-append.run_cpu_time_us":6173,"wal-append.run_wall_time_us":1256774}
I20260709 12:10:35.356575 10998 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.705925 11201 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.650027 11006 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:10:35.743081  8799 leader_election.cc:400] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:35.746176  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:35.820572  8799 leader_election.cc:403] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:35.821463  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 75405.3us
W20260709 12:10:35.822475  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 90053.6us
I20260709 12:10:35.823249  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:35.750258  8835 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:35.754067  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:35.824303  8835 pending_rounds.cc:85] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:10:35.824579  8835 pending_rounds.cc:107] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:35.759768  8757 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:35.825081  8835 raft_consensus.cc:2889] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.760834  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:35.825970  8754 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:35.763160  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:35.827596  8755 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:35.775766 11258 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:35.732774 11224 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:35.823648  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:35.752771 11244 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.717259 11188 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:35.757855 11259 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.769677 11187 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.780820 11156 consensus_queue.cc:1243] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:35.713064 11039 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.777514 11217 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:35.814690  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47489.7us
I20260709 12:10:35.715718 11209 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.824530  8752 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.755170  8759 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.757382 11206 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.999246 11206 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:36.000365 11206 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:35.839227 11305 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.001523 11209 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:35.845237  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.001884 11305 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:36.002741  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 157641us
I20260709 12:10:36.003273  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.004140  8755 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:35.850021  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:35.862214  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:35.864107  8832 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:35.836546 11073 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.841398 11229 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.961598 11289 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 12:10:35.962477 11290 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:35.962919 11291 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.966521 10998 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:35.973824 11254 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:35.973951 11039 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:35.973037 11188 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:35.963447 11300 log.cc:927] Time spent T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:36.010285  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:35.976476 11249 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:35.862038 11220 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.931038 11217 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.930567 11187 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:35.984848 11283 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:35.987149 11269 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.987973 11156 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.988379 11216 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:35.990121  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:35.819013 11292 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:35.990916  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:35.990974 11198 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.005273  8827 raft_consensus.cc:2368] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:36.013365  8835 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.975095 11175 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.043433  9521 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:36.010759  8832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:36.061406  8832 raft_consensus.cc:606] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.004345 11305 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:35.998158 11227 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:36.045879  8752 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:35.967955 11258 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.048403  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:36.064965  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:36.010833 11199 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:36.011639  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.009989  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:36.075594  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 65714.1us
I20260709 12:10:36.076550 11287 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.076996 11287 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:36.077400 11287 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.076785 11227 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.081880 11250 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.085139 11227 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.085886 11269 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.090631 11287 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.007565 11229 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.100380 11229 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.102062  9519 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:36.007952 11267 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:36.060853 11188 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.105341 11267 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.107262 11267 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.056164  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:36.056380  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 254279us
I20260709 12:10:36.053153  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.061794  8832 raft_consensus.cc:614] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:36.109860  8830 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.062961  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:36.110914  8835 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.063632  8834 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:36.045339  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 258667us
I20260709 12:10:36.064114 11175 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.115502 11175 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.067797 11217 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.068994 11187 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.069525 11292 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.054448 11156 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.118556  8656 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:36.121105 11156 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.070854 11198 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.120994  8656 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 5, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:36.122519  8656 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 5, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 5 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:36.124204  8919 tablet_copy_source_session.cc:215] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:36.099505 11220 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.007726 11073 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.010563  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.070969  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.125092 11267 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:36.125969 11143 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.126600 11217 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.127336  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:36.163102  8759 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.128350  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:36.163937  8754 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.165036  8829 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:36.129211  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.130858  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.171226  8902 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.172406  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:36.173967  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:36.174017  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 109135us
I20260709 12:10:36.175034  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.175467  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:36.155711  8906 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:36.176851  8901 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.177017  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.160132 11089 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:36.161430  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 150979us
I20260709 12:10:36.179033  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.173394  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:36.180743 11170 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.180930  8903 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:36.181210 11170 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.181664 11170 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.181761  8905 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:36.151400 11220 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.181321  8903 pending_rounds.cc:85] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 3
I20260709 12:10:36.183687  8903 pending_rounds.cc:107] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:36.183964  8903 raft_consensus.cc:2889] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.184239 11220 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.141933  8835 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:36.175627  8902 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:36.193897  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.195946 11206 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.200115  8656 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 6, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:36.202104 11219 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.201972  8656 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 3 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:36.204288 11201 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:36.188409  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:36.206808  8828 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.208456  8906 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:36.214588  8754 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:36.215857 11143 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.216420 11221 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:36.218168  8829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 382) took 1289 ms (client timeout 1519 ms). Trace:
I20260709 12:10:36.218441 11221 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.218869 11221 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.217978 11229 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.224696 10891 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.225442 10891 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.226504 11259 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.228121 10891 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.228962  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:36.229863  9519 raft_consensus.cc:2393] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:36.230156  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:36.163168 11267 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.230902 11307 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:36.231421 11307 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:36.232520 11267 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.232299 11307 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.233667  8919 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:40132 (request call id 387) took 2974 ms. Trace:
I20260709 12:10:36.166194 11289 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.235049 11289 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:36.218590  8829 rpcz_store.cc:269] 0709 12:10:34.928492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.928641 (+   149us) service_pool.cc:224] Handling call
0709 12:10:36.217980 (+1289339us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540037c154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:36.218081 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776945536}
I20260709 12:10:36.244060  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.244907  8754 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:36.246287  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.247135  8758 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:36.166363 11136 raft_consensus.cc:2764] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:36.238978  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.176021 11227 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.236445  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48121.6us
I20260709 12:10:36.153137 11006 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:10:36.255510  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:36.258677  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:36.256248  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 77291.6us
I20260709 12:10:36.263550  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:36.188370 11089 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:36.265707  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:36.267454  8759 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:36.260265  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:36.234407  8919 rpcz_store.cc:276] 0709 12:10:33.259241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.277132 (+ 17891us) service_pool.cc:224] Handling call
0709 12:10:36.086842 (+2809710us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b540012d7a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380badc0 00007fce3814d4a5 00007fce3814d3ee 00007fce3d0e3036 00007fce3d0eca3e 00007fce349b027b 00007fce3d0ec9ba 00007fce3d0e7acc 00007fce3d0e2c7b 00007fce3d0d78d1
0709 12:10:36.087887 (+  1045us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540009ced4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3814d3f7 00007fce3d0e3036 00007fce3d0eca3e 00007fce349b027b 00007fce3d0ec9ba 00007fce3d0e7acc 00007fce3d0e2c7b 00007fce3d0d78d1 00007fce3c18b4b4 00007fce3c18b442
0709 12:10:36.233525 (+145638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4502914304}
I20260709 12:10:36.270346  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.243431 11308 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.282711  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:36.285027  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:36.285899  8901 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.174708 11217 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.291471  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.292838  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.294209  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.271745  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:36.276446  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.298729  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.281709  8756 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:36.248970 10891 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.374379  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 104123us
I20260709 12:10:36.425961  8753 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.368728  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:36.427383  8831 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.397300 11216 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:36.377470  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139584us
I20260709 12:10:36.398280  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:36.265767 11143 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.401641  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.432121  8903 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:36.401983  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.272439 11254 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.269654 11269 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:36.273304 11274 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:36.422699  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 182490us
I20260709 12:10:36.252585 10954 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.281850 11229 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.433482  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:36.386914 11310 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:10:36.434774  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 163091us
I20260709 12:10:36.272305 11199 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 12:10:36.265986 11227 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.402769 11089 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:36.440575 10891 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.470460 11315 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:10:36.471359 11320 log.cc:927] Time spent T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:10:36.438902 11216 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.301049 11203 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:10:36.272683 11136 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.169s
I20260709 12:10:36.385182 11224 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.436887 11254 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.408804 11290 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.163s
I20260709 12:10:36.396975 11291 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:36.448073 10954 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:36.466123 11308 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.473845 11258 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.553526 10779 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.539944 11287 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:36.612809  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 186115us
I20260709 12:10:36.658772  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:36.572230 11252 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:36.600212 11216 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:36.626351  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.575654 11296 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:36.602874 11250 consensus_meta.cc:287] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 12:10:36.605991 11039 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.648584  8831 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:36.648963  8758 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:36.596581 11229 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:36.597560 11156 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:36.573006 11143 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:10:36.659852  8757 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:36.620075 11254 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.634166 11089 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.626200 11298 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:36.671209  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 270658us
I20260709 12:10:36.675932  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.682608  8725 leader_election.cc:400] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:36.683287  8725 leader_election.cc:403] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.632506 11170 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.701133  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:36.674968 11287 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.678798 11136 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.714021  8798 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.720283  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.689420 11087 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5.
I20260709 12:10:36.727062  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.716970  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:36.719204  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 253202us
I20260709 12:10:36.728070  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:36.691967 11292 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.669399 11252 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.655745 11308 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.768672  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:36.677094 11229 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.711390 11073 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:36.721828 11221 consensus_meta.cc:287] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:10:36.773972  8909 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.775837  8758 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:36.786042  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.778314  8906 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:36.698712 11269 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:36.679530 11156 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.792519  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.729091 10998 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.705011 11289 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.787259  8752 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:36.715580 11258 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:36.731276 11203 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.793228  8753 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:36.721652 11287 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.772459 11217 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.689919 10954 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.678870 11296 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.698733 11231 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:10:36.698879 11298 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.778964 11250 consensus_queue.cc:1059] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:36.722247 11326 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:10:36.837091  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:36.794288 11291 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:10:36.843109  8901 consensus_meta.cc:287] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 12:10:36.844277  8901 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
W20260709 12:10:36.828362 11325 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:10:36.794224 11269 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.802208 10998 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.793179 11221 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.853852  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:36.866771  8901 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:36.857502 11287 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.857946 11268 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.858672 11154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e4c6e5758d4fb18617b5b7c30cd334. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:10:36.864372 11321 log.cc:927] Time spent T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:36.871021  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.835561 10891 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.881198 10998 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.882421  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.849254 11217 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.885340 11217 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:36.887629  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.889312  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.890054 11269 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.852449 11309 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.875248 10954 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.895850 11188 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.000s
I20260709 12:10:36.896801 11252 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.890179 11221 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.899272  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.857554 11231 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.909403 11170 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.871122 11187 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.917533  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:36.918125 11296 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.918838 11287 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.922263 11340 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:36.923712 11340 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.898792 11258 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.888512 11298 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.931914  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:36.898895 11327 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.934911 11187 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.936837 11298 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.937781 11187 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.940536 11308 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.943231 11229 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:36.888479 11217 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:36.899704 11263 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:36.944912 11263 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.946630 11227 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:36.908842 11231 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:36.949868 11231 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:36.952294 11231 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.908216 11268 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:36.955097 11268 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:36.961205  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.961335  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.963161  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.968850  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.969796  8754 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:36.972980  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:36.973707  8753 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.976337  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:36.986359 11274 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.986598  8760 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.986943 11274 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:36.988940  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:36.989693  9519 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:36.990073 11219 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.996460  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:36.998041  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:37.001078  8830 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:37.001389  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:37.002655  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:37.003954  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.005637  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.006039  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.006374  8835 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:37.008122 11335 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:37.011456  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.017027  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:36.987948 11274 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.021113  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:37.026723  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.022903 11216 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:37.029017  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 261015us
I20260709 12:10:37.033273  8751 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:37.034572  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.028198 10931 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.050669 11254 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.052268  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.053100  8831 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:37.010200 11327 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.059223  8831 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.059624  8753 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:37.016955 11326 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:37.055825  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:37.015018 11229 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.063892  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.037870 11248 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.070160  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:37.013597 11217 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:37.073993  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:37.038226 11089 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.065668 11326 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:37.100462  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:37.102546 11293 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.106762  8831 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:37.108585  8908 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:37.109388 11340 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.109612 11216 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.069056 10998 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:37.077819 11073 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.078858 11224 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.079568 11248 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:37.119139  8753 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:37.067239 11263 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.121740  8832 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:37.125861 11311 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.100200 11326 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.135673  8902 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:37.155717  8902 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:37.079701 11089 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.162351  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.163343  8901 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:37.165508  8900 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:37.166640  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.167361  8900 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:37.169400  8907 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:37.119024  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:37.170780  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51834.6us
I20260709 12:10:37.136508  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:37.146420  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1624) took 1017 ms. Trace:
I20260709 12:10:37.147751  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.168303  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.181108 11089 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.179616  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.189666  8760 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:37.180827  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.191445  8904 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:37.171188 11315 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:37.192317 11315 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.143597 11311 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:37.164299  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.182901  8903 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:37.174240 11269 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.182960 11248 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.184605 11254 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.173185  8755 rpcz_store.cc:276] 0709 12:10:36.129333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.129551 (+   218us) service_pool.cc:224] Handling call
0709 12:10:36.130065 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.183523 (+ 53458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.183557 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.184071 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.280935 (+ 96864us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:36.425240 (+144305us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.561979 (+136739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.146061 (+584082us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400089dd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:37.146105 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.146146 (+    41us) raft_consensus.cc:1685] finished
0709 12:10:37.146250 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.146356 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1528,"prepare.queue_time_us":147068,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":126417,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":6776,"spinlock_wait_cycles":122078976,"thread_start_us":232810,"threads_started":2,"wal-append.queue_time_us":95965}
I20260709 12:10:37.187602  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.196355  8901 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:37.198027  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:37.238029  8760 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.071302 11327 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:37.243999  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44286.9us
I20260709 12:10:37.195938 11206 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.189445 11199 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:10:37.276535 11338 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:37.244180 11269 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.287520 11269 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.289529  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.291220 11089 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:37.291982  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.292590 11089 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.293095 11089 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.293313 11225 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.293475 11089 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.293849 11225 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.294299 11225 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.269490 11263 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:37.297225 11263 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.299260 11171 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:37.271643 11206 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.300787 11206 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.301779  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.302580 11171 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.272269 11353 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:10:37.303285 11311 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.304860 11353 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:37.305074 11311 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.306591  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.322849  8760 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:37.330732 11258 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.330755  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.303277 11171 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:37.382555 11171 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.333422 11292 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.383867 11292 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.335741  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1625) took 1205 ms. Trace:
W20260709 12:10:37.338708  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.325819 11039 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:37.381213 11258 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.407673 11292 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.408037 11258 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.407815 11175 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:37.408958 11175 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.409372 11175 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:37.410211 11175 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.411474 11175 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.339632 11199 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:37.412562  9521 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:37.340257 11350 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:37.413833  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.414472 11350 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.305425 11353 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.416657 11154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35686 (request call id 425) took 5578 ms. Trace:
I20260709 12:10:37.417102 11154 rpcz_store.cc:276] 0709 12:10:31.838171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.838301 (+   130us) service_pool.cc:224] Handling call
0709 12:10:32.118266 (+279965us) ts_tablet_manager.cc:934] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
0709 12:10:36.429310 (+4311044us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:37.194588 (+765278us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:37.198831 (+  4243us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:37.415803 (+216972us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:37.416128 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:37.416452 (+   324us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:37.416520 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":53330,"tablet-copy.queue_time_us":250415,"thread_start_us":227089,"threads_started":2}
I20260709 12:10:37.418282 11353 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.418502 11154 tablet_copy_client.cc:806] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:37.358734 11291 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.339387 11156 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.358750 11229 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.254498 11231 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:10:37.299253 11263 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.438200  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1891) took 1140 ms. Trace:
I20260709 12:10:37.437969  8656 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 5, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 5 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.438587  8832 rpcz_store.cc:276] 0709 12:10:36.298129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.298309 (+   180us) service_pool.cc:224] Handling call
0709 12:10:36.423418 (+125109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.141511 (+718093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.437999 (+296488us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400389fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:37.438145 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605147904}
I20260709 12:10:37.197011 11216 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 12:10:37.440721  8830 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:37.235900 11342 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:10:37.439802  8656 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.369654 11315 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.411139 11225 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.341109  8724 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:37.360420 11335 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.358232 11326 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.361766 11344 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.461742  8752 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.420843 11229 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:37.462741  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:37.385921  8757 rpcz_store.cc:276] 0709 12:10:36.130463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.130582 (+   119us) service_pool.cc:224] Handling call
0709 12:10:37.335507 (+1204925us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540033d454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:37.335650 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130776448}
I20260709 12:10:37.437137  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1620) took 1268 ms. Trace:
I20260709 12:10:37.464449  8908 rpcz_store.cc:276] 0709 12:10:36.168364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.168535 (+   171us) service_pool.cc:224] Handling call
0709 12:10:36.168920 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.109060 (+940140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.436908 (+327848us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54000b2f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:37.437077 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160115456}
I20260709 12:10:37.440271  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.442941 11350 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.413770  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:37.447721  8751 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:37.453811  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 112790us
I20260709 12:10:37.470489  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:37.471254  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.472910  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.478597  8830 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
W20260709 12:10:37.479892  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 91527.9us
I20260709 12:10:37.480779  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.480926  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.444290 11340 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.488487  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:37.489192  9522 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.459432 11353 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.493161  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:37.494719  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 48852.9us
I20260709 12:10:37.508960  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:37.462404 11154 tablet_copy_client.cc:670] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
W20260709 12:10:37.517403  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.512404  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:37.496186  8710 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.013s	sys 0.018s
I20260709 12:10:37.526435  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.479393 11136 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.533900  8801 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:37.523701  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 57085.1us
I20260709 12:10:37.482393 11203 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.479617 11305 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.544080  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.544457  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.453332 11291 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.487113  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.564815 11254 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:37.513046 11219 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.565402 11254 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.566138 11219 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.523219 11216 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.528820 11221 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:37.569927 11221 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:37.570945 11221 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.497839 11340 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.537637 11073 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:37.575278 11340 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.508066 11220 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:37.532840 11263 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:37.531728  8710 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.013s	sys 0.019s
I20260709 12:10:37.468891 11344 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.485627 11335 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:37.553742  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.554442  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.554111 11229 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.561309 11305 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.562736 11292 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.563323 11290 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.563807 11326 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.512647 11353 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:37.544103  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.462819 11206 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.644587  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:37.660089  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.603348  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.602295  8656 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.604691 11269 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.652796  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.607051 11274 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.532339 11199 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:10:37.623507  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.624466  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:37.586843 11263 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:37.638449  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 43668.6us
I20260709 12:10:37.597922 11258 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.664973  8759 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:37.680152  8754 raft_consensus.cc:2393] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:37.691200  8901 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 3: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:37.621507 11217 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.683346  8906 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:37.637912 11290 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.694165  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:37.638648 10705 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:37.590637 11220 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.706048 11344 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.706600 11220 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.709833  8753 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:10:37.711287  8753 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:37.648762 11305 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.673624 11315 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.715471 11291 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.694244 11229 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.706071 11006 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.717461 11006 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:37.718250 11006 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.719235 11006 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.719586 11156 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.720173 11156 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.720553 11327 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.723179 11254 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.722281 11156 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.727036 11089 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.666642 11244 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.729000 11244 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:37.731228 11244 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.731308  8801 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:37.694860 11263 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.674350 11269 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:37.740329  9522 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:37.732575  9521 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:37.744319  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.752609  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:37.753232  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.704118 11199 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.706094 11258 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.732753 11216 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.722281 11206 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.768751  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.748827 11249 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.765799 11156 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.779691  8875 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:37.786620  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:37.769815 10998 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.764927 11317 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:37.774092 11249 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:37.779327 11331 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:37.789700 11039 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.793030 11258 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.802999  8874 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:37.792548 11089 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:37.809543  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.798597 11249 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.796926 11216 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.790355 11156 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.801050 11225 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:37.777086 11269 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.796342 10998 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.827049 11269 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.813376 11258 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:37.816517 11089 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.814750 11327 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.821954  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.854509  8755 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:37.838539 11217 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:37.841224 11290 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:37.845644  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.852772 11366 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.855229  8900 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:37.857587  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.858378  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:37.815898 11216 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.888242  8758 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.864251  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.853688  8656 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 2, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:37.892450  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:37.868497  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:37.862709  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 221726us
I20260709 12:10:37.897485  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:37.898198  8759 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:37.899325  8754 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:37.853338 11225 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.901376  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:37.901949  8755 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.900142  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:37.902534  8751 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.833772 11089 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.894731  8656 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:37.901572  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:37.910727  8656 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 5, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:37.912173  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.913084  8835 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.917357  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.918154  8835 raft_consensus.cc:2393] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:37.900831 11363 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:10:37.930015  8658 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 220) took 19685 ms (client timeout 15000 ms). Trace:
I20260709 12:10:37.923686  8799 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:37.925256  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 79686.6us
I20260709 12:10:37.926446  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.926569  8900 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:37.927122  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.923851  8758 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:37.863351 11217 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.936582  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:37.937465  8900 raft_consensus.cc:2368] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:37.938434  8900 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:37.933845  8656 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:37.940410  8656 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 4, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 4 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:10:37.953624  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.956058  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.956598  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:37.957351  9521 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:37.957572  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.909337 11089 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.862128 11327 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:37.804442 11331 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:37.916424 11244 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.013958  8755 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:37.995242  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:37.924358 11335 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:37.954399 11206 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.956025 11203 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.935736 11219 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:37.935281 11199 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:38.045842  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.049242  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.069736  8827 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:38.052528  8751 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:38.054526  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:37.914498 11225 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.013468 11227 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.914011 11294 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:10:37.897141 11366 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:38.066865  8829 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:38.052007 11360 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:38.071727  8834 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:38.076538  8833 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:38.083005  8828 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:38.085201  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.099978  8827 raft_consensus.cc:2410] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:38.085615  8832 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:38.060568 11361 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:38.061177 11136 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.031009 11344 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:38.051230 11206 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:38.013861 11221 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 12:10:37.930430  8658 rpcz_store.cc:269] 0709 12:10:18.229441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.229908 (+   467us) service_pool.cc:224] Handling call
0709 12:10:37.914244 (+19684336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:32.672556 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:32.676277 (+  3721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:32.676337 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:32.676369 (+    32us) tablet.cc:662] Decoding operations
0709 12:10:32.676902 (+   533us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:32.676985 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:32.677046 (+    61us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:32.677559 (+   513us) tablet.cc:701] Row locks acquired
0709 12:10:32.677609 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:10:32.677790 (+   181us) write_op.cc:270] Start()
0709 12:10:32.677970 (+   180us) write_op.cc:276] Timestamp: P: 1783599032677719 usec, L: 0
0709 12:10:32.677990 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:32.741425 (+ 63435us) log.cc:844] Serialized 925 byte log entry
0709 12:10:33.426220 (+684795us) op_driver.cc:464] REPLICATION: finished
0709 12:10:34.436177 (+1009957us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b1800381880. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:10:34.436384 (+   207us) write_op.cc:301] APPLY: starting
0709 12:10:34.436502 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:34.436679 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:34.436720 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:34.437219 (+   499us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:34.437608 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:34.437672 (+    64us) write_op.cc:312] APPLY: finished
0709 12:10:34.437979 (+   307us) log.cc:844] Serialized 29 byte log entry
0709 12:10:34.493719 (+ 55740us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.495538 (+  1819us) write_op.cc:454] Released schema lock
0709 12:10:34.517354 (+ 21816us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:34.573402 (+ 56048us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.573434 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44986,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":373141,"apply.run_cpu_time_us":12163,"apply.run_wall_time_us":136993,"num_ops":2,"prepare.queue_time_us":253876,"prepare.run_cpu_time_us":10890,"prepare.run_wall_time_us":145270,"raft.queue_time_us":199188,"raft.run_cpu_time_us":13277,"raft.run_wall_time_us":435879,"replication_time_us":708761,"spinlock_wait_cycles":5033728,"thread_start_us":554952,"threads_started":5,"wal-append.queue_time_us":169352,"wal-append.run_cpu_time_us":72376,"wal-append.run_wall_time_us":2478844}]]}
I20260709 12:10:38.027588 11244 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.091482 11227 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.019558 11258 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.128988 11227 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.111330  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:38.112560 11369 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:38.129860  8906 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:38.113886 11225 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.115612 11327 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.116094 11216 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.116717 11156 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:38.116914  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.137235  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:38.117995 11372 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:38.126106 11366 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.109328 11375 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:38.132506  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:38.140815  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 182950us
I20260709 12:10:38.110400 11206 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.150274  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.102110 11248 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:38.133249 11203 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.138221 10998 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.084203 11199 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.170253  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.155295 11335 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:38.134708  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139548us
I20260709 12:10:38.168102  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:38.168293  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 142248us
I20260709 12:10:38.169215 11375 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:38.136168  8832 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:38.173607  8828 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.109329 11136 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.130596 11344 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.124550 11263 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.182605 11375 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.185799  8799 leader_election.cc:400] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:38.186193  8799 leader_election.cc:403] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.187124 11344 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.187803 11344 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.189595  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.190307  8752 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:38.190634  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.187129  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.190316  8756 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.176712  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.192520  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.193286  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.193902  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.194576  8758 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:38.189805  8832 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:38.195636  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.197535  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.197547  8758 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.202934  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.202068 11290 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.208948 11383 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.206656 11216 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.171474 11203 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.225389 11383 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.227090  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.228843 11335 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.231328  8829 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:38.208494 11327 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:38.233218  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:38.234169 11379 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:38.234302  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.241515  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.243141 11263 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.244293  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:38.256735  9521 raft_consensus.cc:2393] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:38.219992 11274 consensus_meta.cc:287] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 12:10:38.252732  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.254606  8832 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:38.258587  8827 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:38.269366  8831 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:38.269896  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.270711  8833 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:38.270615  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.272547  9489 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.276724  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.277514  8833 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.278506  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.279400  8833 raft_consensus.cc:2410] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:38.279318 11199 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.276887 11274 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.279983 11275 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.280311 11274 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.261277 11327 consensus_queue.cc:1243] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:38.267500 11229 consensus_meta.cc:287] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.008s
I20260709 12:10:38.281064  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:38.282701  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68861.7us
I20260709 12:10:38.285223  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.286674  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.286711  8874 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.289258  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.289301  8833 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:38.292894  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.293699  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.280437 11275 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:38.298812  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.299374  8833 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:38.300381  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.268146 11221 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.268464 11383 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.303654  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.306784  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.288110 11366 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.309311  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.305133 11315 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.318627 11315 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.319161 11315 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.291788 11380 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.323112  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.323488  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.323889  8833 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.280306 11217 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.301923 11156 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.292523 11263 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:38.335263  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:38.340636  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.341884  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:38.304550 11305 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.301702 11275 raft_consensus.cc:3060] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.288563 11382 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:38.297178 11229 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:38.325170 11171 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:38.336503 11249 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.003s
I20260709 12:10:38.308499 11219 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:38.325944 11274 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.337635 11380 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.317866 11307 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:38.419868 11249 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.429598 11249 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.345364 11221 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.347083 11366 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.434973 11366 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.435459 11366 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.348439 11377 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.439589 11377 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.439989 11377 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.441465 11274 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.442408 11274 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.317615 11383 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.445075 11227 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.345234 11244 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.446590 11383 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.432220 11221 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.480198  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:38.489786  9521 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.466830 11221 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.499542 11275 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.420663 11391 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.501287 11391 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.503304 11275 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.505669  9522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:38.506328  9522 raft_consensus.cc:606] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:38.506907 11366 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:38.466341 11217 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.509518 11089 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.510668  8901 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:38.512801 11344 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:38.513667  8828 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:38.515210 11089 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.527192  9522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
W20260709 12:10:38.532882  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 45801.9us
I20260709 12:10:38.460600 11227 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.503770 11391 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.601559  8833 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.593596  9522 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:38.594197  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.614845  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.617769  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.619285  8833 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.621840  8826 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:38.629513  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.626487  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.635500  9521 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:38.642557  8833 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:38.613574 11344 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.648806 11258 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.648906 11344 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.649807 11258 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:38.651067 11258 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.652367  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.653168  8833 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.651690 11344 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.665207 11344 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.666040 11344 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.667696  8833 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:38.624482 11199 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.669457 11199 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.669945  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.671859 11199 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.673334  8833 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:38.674464 11206 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.002s
I20260709 12:10:38.674916 11206 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.676486 11199 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:38.645395 11203 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.677279 11199 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.679889 11199 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.753294 11221 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.732728 11203 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.757925 11203 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.758697 11206 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.646435 11366 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.729990 11217 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.762276 11217 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.764521 11353 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.748379  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.779609  8826 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:38.627287 11377 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.793025 11344 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.770457 11221 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.797147 11331 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.797518 11217 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.631647 11315 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.806046  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.810281  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.822289  8826 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.822017  8874 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.831774 11221 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.832448 11366 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:38.829149 11203 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:38.848539  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:38.832361 11219 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:38.845583 11089 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:38.860133  8875 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:38.851810 11350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.019s
I20260709 12:10:38.857002 11254 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:38.851356 11366 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:38.867254 11254 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.867890 11366 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.878942  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.880327  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.882694  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.883343  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.885485  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.869670 11254 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.852339 11221 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:38.865653 11089 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.871279 11263 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:38.893920 11263 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.894631  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:38.897795 11221 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.901990  8760 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.876428  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.874257  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2050) took 1010 ms. Trace:
I20260709 12:10:38.876618  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.877585  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.887013  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.887403  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.906970  8751 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.887444 11315 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.890755  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.915403  8900 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:38.915822  8760 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:38.865672 11227 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.892940  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.904852  9489 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.902217 11377 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.924893  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:38.925148  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.896320 11263 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.889664  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.905484  8904 rpcz_store.cc:276] 0709 12:10:37.863524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.864594 (+  1070us) service_pool.cc:224] Handling call
0709 12:10:37.865131 (+   537us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:38.107149 (+242018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.107183 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:38.107770 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 12:10:38.196316 (+ 88546us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:38.196356 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.873759 (+677403us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000b3454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:38.873816 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.873916 (+   100us) raft_consensus.cc:1685] finished
0709 12:10:38.873934 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.874194 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3263,"raft.queue_time_us":4039,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"spinlock_wait_cycles":547888896,"thread_start_us":88163,"threads_started":1,"wal-append.queue_time_us":133766}
I20260709 12:10:38.921002  8908 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:38.921411  8756 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:38.931495  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:38.932469  8909 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:38.923050  8826 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.925653  8760 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.945420  8751 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:38.925860  9521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:38.926137  8758 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:38.902460 11089 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:38.926617  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.946775  9521 raft_consensus.cc:606] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:38.949703  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.952003  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.953115 11377 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:38.953262 11203 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.954273 11377 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:38.928359 11350 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.957124  9521 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:38.952113  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.956138  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.958567  8760 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:38.929773 11317 raft_consensus.cc:2804] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.960763  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.957669  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:38.960407  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:38.941901 11227 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:38.963114  8799 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:38.965919  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.966843  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:38.947767 11225 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:38.970537  8799 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:38.981119  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:38.968967 11203 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.968057 11307 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.981769  8833 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.986634 11136 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:38.992043 11203 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.975188 11399 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.974005 11317 raft_consensus.cc:697] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:38.976661 11225 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.022291  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:38.983167  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:38.971181 11221 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.978351 11258 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:39.012241 11089 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:39.012403 11227 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:38.977789 11350 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.018272 11377 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:39.020751  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.033669  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:39.040848  8833 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:39.023602 11203 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.044075 11307 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.038735 11350 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.046442 11382 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.059345 11317 consensus_queue.cc:237] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:39.060878  8831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 1899) took 1887 ms (client timeout 2217 ms). Trace:
W20260709 12:10:39.061323  8831 rpcz_store.cc:269] 0709 12:10:37.173831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.187326 (+ 13495us) service_pool.cc:224] Handling call
0709 12:10:39.060685 (+1873359us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400051754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:39.060813 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371988224}
I20260709 12:10:39.076514  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2051) took 1210 ms. Trace:
I20260709 12:10:39.083688  8901 rpcz_store.cc:276] 0709 12:10:37.865713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.865875 (+   162us) service_pool.cc:224] Handling call
0709 12:10:39.076201 (+1210326us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540011fdd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:39.076412 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388378496}
I20260709 12:10:39.078150  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:39.081703  8874 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.566s (SENT) [suppressed 28 similar messages]
I20260709 12:10:39.050448 11221 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:39.077837  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.097266  9522 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:39.056772 11307 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.081837 11350 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.080273  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:39.084378 11231 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:39.079061  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.110853  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:39.123219  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.124128  8903 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:39.124421  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.125221  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:39.125626  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.125890  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.126310  8907 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
W20260709 12:10:39.095521 11202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.044s	sys 0.034s
I20260709 12:10:39.057145 11219 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:39.099186 11353 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.144793 11006 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.145388 11006 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.145733 11382 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.146337 11382 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.133288 11258 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.147475 11006 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.147854 11258 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.148880 11350 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.128115  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.107234 11307 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.134280  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:39.134415  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:39.126631 11231 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.137517 11219 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.138218 11225 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:39.150199 11258 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.150285  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.150669  8830 raft_consensus.cc:2410] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:39.150858 11202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.045s	sys 0.034s
I20260709 12:10:39.170244  8751 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.126088  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.155757  8903 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:39.160826  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:39.164273  8901 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:39.167757  8831 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:39.127657 11089 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:39.148541 11382 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.182956  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:39.163803 11315 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.188352  8831 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:39.188853  8831 pending_rounds.cc:85] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 5
I20260709 12:10:39.189157  8831 pending_rounds.cc:107] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:39.189213  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:39.189536  8831 raft_consensus.cc:2889] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.195600 11335 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.200052 11335 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.200413 11335 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.202355 11350 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:39.206238  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 124568us
I20260709 12:10:39.181305  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.181203 11219 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:10:39.210450  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 99686.9us
I20260709 12:10:39.216722  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:39.195621 11315 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.188796 11414 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.218407  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:39.222254  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:39.210475 11206 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.228438  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:39.236245  8835 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:39.236809  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 1909) took 1276 ms. Trace:
I20260709 12:10:39.237206  8835 rpcz_store.cc:276] 0709 12:10:37.960091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.960306 (+   215us) service_pool.cc:224] Handling call
0709 12:10:39.228236 (+1267930us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5800140498. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:10:39.236728 (+  8492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68925184}
I20260709 12:10:39.238615  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.233171 11377 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:39.239904 11406 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 12:10:39.226704 11405 consensus_queue.cc:1059] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:39.188746 11089 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.200911 11221 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:39.254392 11405 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:39.254918 11405 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:39.257120 11332 raft_consensus.cc:993] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.257894 11332 raft_consensus.cc:1081] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.259565 11103 raft_consensus.cc:993] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.260701 10705 raft_consensus.cc:1081] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.262940  8758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:10:39.263494  8758 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.263820  8758 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.219013 11315 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.266980  8755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:10:39.267599  8755 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.267949  8755 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.220376 11414 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.269007 11414 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.225332 11382 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.217444 11217 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:39.274279 11231 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.256122 11405 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.280238 11089 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:39.219873 11227 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:39.281018 11405 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.286005 11203 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.291478  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:39.227567 11258 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.241902  8835 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:39.246863 11219 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:39.248289 11373 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 1.193s	user 0.013s	sys 0.007s
I20260709 12:10:39.292035 11307 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.297237  8758 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:39.409574  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.400043  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 197676us
I20260709 12:10:39.412672  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:39.416020  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:39.417598  8827 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.419283  8758 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.347635 11203 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.316423  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.424984 11202 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.425650 11203 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.425810 11202 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:39.427066 11203 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.428285 11202 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:39.435525  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.463622  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.471165 11274 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.471303 11291 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.479278 11263 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.479597 11366 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.480463 11263 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.333686 11307 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:39.321410 11258 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:39.486565 11203 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.486491 11258 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.349916 11315 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.327431 11335 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.484025 11263 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.503787 11326 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:39.504036 11199 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:39.504993 11326 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.506456 11199 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.509039 11291 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.515489 11315 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.516675 11291 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.487812 11366 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.521747 11366 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.516711  8754 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.528930 11199 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:39.532049  8906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2052) took 1665 ms (client timeout 1577 ms). Trace:
W20260709 12:10:39.536104  8906 rpcz_store.cc:269] 0709 12:10:37.866245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.868136 (+  1891us) service_pool.cc:224] Handling call
0709 12:10:39.531527 (+1663391us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540009ced4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:39.531749 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541426048}
I20260709 12:10:39.537310 11335 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.543480  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.340545 11377 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:39.579962 11437 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.580902 11437 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.369673 11414 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.583532  8900 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.583348  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.565814  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:39.592157  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.587294 11216 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.597815 11216 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.601179  8908 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.594137 11221 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.605484 11307 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.606552 11307 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.608166 11437 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.609056  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.585665 11326 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.628700  8835 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:39.629251  8835 pending_rounds.cc:85] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 3
I20260709 12:10:39.629532  8835 pending_rounds.cc:107] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:39.629799  8835 raft_consensus.cc:2889] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.632119 11039 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.633023 11039 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.634585  9521 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.634997  9521 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:39.635681 11039 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.636431  9521 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.638473 11414 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.614496 11307 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.639837 11377 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.644913 11221 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.647897 11221 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.653359  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.653668  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.612835  8901 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.655208  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.656944  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:39.657891  9524 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.657922  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:39.614485  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:39.616811 11294 consensus_queue.cc:1059] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:39.617424 11432 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:10:39.611577 11073 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.665702 11073 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:39.625401  8829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1788) took 1543 ms (client timeout 1566 ms). Trace:
I20260709 12:10:39.668871 11199 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.669351 11073 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:39.667214  8829 rpcz_store.cc:269] 0709 12:10:38.086552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.102885 (+ 16333us) service_pool.cc:224] Handling call
0709 12:10:39.624911 (+1522026us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001fe5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:39.625169 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232526080}
I20260709 12:10:39.669997 11073 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.669656 11199 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.672324 11199 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.673663 11294 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:39.674355 11294 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.675743  9524 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:39.675910  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.676414 11280 raft_consensus.cc:3055] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.681581 11280 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:39.677610 11294 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.682318  8829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:39.683318  8829 raft_consensus.cc:606] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:39.683854  8829 raft_consensus.cc:614] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:39.678364  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.685182  9525 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:39.688206  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.689100  8900 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.689484  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:39.698534  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.633656 11235 raft_consensus.cc:993] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.679597  9521 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.680226  9523 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.683638 11280 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.711874 11294 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.712436 11294 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.700150  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.708069  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.717638  8906 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.712882 11294 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.712730 11280 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.721702 11235 raft_consensus.cc:1081] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:39.604228 11216 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.730044  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.731223  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.731983  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:39.734577 11294 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.682384  8755 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.747282  8827 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:39.751057 11294 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:39.751698 11410 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.723s	user 0.000s	sys 0.006s
I20260709 12:10:39.752228  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.757368  8754 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.759944  8900 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:39.755280  8903 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:39.766129  8755 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:39.773097  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:39.774384  8758 raft_consensus.cc:2368] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:39.776788 11309 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:39.777571 11309 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:39.759473  9519 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.783370  8901 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:39.784897  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.785704  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.788848  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.795038  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.798544  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.800002  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:39.801441  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 55221.1us
I20260709 12:10:39.839090 11154 tablet_copy_client.cc:538] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:39.843088  8900 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:39.846206  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.800901  8726 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:39.873591  9521 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:39.890540  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1799) took 1697 ms. Trace:
I20260709 12:10:39.891165  8830 rpcz_store.cc:276] 0709 12:10:38.192819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.193038 (+   219us) service_pool.cc:224] Handling call
0709 12:10:39.850678 (+1657640us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001edcd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:39.890314 (+ 39636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199909248}
I20260709 12:10:39.892325 11309 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:39.893589  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 186531us
I20260709 12:10:39.894536  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:39.895498  8907 raft_consensus.cc:2393] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:39.896924 11217 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:39.897631 11217 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:39.899755 11202 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.930658 11217 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:39.933053  8830 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:39.933523  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:39.934506  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.936785  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:39.938866  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:39.946780  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.944568  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:39.942945  8828 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:39.952342  8834 raft_consensus.cc:2393] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 4: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:39.952911  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 59588.1us
I20260709 12:10:39.953063  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:39.949388  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:39.959393  8900 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:39.952350  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:39.963063  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.965775  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:39.965955  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:39.975845  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:39.976378 11231 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.976999 11231 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:39.977442 11231 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.983040 11249 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.983940 11249 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.984297 11249 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:39.955387 11202 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:40.026803  8902 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.035651  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:40.036695  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 151311us
W20260709 12:10:40.037190  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 252410us
I20260709 12:10:40.037410 11073 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.038342 11073 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:40.038915 11073 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.046613  8906 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:40.047612  8901 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.009328 11249 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:40.038872 11444 log.cc:927] Time spent T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:40.083942  8835 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:40.037580  8799 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:40.008222 11202 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.084497  8835 pending_rounds.cc:85] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 1
I20260709 12:10:40.097517  8835 pending_rounds.cc:107] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:40.097851  8835 raft_consensus.cc:2889] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.081178  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.105047  8900 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.060859 11353 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.129385 11353 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.113971 11380 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 12:10:40.116901  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 79492.7us
I20260709 12:10:40.117662 11216 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.134723 11216 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:40.136569 11216 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.137457  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1644) took 2212 ms. Trace:
I20260709 12:10:40.138036  8905 rpcz_store.cc:276] 0709 12:10:37.925257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.925473 (+   216us) service_pool.cc:224] Handling call
0709 12:10:39.487816 (+1562343us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800135398. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:39.516726 (+ 28910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.630640 (+113914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.630676 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.631241 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.738969 (+107728us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:39.768509 (+ 29540us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.784526 (+ 16017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.784600 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.136890 (+352290us) raft_consensus.cc:1685] finished
0709 12:10:40.137014 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.137233 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250455,"prepare.queue_time_us":31421,"raft.queue_time_us":136675,"spinlock_wait_cycles":80362368,"thread_start_us":107263,"threads_started":1,"wal-append.queue_time_us":136466}
I20260709 12:10:40.134198  8799 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:40.124471 11249 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.121356 11221 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:40.146792  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.199275  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:39.982146  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:40.236544  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 607977us
I20260709 12:10:40.189742  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:40.210372 11447 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.225s	user 0.004s	sys 0.000s
I20260709 12:10:40.141847 11199 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.262953  8908 consensus_meta.cc:287] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.661s	user 0.030s	sys 0.091s
I20260709 12:10:40.143469 11249 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:40.265455  8908 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:40.197468  8755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:10:40.234196 11353 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.276850  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:40.279139  8755 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.280592  8755 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.281360  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.199636 11217 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:40.289484  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.269951 11199 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.299678  9521 raft_consensus.cc:3055] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:40.300180  9521 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:40.302313  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:40.289805  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.296257 11199 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.308991  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 228046us
I20260709 12:10:40.310899  8874 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.317134 11225 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.320757 11073 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.333256  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.327379 11073 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:40.357335  9521 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.329111 11199 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.367220  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.330379 11231 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.372794 11267 consensus_queue.cc:1059] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:40.374058 11199 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:40.390085  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 77470.6us
I20260709 12:10:40.392411 11437 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:40.408972  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.407037  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:40.412856  8830 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:40.414713  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.419595  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.427049  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:40.430917  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.434351  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.438482  8826 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:40.440467  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.441113  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.444612 11231 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.445500 11231 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.445842  8835 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:40.446358 11231 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:40.446964  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:40.447712  8827 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:40.450798  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 58467.6us
I20260709 12:10:40.452562  8830 raft_consensus.cc:2410] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:40.454398 11199 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:40.456866  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.462347  8828 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.462510  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.460376 11199 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.466037  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:40.464965  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:40.467283  8908 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.467357  8834 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.467432  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:40.469883  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:40.470667  8900 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.475414  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.466876  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:40.475926  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.486584  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:40.487962  9521 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.496762  8833 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.497454 11154 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:10:40.501478  8830 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.499091  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:40.507890  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:40.512866  9523 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:40.475121 11202 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:40.521166 11451 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:10:40.542982  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:40.548583  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:40.549558  8754 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.551837  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:40.552752  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:40.553479  8909 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.565546  8906 raft_consensus.cc:1275] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.447703 11231 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.574919 11073 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:40.583896 11073 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.586413 11073 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.589162  8758 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:40.593660  8755 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.599401  8875 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:40.599907  8875 leader_election.cc:403] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:40.577880 11353 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:40.609720  8755 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:40.611799  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:40.569815 11202 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.595656 11199 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.646428  9521 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:40.646622 11219 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:40.649585 11219 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.650892  9488 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:40.652171  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 105740us
I20260709 12:10:40.654426  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:40.655232 11309 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:40.655473  8875 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:40.652283 11219 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:40.657877  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 458702us
I20260709 12:10:40.638475  8755 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:40.670841  8834 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:40.644120 11199 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.619381 11353 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.661607 11437 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:40.674772  8760 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.679122  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.684688 11258 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:40.686286 11258 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:40.686759 11258 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.687988  8726 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:40.690332  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.709074  8908 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:40.713637  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:40.723773 11331 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.724848 11275 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:40.726115  8900 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:40.726958 11293 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:40.728061 11227 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.728777 11227 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:40.730229 11227 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.682269 11219 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:40.751793 11353 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.672370 11309 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:40.755511 11309 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.756026 11309 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:40.778280  8827 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:40.786195  8754 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:40.677903 11380 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:10:40.696753 11267 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:10:40.795305  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:40.708678 11199 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.820744  9521 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.821352  9521 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:40.823558  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.806360 11216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.025s
I20260709 12:10:40.762990 11437 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.805578 11258 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:40.873092  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:40.869879  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 294350us
W20260709 12:10:40.858788 11216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.025s
I20260709 12:10:40.881083  8904 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.881965  8759 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:40.882251  8758 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:40.882648  8758 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:40.815259 11456 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:40.877925  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 688243us
I20260709 12:10:40.814580 11353 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:40.883689  8758 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.892107  8758 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.896162  9521 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.902714  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:40.907635  9521 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.904062  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:40.911752  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 364799us
W20260709 12:10:40.916489  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 228592us
I20260709 12:10:40.912959  8759 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.905469 11202 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:40.935135  8760 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.915374 11454 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:40.894047 11353 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:40.871840 11309 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:40.925740 11456 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.954777  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:40.952520  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:40.956992  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 478978us
I20260709 12:10:40.959160  8656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 147) took 7373 ms. Trace:
I20260709 12:10:40.978829  8656 rpcz_store.cc:276] 0709 12:10:33.428320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.437280 (+  8960us) service_pool.cc:224] Handling call
0709 12:10:33.819038 (+381758us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e00004e 00007fce3c4c12a4 00007fce3c4c1232 00007fce3c4c1161 00007fce3c4c10dc 00007fce3c4c0392 00007fce3647e48c 00007fce3647d8c6
0709 12:10:40.762629 (+6943591us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.222501 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.225870 (+  3369us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.225907 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:38.225927 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:38.227028 (+  1101us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.227123 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.227157 (+    34us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:38.228223 (+  1066us) tablet.cc:701] Row locks acquired
0709 12:10:38.228262 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:10:38.228431 (+   169us) write_op.cc:270] Start()
0709 12:10:38.228554 (+   123us) write_op.cc:276] Timestamp: P: 1783599038228370 usec, L: 0
0709 12:10:38.228579 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.290513 (+ 61934us) log.cc:844] Serialized 5133 byte log entry
0709 12:10:38.839112 (+548599us) op_driver.cc:464] REPLICATION: finished
0709 12:10:38.977718 (+138606us) write_op.cc:301] APPLY: starting
0709 12:10:38.980195 (+  2477us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:39.007735 (+ 27540us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:39.012727 (+  4992us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:39.014652 (+  1925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:39.014940 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:39.014990 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:39.015355 (+   365us) log.cc:844] Serialized 95 byte log entry
0709 12:10:39.015543 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.015715 (+   172us) write_op.cc:454] Released schema lock
0709 12:10:39.015774 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:39.016218 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.016250 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2420567,"reported_tablets":23,"spinlock_wait_cycles":811396480,"child_traces":[["op",{"apply.queue_time_us":122912,"apply.run_cpu_time_us":4314,"apply.run_wall_time_us":43858,"num_ops":13,"prepare.queue_time_us":110644,"prepare.run_cpu_time_us":28913,"prepare.run_wall_time_us":163971,"raft.queue_time_us":404001,"raft.run_cpu_time_us":17356,"raft.run_wall_time_us":95848,"replication_time_us":608502,"thread_start_us":503093,"threads_started":4,"wal-append.queue_time_us":136912,"wal-append.run_cpu_time_us":42742,"wal-append.run_wall_time_us":1610281}]]}
I20260709 12:10:40.965139  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:40.970883  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 314353us
I20260709 12:10:40.985095  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.986325  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:40.974984  9521 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:41.034258  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 65921.1us
W20260709 12:10:41.049084  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 146508us
I20260709 12:10:41.050529  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:40.959023 11317 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.054873  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1690) took 1003 ms. Trace:
W20260709 12:10:41.055740 11275 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:41.034196 11456 raft_consensus.cc:697] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:41.081439  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 92308.1us
I20260709 12:10:41.063117 11216 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.092342  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 106106us
I20260709 12:10:41.034673 11454 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.079417 11309 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.086623 11459 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:41.108953  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:41.116618  8909 consensus_meta.cc:287] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.004s
I20260709 12:10:41.118304  8909 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:41.073576 11317 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.120867  8753 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.127300 11199 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.128216  8754 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:41.127799 11456 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.108091 11469 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.121750 11249 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:41.145278  8758 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:41.148855  8758 pending_rounds.cc:85] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 5
I20260709 12:10:41.149227  8758 pending_rounds.cc:107] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:41.149736  8758 raft_consensus.cc:2889] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.129472 11231 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.154460  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68561.7us
I20260709 12:10:41.132491 11459 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:10:41.161924  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 45732.1us
I20260709 12:10:41.164512  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:41.144580 11476 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:41.147400 11437 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:41.170138  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 261496us
I20260709 12:10:41.117177 11216 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:41.166597 11217 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:41.172254 11473 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.174702  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.175397 11267 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.177628 11454 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.178359 11476 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.179229 11331 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:41.180680  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 155795us
I20260709 12:10:41.163743 11467 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:41.183401 11455 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:10:41.187634 11479 consensus_queue.cc:1048] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:10:41.180429 11461 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:10:41.143055 11199 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.182461 11487 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:41.199819 11221 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.163429 11231 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.236415 11199 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.213563 11267 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:41.200076 11437 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:41.217065 11454 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.239321 11467 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:41.233623 11353 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:41.261662 11482 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:10:41.262061 11480 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.262732 11480 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.263994 11267 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.270282  8872 leader_election.cc:400] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:41.271031  8872 leader_election.cc:403] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:41.273911 11476 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.275246 11317 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.278208 11231 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.278970 11231 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.236732 11469 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:41.289661  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:41.246351 11484 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.292815  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.293140  8835 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:41.295423  8830 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:41.247915 11485 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.279561 11231 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.299633  8833 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:41.300047  8801 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:41.300575  8827 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:41.300704 11474 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.301767 11471 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.004s
I20260709 12:10:41.304484  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:41.305821  8829 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:41.307160  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.306761 11459 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.318872  8835 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:41.318859  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.320832  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.326251  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.319645  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.331827 11492 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5.
I20260709 12:10:41.331730  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:41.334096  8760 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:41.334548  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 88605.3us
I20260709 12:10:41.288115 11454 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.334894  8759 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:41.336551  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.340139  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:41.341620  8754 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.271930 11467 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.348914  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.352342  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.352357  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.353323  9523 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
W20260709 12:10:41.367993  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 162297us
I20260709 12:10:41.389876  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.389983 11491 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:41.390977  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.340613 11353 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.389972  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.398396 11492 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.318986 11485 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.314633 11484 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.352898 11480 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.388643 11227 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.407586 11488 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.406833 11474 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.426499 11199 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.443257  8826 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:41.427482  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.446789  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.446288  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.400872 11469 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.427349 11353 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:41.459246 11499 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:41.426746 11491 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.463022 11491 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.450122 11476 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.420231 11492 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.448392 11488 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.486325 11495 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.480227 11476 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.522573 11476 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.442101 11474 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:41.062301  8757 rpcz_store.cc:276] 0709 12:10:39.900936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.250720 (+349784us) service_pool.cc:224] Handling call
0709 12:10:40.269814 (+ 19094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.349497 (+ 79683us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:40.366292 (+ 16795us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.873300 (+507008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:40.873368 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:40.873415 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.873483 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.873700 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2860,"prepare.queue_time_us":9967,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":33444,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6735,"thread_start_us":452738,"threads_started":1,"wal-append.queue_time_us":652369}
I20260709 12:10:41.489976  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.492408  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:41.494644  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:41.495613  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.435276 11227 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.497424 11486 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.499239 11484 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:41.500120  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.500474 11467 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:41.496471  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.544339  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.545383  8753 raft_consensus.cc:2410] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:41.499253  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.507755  8874 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:41.515280 11221 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:41.515976 11380 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.516301 11492 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:41.524844 11474 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.551905  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.554077  8752 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:41.552829  8759 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:41.538509 11473 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:41.559268 11467 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.559752 11467 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:41.537062  9516 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:41.551545  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.560549 11227 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:41.560587 11467 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.562268 11467 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.562673 11465 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
I20260709 12:10:41.562820  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.563969 11454 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.489539  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:41.564793  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 75356.9us
I20260709 12:10:41.566012 11488 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.567310 11485 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.567579 10705 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.567945  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 492) took 1086 ms. Trace:
I20260709 12:10:41.568341  9524 rpcz_store.cc:276] 0709 12:10:40.481329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.481545 (+   216us) service_pool.cc:224] Handling call
0709 12:10:40.500731 (+ 19186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.530163 (+ 29432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.530218 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.573885 (+ 43667us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.925282 (+351397us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:40.925324 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.925399 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.561806 (+636407us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:41.564430 (+  2624us) raft_consensus.cc:1685] finished
0709 12:10:41.564451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.567853 (+  3402us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8989,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":27923,"spinlock_wait_cycles":2763648,"thread_start_us":293055,"threads_started":1,"wal-append.queue_time_us":545514}
I20260709 12:10:41.569494 11231 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:41.570851 11502 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:10:41.559917  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 65415.9us
W20260709 12:10:41.575546 11490 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:10:41.544873 11476 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.576884 11217 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:41.577219 11476 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.579432 11476 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.581127 11216 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.538386 11495 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.592521 11495 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.593319 11202 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.597914  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1697) took 1119 ms. Trace:
I20260709 12:10:41.554476  8752 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:41.579468 11353 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.533839  8754 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:41.567983 10705 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.589234  9522 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.598443  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.802887 11216 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.803896 11216 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.673766  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:41.799276  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:41.827303  8799 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:41.673345  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 74030.6us
W20260709 12:10:41.833550  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 207857us
I20260709 12:10:41.835783  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:41.655912  8726 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:41.757607  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101360us
I20260709 12:10:41.842344  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.817101 10705 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:41.816347 11501 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:10:41.857337  8752 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.860918 11458 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.861549  8752 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.825878 11231 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:41.865134  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.865836  8832 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:41.651718 11468 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:41.809636  9519 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:41.840716 11476 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.651439 11463 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.846755 11353 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:41.848735  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 192904us
I20260709 12:10:41.880739 11275 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.881333 11275 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.883445 11275 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.598385  8751 rpcz_store.cc:276] 0709 12:10:40.484332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.492463 (+  8131us) service_pool.cc:224] Handling call
0709 12:10:40.527211 (+ 34748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:40.582857 (+ 55646us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:40.601364 (+ 18507us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.525835 (+924471us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b180045a120. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce323a
0709 12:10:41.525965 (+   130us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.526697 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 12:10:41.526864 (+   167us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:41.549497 (+ 22633us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.554940 (+  5443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.555014 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.597662 (+ 42648us) raft_consensus.cc:1685] finished
0709 12:10:41.597685 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.597826 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8090,"prepare.queue_time_us":43882,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":324128,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":14225,"spinlock_wait_cycles":2602880,"thread_start_us":285841,"threads_started":2,"wal-append.queue_time_us":536241}
I20260709 12:10:41.888312  8752 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:41.889350  8752 pending_rounds.cc:85] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 3
I20260709 12:10:41.889746  8752 pending_rounds.cc:107] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:41.890239  8752 raft_consensus.cc:2889] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.869544 11458 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:41.873304  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.874231  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 238661us
I20260709 12:10:41.856870 11480 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:41.874536  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 438225us
W20260709 12:10:41.902410 11217 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:41.907096  9522 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:41.907214 11216 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.908206 11458 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.909837 11509 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:41.910681 11458 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.910451 11509 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.913100 11476 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:41.914193 11476 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.916065  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.916836  8760 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:41.917302 11353 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:41.918331 11353 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.921391  9524 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.923182 11509 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:41.928118  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 80188.5us
I20260709 12:10:41.937143  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.938005  8832 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 2.
W20260709 12:10:41.939981  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68653.3us
I20260709 12:10:41.940927  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:41.942410  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:41.949673 11508 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:41.950162 11380 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:41.951642 11380 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:41.952047 11380 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.956346 11508 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.875684 11468 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.965997 11468 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.961963  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.963094 11380 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.971356  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.972739 11480 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:41.972855 11231 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.973649 11231 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.973884 11480 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.976106 11231 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.978987 11504 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:41.979627 11504 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:41.980183  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:41.980530 11493 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.981201 11493 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.981547 11456 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:41.982113 11456 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:41.983467 11493 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:41.983880  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:41.984158 11280 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:41.984586 11280 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.985064 11504 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:41.985852  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.987346 11457 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:41.988943  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:41.989699  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.990449  8829 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:41.991447  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:41.992086  8829 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:41.985062 11280 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.004458  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:41.984393 11456 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:42.012005  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71180.4us
I20260709 12:10:42.015298  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:42.016198  9524 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:42.019773  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.006505 11508 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.023810 11249 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:42.024971 11249 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.025346 11249 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:42.026921 11504 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:42.027099  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.016942 11221 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:42.026372 11249 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.029613 11221 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.030293 11249 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.032133 11221 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:42.028753 11216 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.028601 11485 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.032945 11485 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:42.033861 11485 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.035096 11485 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.036731  8832 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.017006 11456 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:10:42.041725 11456 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.041998  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.042188 11456 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:42.041862  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.043396  8832 raft_consensus.cc:2368] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:10:42.049497  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:42.049844  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.050354  8830 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.051672 11489 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:42.052109 11489 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:42.053049 11489 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.054296 11489 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.059077 11484 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.059615 11484 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.062415 11484 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:42.064226  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.066232  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 69404.4us
I20260709 12:10:42.067556  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.016122 11493 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.070050  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:42.073105  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.068578  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.015604 11509 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.079384  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.073854  8759 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:42.083025  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:42.084714  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.085517  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.084925  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.085654  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.083943 11493 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.086808  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.087397 11493 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.087984 11504 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.088457 11504 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:42.088866 11504 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.088956  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.089859  8752 raft_consensus.cc:2393] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:42.090081 11493 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.085685 11508 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.013355 11469 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:42.090752 11508 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.092469 11456 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.093827 11456 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.097579  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.099076  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.100276  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.069571 11463 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.101563 11508 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.086778  8751 raft_consensus.cc:2410] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:42.106776  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.107515  8872 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.069093 11231 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.113338  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.116739 11231 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.118273  9521 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:42.118772 11493 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.119776  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.119972  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.119812  8757 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:42.120671  8751 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:42.120115 11493 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.121613  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.122223 11463 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:42.121131  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.123771  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.124817  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.125789  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.126714  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.127223  8760 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:42.127965  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.119189 11231 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.129979  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:42.130640  8759 raft_consensus.cc:2376] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8. Re-sending same reply.
I20260709 12:10:42.122223  8751 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:42.131502  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.132097  8759 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:42.132239  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.133431  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.133955  8751 raft_consensus.cc:2376] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8. Re-sending same reply.
I20260709 12:10:42.134706  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.135293  8751 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:42.116988  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.108237  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:42.137562  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.138859  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.154505  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.110898 11467 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.155382 11467 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.155471 11508 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.155846 11467 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.157137  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.150087 11493 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.158313 11485 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.158691 11485 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.159044 11485 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.153301 11231 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:42.166814  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.170060 11508 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.170518 11508 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.170882 11508 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.170064  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.111204 10705 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.178131  9522 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.179356 10705 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.180426 11221 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.180539 11463 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.181409 11437 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.181113 11221 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.183872  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.187829  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.220536  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.239463  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:42.241403  8759 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:42.258986  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.261675  8830 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:42.220688  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.261554  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:42.260281  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 187776us
W20260709 12:10:42.272859  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 89056.5us
I20260709 12:10:42.273192  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.273695  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.274315  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.275800  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:42.276201  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.276940  8832 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:42.270879 11463 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:42.257048 11154 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.084s	user 0.004s	sys 0.000s
I20260709 12:10:42.281791  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.247936 11493 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.279994 11216 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.292678  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.306572  8907 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:42.279997 11380 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:42.340061  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.343135  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.335052  8826 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:10:42.322057  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 47235.9us
I20260709 12:10:42.345525  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.347335  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.290925 11463 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.335642  8833 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:42.305684 11468 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:42.356730  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:42.366925  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.358646  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:42.371148  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.381490  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:42.382252  8909 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:42.334805 11221 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:42.389781  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:42.393285  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 44405.6us
I20260709 12:10:42.396893  8801 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.394718  8828 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:42.402328  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:42.327459 11275 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:42.321583 11493 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.369082 11437 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.338056 11509 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:42.380782 11483 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.360767 11492 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:10:42.445461  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.403857 11495 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.404048 11476 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:42.456933  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 88432.8us
I20260709 12:10:42.416061 11459 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.411123 11480 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.398114 11380 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:42.438642 11463 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.436600 11437 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:42.474138  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.380595 11468 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.489766  8900 raft_consensus.cc:2410] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:42.410851 11497 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:10:42.492811  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 106659us
I20260709 12:10:42.467176 11353 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.459714 11495 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:42.502955  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.439990 11508 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.493363 11380 consensus_queue.cc:1243] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer 005ae7a1e140481db6cc04faeb268d9c log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:42.489668 11476 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:42.499678 11437 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:42.526283  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 129503us
I20260709 12:10:42.527194  8801 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.452592 11467 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.493075 11463 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:42.517864 11280 consensus_meta.cc:287] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.003s
I20260709 12:10:42.514310  8909 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
W20260709 12:10:42.529284  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 160892us
W20260709 12:10:42.521835  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 132152us
I20260709 12:10:42.540366  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:42.538210  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46114.4us
I20260709 12:10:42.517436 11495 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.531483  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.546290  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.527249 11216 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.489459 11459 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.554570  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.501278 11480 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.536990 11463 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.571085 11375 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:10:42.571856 11519 log.cc:927] Time spent T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:10:42.550287 11221 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:42.593241  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 66095.1us
I20260709 12:10:42.610096  8833 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:42.610148  8908 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:42.583179 11521 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:10:42.548852 11280 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:42.633766  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 79187.6us
I20260709 12:10:42.557940 11485 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.638532 11537 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.638878 11523 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:10:42.640520 11459 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.641219 11219 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:42.638101 11525 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:10:42.655980 11489 consensus_meta.cc:287] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.005s
I20260709 12:10:42.656708 11536 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.684083 11536 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.684688 11536 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.661059 11493 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.661939  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:42.697026  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1870) took 1075 ms. Trace:
W20260709 12:10:42.663160 11529 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:42.663676  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.701459  8835 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.662983  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.681717  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.697574  8827 rpcz_store.cc:276] 0709 12:10:41.621287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.994426 (+373139us) service_pool.cc:224] Handling call
0709 12:10:41.994775 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:41.995258 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.995288 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.995981 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 12:10:42.070314 (+ 74333us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.070351 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.070416 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.696652 (+626236us) raft_consensus.cc:1685] finished
0709 12:10:42.696768 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.696958 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":72,"thread_start_us":69446,"threads_started":1,"wal-append.queue_time_us":263284}
W20260709 12:10:42.697310  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 102338us
I20260709 12:10:42.704576  8801 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:42.709717  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 141069us
I20260709 12:10:42.710892  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:42.712050  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.683215 11527 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
W20260709 12:10:42.684984 11456 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260709 12:10:42.695391 11467 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.732012  8908 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:42.733052  8909 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:42.734592  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.736254 11353 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.736702 11353 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.737036 11353 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.735337  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:42.684880 11280 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:42.748211  8909 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:42.755915 11531 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:10:42.761245  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:42.766381  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 207281us
I20260709 12:10:42.766778  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.745499 11537 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:42.759861 11539 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.004s
I20260709 12:10:42.731775 11219 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:42.746078 11542 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.671065 11476 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.769059  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.781283  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.776763 11258 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:42.790593  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.771292 11467 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.797820  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:42.772838 11537 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:42.806083  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.806880  8905 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:42.808274  8907 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.810271 11480 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.810818  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.811796  8906 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:42.813272  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:42.798594 11550 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.782498 11542 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.818683 11542 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.821883 11504 consensus_meta.cc:287] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.001s
I20260709 12:10:42.783025 11468 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:42.828759  9488 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:42.783958 11508 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.831305  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.836931  9488 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:42.840891  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.842549 11535 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.846763  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.825968 11537 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:42.866089  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1857) took 1519 ms. Trace:
I20260709 12:10:42.871765  8831 rpcz_store.cc:276] 0709 12:10:41.345673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.345815 (+   142us) service_pool.cc:224] Handling call
0709 12:10:41.355005 (+  9190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.416891 (+ 61886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.416940 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.420673 (+  3733us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.307809 (+887136us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18003f72a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350242a6 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9
0709 12:10:42.401533 (+ 93724us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18003f72a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:10:42.521533 (+120000us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:42.521575 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.521663 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.695409 (+173746us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:42.864598 (+169189us) raft_consensus.cc:1685] finished
0709 12:10:42.864622 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.864828 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65684,"raft.queue_time_us":74814,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4702,"spinlock_wait_cycles":26892032,"thread_start_us":119797,"threads_started":1,"wal-append.queue_time_us":1166423}
W20260709 12:10:42.882421  8654 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 235) took 24559 ms (client timeout 15000 ms). Trace:
I20260709 12:10:42.887406 11485 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.890240 11463 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.846491 11275 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:42.846800 11331 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:42.898283  8654 rpcz_store.cc:269] 0709 12:10:18.322691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.323055 (+   364us) service_pool.cc:224] Handling call
0709 12:10:42.882083 (+24559028us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201212,"reported_tablets":21}
I20260709 12:10:42.838467 11549 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.825546 11467 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.838815 11504 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.849563 11497 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.847472 11489 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.913190  8904 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:42.913650  8904 pending_rounds.cc:85] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 6
I20260709 12:10:42.914072  8904 pending_rounds.cc:107] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:42.914408  8904 raft_consensus.cc:2889] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:42.902000  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52134.3us
I20260709 12:10:42.861272 11488 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.910406 11467 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:42.920506  8831 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.926643  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:42.928961  8832 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.929225 11504 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:42.905145 11331 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.932296 11331 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.905351 11258 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:42.924882 11353 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.914768 11489 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:42.937009 11489 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.941948 11249 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.942453 11249 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:42.943281 11249 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:42.944298 11249 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.946516 11463 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.924384 11509 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:42.950582  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.936373 11353 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:42.957099  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:42.957931  8751 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.908278 11549 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:42.969331  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 225889us
I20260709 12:10:42.970501  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:42.973085  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:42.962906 11549 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.959270 11437 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.956979 11509 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.984408  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.986373  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.987210  8902 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:42.988143  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.989923  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.991958  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:42.989645 11504 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:42.994824 11504 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.981384 11488 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.981129 11555 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.001982  9519 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:43.003423  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.026512  8751 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:43.017446 11536 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:42.996982 11154 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:43.019521 11437 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:43.020344 11495 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.030889  8900 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:43.033931  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.042085  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.050158  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:43.050371  9519 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:43.054808 11540 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.414s	user 0.000s	sys 0.003s
I20260709 12:10:43.055864 11462 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:43.057458  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.086211  8830 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:43.058030 11488 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:43.063280  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.063464  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:43.087986  8827 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.088333  8829 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:43.066107 11486 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:43.087989  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.067157  8833 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:43.077087  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 44001.5us
I20260709 12:10:43.084031  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:43.084525  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:43.092077  9522 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.097383 11495 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:43.100910 11504 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.101485 11154 tablet_bootstrap.cc:492] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:10:43.102517 11154 ts_tablet_manager.cc:1403] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 2.605s	user 0.028s	sys 0.028s
I20260709 12:10:43.102636  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.103859  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.104828  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.105005  8725 leader_election.cc:400] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:10:43.105535  8725 leader_election.cc:403] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:43.106801  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.113003  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:43.120806  9519 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.127641  8827 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:43.129132  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.083061 11216 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:43.137004  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.137166  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.137717  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.124964  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:43.034224 11553 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:10:43.149559  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.150748  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.105144 11486 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:43.154735  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:43.171175  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.179013  8832 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.129920 11202 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:43.116410 11457 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:10:43.142010 11216 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.184484  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:43.185304  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 207050us
I20260709 12:10:43.186005  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:43.193733  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.193862  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet 16a04653cca743d0966d20df2225c35d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:43806
I20260709 12:10:43.146463 11456 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.197667  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.205076  9522 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:43.207913  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:43.214408  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.145280 11331 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.220885  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:43.222584  8907 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:43.202348 11437 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:43.229615  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.227792  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.159435 11537 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.237485  8902 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:43.204813 11456 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.206449 11249 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:43.185537 11542 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:43.232149 11459 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 12:10:43.299170  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 144336us
I20260709 12:10:43.188786 11469 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 12:10:43.308972  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 115336us
I20260709 12:10:43.313373  8835 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:43.407213  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 196369us
I20260709 12:10:43.231424 11457 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.233637 11488 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.232811 11437 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:43.383117 11525 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:43.359534 11550 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.242206 11275 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:43.432521  8829 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.387534 11280 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.450868  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.451557  8751 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.454413 11564 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:43.451459  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.456894  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.457504  8755 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.459921  8751 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:43.460414  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.460989  8752 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.431303 11536 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.456933  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.462769  8759 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.435245 11221 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.430548 11545 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.437299 11437 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.482254  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:43.483101  8758 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:43.468734  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:43.474479  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.475886  8754 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:43.488772  8754 pending_rounds.cc:85] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 3
I20260709 12:10:43.488449  8755 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:43.489126  8754 pending_rounds.cc:107] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:43.490257  8754 raft_consensus.cc:2889] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.443255 11488 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:43.494201  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:43.477274 11545 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.464922 11457 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:43.514596  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:43.444867 11280 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.497994 11536 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.525813 11545 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:43.534571 11569 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:10:43.536023 11537 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:43.537632 11566 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:43.484488 11221 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.561966  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.563174  8758 raft_consensus.cc:2368] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:43.546568 11536 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:43.569553  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.571045  8752 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:43.582901  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.583648  8758 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.552479 11331 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.583112  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.584679  8908 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.574105 11557 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.598737 11571 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.599711 11578 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:43.600240 11578 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.550834 11457 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.585099 11275 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:43.443008 11550 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.605418 11275 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.573346 11536 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:43.546075 11154 raft_consensus.cc:359] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:43.641340  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:43.649659  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 73539.3us
I20260709 12:10:43.647349  8759 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:43.650509  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.628575  8908 raft_consensus.cc:2468] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:43.655054  8758 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:43.681561  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.681874  9488 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:43.687705  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:43.611629 11563 log.cc:927] Time spent T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:43.689719 11578 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:43.691010 11565 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:10:43.693698  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.696149  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.569056 11488 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.643874 11216 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.647753 11573 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:43.688611  9522 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.605877 11457 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:43.696591  8832 consensus_meta.cc:287] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.004s
I20260709 12:10:43.698145  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:43.705610  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.724586  8832 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:43.725870  8760 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:43.709007  8830 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.713672  8724 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.708261  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.712548  8835 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:43.639508 11542 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.737964  8908 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:43.738059  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.750988  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.650907 11536 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.753715  8757 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:43.758494  8724 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:43.679428 11557 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:43.728322 11578 raft_consensus.cc:2804] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.751765 11459 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:43.687948 11571 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.692006 11486 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.649924 11154 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:10:43.701361 11216 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.709136 11231 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:43.722321 11493 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.728528 11469 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.774029  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.761050 11202 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.778000  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.778976 11571 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:43.764984 11489 consensus_meta.cc:287] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.827s	user 0.013s	sys 0.005s
I20260709 12:10:43.736851 11457 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.701252 11573 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.799506  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.844705  8831 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.898677  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.903658  8908 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:43.904919  8751 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:43.912561  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.913264  8828 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:43.914932  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 139330us
I20260709 12:10:43.912302  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.799796 11231 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.919427 11231 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.920898  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.920501  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:43.926538  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:43.935022 11550 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:43.939415 11557 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.927254  8831 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:43.941839  8831 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.946347 11221 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:43.947662  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.949380  8903 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:43.949856  8903 pending_rounds.cc:85] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 4
I20260709 12:10:43.950062  8903 pending_rounds.cc:107] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:43.950271  8903 raft_consensus.cc:2889] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.950949  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:43.951304  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.842299 11489 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:43.952972  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.954046  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.954671 11489 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.955149  9524 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.902658 11154 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:43.956981  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.958343  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.912016 11486 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:43.960244 11549 consensus_meta.cc:287] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.970s	user 0.007s	sys 0.005s
I20260709 12:10:43.960757 11549 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.962922 11549 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:43.963565  8834 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.915306 11280 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:43.949383  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:43.966675  8900 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:43.958442 11154 ts_tablet_manager.cc:1434] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.856s	user 0.011s	sys 0.010s
I20260709 12:10:43.968389  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:43.970189  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:44.097707  8900 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.097796  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 466) took 1395 ms. Trace:
I20260709 12:10:44.098481  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1898) took 1026 ms. Trace:
I20260709 12:10:44.099673  8830 rpcz_store.cc:276] 0709 12:10:43.071907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.397862 (+325955us) service_pool.cc:224] Handling call
0709 12:10:43.398316 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.727958 (+329642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.088890 (+360932us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54001edcd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:44.098415 (+  9525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714050816}
I20260709 12:10:44.033766 11221 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:44.106671 11221 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.021656  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:43.922904 11469 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.111846 11469 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:43.969548  8751 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:44.016549  9519 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEARNER]: Advancing to term 5
I20260709 12:10:44.114509 11469 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.095634  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:43.952476  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.125892  8760 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.059157 11560 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.962s	user 0.000s	sys 0.009s
I20260709 12:10:44.010553 11480 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:10:44.115864 11221 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:44.100885 11545 consensus_meta.cc:287] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.004s
I20260709 12:10:44.098449  8835 rpcz_store.cc:276] 0709 12:10:42.701949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.812978 (+111029us) service_pool.cc:224] Handling call
0709 12:10:44.078494 (+1265516us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400389ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:44.097705 (+ 19211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148332416}
I20260709 12:10:44.009707 11596 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.108609 11231 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:44.109323  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 102818us
I20260709 12:10:44.125970  8903 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
W20260709 12:10:44.088871 11437 consensus_meta.cc:287] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.006s
I20260709 12:10:44.117408 11573 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.067098 11533 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:44.019338  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 244926us
W20260709 12:10:44.134264  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 375654us
I20260709 12:10:44.140717  9487 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:44.116513 11154 ts_tablet_manager.cc:1467] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Tablet startup took 1013ms
I20260709 12:10:44.135164  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.148264  8798 leader_election.cc:400] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:44.148700  8798 leader_election.cc:403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.137703  8900 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:44.138432  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.150929  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.171466  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.150457  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.129520 11578 raft_consensus.cc:697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:44.186385  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45555.3us
I20260709 12:10:44.141368 11533 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:44.141649 11202 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.206632  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:44.210474  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.133692 11545 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:44.216708  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 76115.5us
I20260709 12:10:44.182689  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.218142  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.216735  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.220566 11604 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.221354  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.222930  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.223738  8752 raft_consensus.cc:2410] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:44.223577 11604 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.172812 11331 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.182075 11216 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4.
I20260709 12:10:44.225835  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.225054  8753 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.225442 11543 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.225042  8759 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.223946  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.225368  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.141530 11558 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:10:44.143119 11437 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.182262 11591 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.228220  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.237888  8759 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.242978  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.243753  8753 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:44.244598  8758 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.244855  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:44.246488  8756 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:44.205796 11598 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:44.247941 11600 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:44.252678 11594 consensus_queue.cc:1059] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:44.248050 11202 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.134626 11596 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.240176 11543 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:44.264120  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.248195 11231 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.266183  8753 pending_rounds.cc:85] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 3
W20260709 12:10:44.266449 11601 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:44.275182  8832 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.290086  8753 pending_rounds.cc:107] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:44.301438  8753 raft_consensus.cc:2889] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:44.301537  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:44.235661 11216 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:44.306900 11216 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:44.307946 11216 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.311208 11437 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:44.302407 11603 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.257278 11600 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.304380  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 465) took 1781 ms. Trace:
I20260709 12:10:44.258476 11536 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.305418  8724 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.306267 11606 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.312326 11480 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:44.314337 11599 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:44.316030 11456 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.304191  8758 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:44.329320  8826 rpcz_store.cc:276] 0709 12:10:42.523469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.523718 (+   249us) service_pool.cc:224] Handling call
0709 12:10:42.537433 (+ 13715us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:42.545076 (+  7643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.545116 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:42.875757 (+330641us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b2c00010c48. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:10:42.897676 (+ 21919us) log.cc:844] Serialized 52 byte log entry
0709 12:10:42.960202 (+ 62526us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:42.960670 (+   468us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.970675 (+ 10005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.970778 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.058293 (+1087515us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:44.304002 (+245709us) raft_consensus.cc:1685] finished
0709 12:10:44.304034 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.304293 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27372,"prepare.queue_time_us":220,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":117556,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":12616,"spinlock_wait_cycles":80109312,"thread_start_us":58524,"threads_started":1,"wal-append.queue_time_us":146563}
I20260709 12:10:44.321071 11543 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.322656  8759 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:44.337106 11591 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:44.329278  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 111260us
I20260709 12:10:44.346552  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.331669  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.348568  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.317724  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.339967  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet 16a04653cca743d0966d20df2225c35d (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:10:44.263221 11533 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.330019  8760 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:44.355489  8754 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.359681  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.339020 11594 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.379252  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.385238  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.367239  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.388350  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.332619 11600 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.264207 11598 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.273839 11578 consensus_queue.cc:237] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.357388 11604 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.390173 11468 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.341063 11217 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:44.401522  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:44.364411 11533 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.345000 11573 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:10:44.401432 11202 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.382860 11542 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:44.398981  8799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.873s (SENT) [suppressed 25 similar messages]
I20260709 12:10:44.389962 11504 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:44.411831 11497 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.357849 11456 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.391490 11557 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:44.490476 11583 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.592s	user 0.003s	sys 0.005s
I20260709 12:10:44.490715 11504 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:44.491125 11557 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:44.492098 11572 raft_consensus.cc:3055] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:44.492882 11572 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:44.434216 11598 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:44.382660 11553 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:44.492478 11557 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.416605  8829 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:44.413130 11380 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 12:10:44.470758 11605 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.076s	user 0.003s	sys 0.003s
I20260709 12:10:44.472867 11545 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.474511 11600 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.451829 11258 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.464746 11581 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.480620 11456 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.484232 11202 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:44.484840 11469 raft_consensus.cc:3055] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.486840 11495 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:44.488505  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.488801 11492 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:44.413677  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.468273 11596 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.410605  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.424506 11536 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.457665 11542 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:44.510063 11573 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:44.543592  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 144646us
I20260709 12:10:44.541857  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.549207  8826 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:44.549356  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 135749us
I20260709 12:10:44.554076  8872 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.535594 11437 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.557972  8760 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:44.538856 11258 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:44.442032 11591 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.567507  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.568058 11586 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:44.569375 11493 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.569821 11493 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.570205 11493 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.562551 11536 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:44.571887 11536 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.574115 11536 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.574709  8752 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:44.559033 11437 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:44.575922 11437 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:44.577368 11437 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.547067 11202 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.549844 11469 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:44.568919 11586 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.566182  9516 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:44.587687  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.561472 11380 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.492157 11504 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.564194 11497 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.551050 11495 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.565003 11543 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.657143  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.552924 11492 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:44.660166  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 96213.1us
I20260709 12:10:44.545112 11581 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.582981 11219 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
W20260709 12:10:44.650552  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 100759us
I20260709 12:10:44.668740  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.669513  8900 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:44.671500  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.672031 11219 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:44.160983 11154 ts_tablet_manager.cc:1469] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Trace:
0709 12:10:31.838171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.838301 (+   130us) service_pool.cc:224] Handling call
0709 12:10:32.118266 (+279965us) ts_tablet_manager.cc:934] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
0709 12:10:36.429310 (+4311044us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:37.194588 (+765278us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:37.198831 (+  4243us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:37.415803 (+216972us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:37.416128 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:37.416452 (+   324us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:37.416520 (+    68us) inbound_call.cc:177] Queueing success response
0709 12:10:40.496895 (+3080375us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:10:43.102873 (+2605978us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:10:43.103549 (+   676us) tablet_replica.cc:261] Starting instrumentation
0709 12:10:43.104171 (+   622us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":53330,"mutex_wait_us":25475,"raft.queue_time_us":2155,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":14920,"tablet-copy.queue_time_us":250415,"tablet-download-pool.queue_time_us":55232,"tablet-download-pool.run_cpu_time_us":2045,"tablet-download-pool.run_wall_time_us":2213828,"thread_start_us":227089,"threads_started":2}
I20260709 12:10:44.672479 11219 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:44.673478 11219 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.673925 11558 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.674423 11615 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.655108 11468 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:44.674634 11219 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.675021 11615 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.678133 11615 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.681216 11586 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.682050  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.684834 11492 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.675050 11468 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.685840 11469 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.688167 11468 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.689611  8833 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:44.689790  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.651293 11607 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.654886 11536 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.691856  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.693527  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.583560 11573 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.697136  8900 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:44.713234  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:44.700017  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.713758  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.718385  9522 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:44.668185 11258 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.722939 11258 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.726922  8875 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:44.699424 11607 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.667534 11543 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.736516 11555 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.720153 11576 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:44.748997 11581 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.749511 11607 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:44.750384 11617 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:10:44.769277 11600 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:44.750578 11613 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:10:44.771490  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.727150 11586 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:44.753091  8903 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:44.755319 11456 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.756314 11216 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.762578  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.765825  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.698923 11542 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:44.777889 11258 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.778086  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.778473 11258 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.779286  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:44.719820 11536 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.779811 11468 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.780334 11468 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.781345 11536 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.766937 11576 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.786413 11621 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:44.744091 11437 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:44.787070 11621 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.787356 11598 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.787693 11437 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:44.788230 11437 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.788733 11497 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.789145 11497 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:44.789103 11216 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.790228 11497 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:44.767936  8832 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.791527 11497 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.791697 11216 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:44.779413  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.787390 11576 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.780730 11258 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.782811 11468 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.784409  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.794312  9521 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:44.766765  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.795812  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.796378  8831 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:44.797150  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:44.797721  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.798092  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.798657  8831 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:44.799432  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.800151  8900 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:44.801129 11621 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.802296  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.803536  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.804916  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.804800 11456 consensus_queue.cc:1059] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:44.805598  8906 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:44.805840  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.806951 11459 raft_consensus.cc:3055] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.807329 11459 raft_consensus.cc:740] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:44.805526  8832 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.789559 11495 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:44.753743 11555 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.782640  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.799631  8908 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:44.766088 11543 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:44.809700  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:44.810328  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.832846  9519 raft_consensus.cc:2410] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:44.785084  8827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1887) took 2070 ms (client timeout 1936 ms). Trace:
W20260709 12:10:44.833418  8827 rpcz_store.cc:269] 0709 12:10:42.714810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.747124 (+ 32314us) service_pool.cc:224] Handling call
0709 12:10:44.784900 (+2037776us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540037d054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:44.785007 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737140608}
I20260709 12:10:44.834477  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.810128  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:44.815948  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:44.841142  9523 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:44.841836  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.845104  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.845763  8903 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:44.850411  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.850989  8760 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:44.851815  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.852468  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:44.854620  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.855582  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.856745  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.857327  8760 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:44.859591  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.859820  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.860553  8900 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:44.861630  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:44.872920  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:44.873713  8901 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:44.904878  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:44.849329 11258 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.907368  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:44.906421  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 248162us
I20260709 12:10:44.908310  8760 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:44.908162  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:44.909340  8835 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:44.909644  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:44.910506  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61212.9us
I20260709 12:10:44.911684  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:44.869438 11495 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:44.871901 11456 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.922587 11623 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.925210  8903 raft_consensus.cc:2410] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:44.934856 11219 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:44.935348  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:44.907722 11258 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.808157 11459 consensus_queue.cc:260] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:44.938922  8874 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:44.928383 11560 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:44.919921 11586 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.935832 11219 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.948494  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:44.921247 11495 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.928186 11456 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:44.994462  8826 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:44.936173 11533 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:45.001227  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52839.1us
I20260709 12:10:45.002305  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:44.940917 11532 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.920744 11468 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:10:44.920265 11492 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:10:44.944366 11258 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.936378 11623 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:10:44.999426 11456 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.997522 11586 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:44.997931 11578 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.058509 11459 raft_consensus.cc:3060] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.997653 11219 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.059134 11581 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.160827  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 239635us
I20260709 12:10:44.996805 11495 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.074105 11483 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:45.172185  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.044899 11509 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:45.199041  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.200250  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:45.203678 11493 consensus_meta.cc:287] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.633s	user 0.016s	sys 0.005s
I20260709 12:10:45.208568 11202 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.210103  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:45.199188  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:45.214006  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:45.215580 11589 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 1.318s	user 0.003s	sys 0.008s
I20260709 12:10:45.200563 11581 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.193763 11483 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.221457  8904 raft_consensus.cc:1240] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:45.168030 11586 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.229290 11467 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.269814 11467 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.274042 11581 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:45.277485  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 232960us
I20260709 12:10:45.243404  8799 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.156566 11532 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:45.177310 11573 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.218302  8833 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:45.222185 11509 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:45.310105  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 66795.3us
I20260709 12:10:45.175513 11578 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.314414  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.244473 11202 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.248281 11591 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.324738  8904 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:45.323978 11219 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.329900 11541 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.330363 11541 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.330655 11532 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.331286 11532 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.330722 11541 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.313277 11533 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.336566 11533 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.332350 11532 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.340945 11631 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.341820 11532 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.345494 11202 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.348111 11202 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:45.349473 11630 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:45.229835 11493 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.326653 11592 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:10:45.308859 11509 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.278599 11483 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:45.365335  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 51015.5us
I20260709 12:10:45.350294 11557 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.371438  8760 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.316186 11549 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:10:45.365092  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 59541.7us
I20260709 12:10:45.367745  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:45.359521 11629 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:10:45.359925 11555 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.388268 11221 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.393152 11467 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.371670 11219 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.398690  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:45.397267 11221 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:10:45.403345  8725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.009s
W20260709 12:10:45.404958  8725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.009s
I20260709 12:10:45.393846 11557 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.405094  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:45.405263  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 548316us
I20260709 12:10:45.410959  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:45.411674  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:45.412438  8724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.008s
W20260709 12:10:45.413797  8724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.008s
W20260709 12:10:45.412783  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 173668us
W20260709 12:10:45.427178  8831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.009s
W20260709 12:10:45.449889  8831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.007s	sys 0.020s
I20260709 12:10:45.427465  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:45.416257  8902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.008s
W20260709 12:10:45.451277  8902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.002s	sys 0.008s
I20260709 12:10:45.451314  8826 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
W20260709 12:10:45.414084  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 555057us
I20260709 12:10:45.455278  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:45.447935  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:45.459764  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.460423  8827 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:45.413417  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:45.468391  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55068.4us
I20260709 12:10:45.466270  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:45.473625  8826 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:45.409066 11557 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:45.474272  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.480180  8827 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:45.412569 11555 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.483749  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.415021 11549 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.483121 11592 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:45.422077 11504 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:45.466533 11634 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:45.453135 11591 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:45.488392  8835 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:45.453248 11375 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.490155  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:45.496570 11557 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.476475 11467 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:45.483502 11437 consensus_meta.cc:287] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
W20260709 12:10:45.499018  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.487924 11549 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.488454 11555 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:45.514676  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:45.501963 11591 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:45.501654 11603 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:45.508329 11639 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:45.501160 11641 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.504238 11578 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:45.468740 11221 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.532001 11643 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:45.532588 11649 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.514834 11549 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.513625 11545 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.580794 11545 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.581209 11558 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.581413 11545 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.581846 11643 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.536736 11331 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:45.583371 11331 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.514443 11555 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.536383  8757 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:45.513065 11467 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.537292  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1886) took 2816 ms. Trace:
I20260709 12:10:45.499940 11504 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.585291 11545 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:45.593820  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1728) took 2141 ms (client timeout 1694 ms). Trace:
W20260709 12:10:45.594264  8756 rpcz_store.cc:269] 0709 12:10:43.452869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.452985 (+   116us) service_pool.cc:224] Handling call
0709 12:10:45.593525 (+2140540us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54002b2fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:45.593712 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742430464}
I20260709 12:10:45.586344  8834 rpcz_store.cc:276] 0709 12:10:42.714462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.877916 (+163454us) service_pool.cc:224] Handling call
0709 12:10:42.878335 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.963988 (+1085653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.522206 (+1558218us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400388bd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:45.531104 (+  8898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495337344}
I20260709 12:10:45.595433  8751 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:45.545892 11650 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.545624 11641 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.521540 11493 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:45.602758 11641 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.551909  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 605) took 2470 ms. Trace:
I20260709 12:10:45.603440  9524 rpcz_store.cc:276] 0709 12:10:43.081900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.082726 (+   826us) service_pool.cc:224] Handling call
0709 12:10:43.098333 (+ 15607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.955513 (+857180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.551577 (+1596064us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400753ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:45.551808 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970025344}
I20260709 12:10:45.603960 11643 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:45.554874 11572 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.604437 11549 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:45.556810  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.524418 11600 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.524955 11591 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:45.560074 11633 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:10:45.507932 11437 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.575925 11581 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:45.535708 11603 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.594743 11497 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.601100 11649 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.608723 11221 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.605080 11572 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.609133 11638 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.580961 11495 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.609711 11600 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.612026  8834 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:45.623065  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.611327  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 163513us
I20260709 12:10:45.635401  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.637518  8799 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.626346 11603 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.626278 11497 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.628695 11468 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.658838  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.661532  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.638384 11600 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.667829  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.602813 11467 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.670341  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.674764  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.670826  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:45.643883 11631 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.639797 11543 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.629140 11581 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.684510  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1737) took 1291 ms. Trace:
I20260709 12:10:45.685128  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.688395  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.689546  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.690526  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.691790 11637 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:45.692773 11636 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.693307 11636 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.695960 11635 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:10:45.674266 11380 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:45.697239 11635 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.697556 11380 consensus_queue.cc:1243] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:45.697674 11635 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:45.698915 11635 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:45.700589 11628 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.412s	user 0.003s	sys 0.005s
I20260709 12:10:45.702435  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1739) took 1439 ms. Trace:
I20260709 12:10:45.703598 11509 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:45.705564 11459 consensus_meta.cc:287] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 12:10:45.702782  8752 rpcz_store.cc:276] 0709 12:10:44.263191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.577838 (+314647us) service_pool.cc:224] Handling call
0709 12:10:44.583266 (+  5428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.700956 (+117690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.701008 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.701678 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.932464 (+230786us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:44.998872 (+ 66408us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.999192 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.999304 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.584582 (+585278us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:45.702129 (+117547us) raft_consensus.cc:1685] finished
0709 12:10:45.702234 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.702373 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68944,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":49,"raft.queue_time_us":108043,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6373,"spinlock_wait_cycles":120533632,"thread_start_us":329194,"threads_started":2,"wal-append.queue_time_us":277902}
I20260709 12:10:45.686203  8753 rpcz_store.cc:276] 0709 12:10:44.393286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.669706 (+1276420us) service_pool.cc:224] Handling call
0709 12:10:45.684036 (+ 14330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.684202 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.684228 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.684266 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:45.684294 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.684345 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.684456 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.713805  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:45.723749  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 218314us
I20260709 12:10:45.731056  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1740) took 1149 ms. Trace:
I20260709 12:10:45.731714  8753 rpcz_store.cc:276] 0709 12:10:44.581319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.714756 (+1133437us) service_pool.cc:224] Handling call
0709 12:10:45.730211 (+ 15455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.730452 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.730490 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.730549 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.730593 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.730683 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.730995 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:45.714036 11258 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 12:10:45.630009 11650 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.741890  8904 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.746243  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:45.678269 11456 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.672586 11468 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.720541 11504 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.750244  8724 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:45.755282  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:45.657693 11638 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.771631  8756 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.772403  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:45.742290  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.760449 11641 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:45.761296 11495 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:45.748121 11459 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.765969 11468 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.768090 11456 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:45.769520 11573 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:45.772703  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.773670  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:45.719782 11635 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.692384 11637 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.788980  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:45.774899  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.757712  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 112923us
W20260709 12:10:45.777637  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 200651us
I20260709 12:10:45.753590  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:45.752799 11643 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:45.753867 11493 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:45.792035  8753 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:45.791946  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.791896  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.792510  9488 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:45.747802 11258 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.786036 11573 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:45.770411 11644 consensus_queue.cc:1059] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:45.790427 11641 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.807673  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 572) took 1036 ms. Trace:
W20260709 12:10:45.809772  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 54552.4us
I20260709 12:10:45.747771 11541 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.815843  8753 rpcz_store.cc:276] 0709 12:10:44.771685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.806774 (+1035089us) service_pool.cc:224] Handling call
0709 12:10:45.807124 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.807308 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.807336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.807383 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.807431 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.807501 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.807615 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.806510 11456 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.838377 11456 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.838850 11456 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.842504  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1738) took 1594 ms. Trace:
I20260709 12:10:45.843106  8751 rpcz_store.cc:276] 0709 12:10:44.248545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.361300 (+112755us) service_pool.cc:224] Handling call
0709 12:10:45.595192 (+1233892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.596015 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.842202 (+246187us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002b2fd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:45.842428 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836932352}
I20260709 12:10:45.803566 11545 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.804818 11493 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.801895 11643 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.826383  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:45.828763  8907 raft_consensus.cc:2368] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:45.830618 11258 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.830928 11649 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.814260 11280 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.857420  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:45.833444 11636 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.808266 11437 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.833598 11660 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.834076 11509 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:45.801797 11656 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.835438 11650 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.814939 11641 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:45.845614  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 209453us
I20260709 12:10:45.842805 11555 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:45.849396  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:45.848109  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 573) took 1076 ms. Trace:
I20260709 12:10:45.895856  8753 rpcz_store.cc:276] 0709 12:10:44.771921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.837547 (+1065626us) service_pool.cc:224] Handling call
0709 12:10:45.837869 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.847711 (+  9842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.847748 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.847797 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.847836 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.847908 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.848045 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.898005  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 575) took 1125 ms. Trace:
I20260709 12:10:45.898329  8753 rpcz_store.cc:276] 0709 12:10:44.772410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.897325 (+1124915us) service_pool.cc:224] Handling call
0709 12:10:45.897623 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.897784 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.897801 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.897832 (+    31us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.897852 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.897885 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.897960 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.899551  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 576) took 1126 ms. Trace:
I20260709 12:10:45.899794  8753 rpcz_store.cc:276] 0709 12:10:44.775775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.899021 (+1123246us) service_pool.cc:224] Handling call
0709 12:10:45.899234 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.899358 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.899372 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.899401 (+    29us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.899420 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.899450 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.899514 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:45.851032  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 59513.8us
I20260709 12:10:45.813143 11573 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.909379 11638 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:45.910183  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:45.918121  8753 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:45.830607  8902 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:10:45.866425  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.852371  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.858096  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:45.798542 11331 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:46.027042  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 169514us
I20260709 12:10:45.873821  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.853396  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:45.874897  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.783649 11459 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:45.879606  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:45.906708 11586 consensus_meta.cc:287] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.008s
I20260709 12:10:45.847282 11545 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.886237  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:45.849174  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 574) took 1077 ms. Trace:
I20260709 12:10:46.044704  8751 rpcz_store.cc:276] 0709 12:10:44.772166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.844239 (+1072073us) service_pool.cc:224] Handling call
0709 12:10:45.848502 (+  4263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.848769 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.848809 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.848861 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.848902 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.848954 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.849095 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.890872  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:45.892139  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.046394  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.901336 11644 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:45.905210  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:46.050417  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.052973  9519 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.959259  8834 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:45.883263  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:45.889372 11641 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.033867  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 159096us
I20260709 12:10:46.037492  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-d0e4c6e5758d4fb18617b5b7c30cd334 received from {username='slave'} at 127.0.0.1:40132
I20260709 12:10:46.038044  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:45.887835 11581 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.039103  8799 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:46.056674  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.028694  8831 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:46.062366  9523 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:46.092485  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53475.4us
I20260709 12:10:46.094656  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:45.960757 11231 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.089599 11664 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:10:46.100287  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.039999 11652 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.044040 11495 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.034855 11631 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.115692 11657 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:46.118145  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 191181us
I20260709 12:10:46.119904 11331 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.122246  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.048349 11545 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.132680  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.145555  8831 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.035238 11637 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.141505  8902 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.146730  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-d0e4c6e5758d4fb18617b5b7c30cd334 on tablet d0e4c6e5758d4fb18617b5b7c30cd334 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:46.147130 11536 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.149045 11555 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.130451 11231 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.153932 11459 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.170830  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.048753 11586 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.108202 11650 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:46.069114 11644 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.180930 11541 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.237550  9519 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:46.181797 11603 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 12:10:46.250192  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.251549  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:46.241926  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1737) took 1992 ms (client timeout 2107 ms). Trace:
I20260709 12:10:46.221496  8900 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
W20260709 12:10:46.182814 11593 log.cc:927] Time spent T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 1.904s	user 0.000s	sys 0.006s
I20260709 12:10:46.254828 11665 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.259158 11456 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:46.260988 11626 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.061s	user 0.006s	sys 0.000s
W20260709 12:10:46.181957 11483 consensus_meta.cc:287] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.808s	user 0.013s	sys 0.000s
W20260709 12:10:46.264540  8758 rpcz_store.cc:269] 0709 12:10:44.243788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.245604 (+  1816us) service_pool.cc:224] Handling call
0709 12:10:46.236252 (+1990648us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b540014c8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:46.236426 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84244736}
W20260709 12:10:46.267069  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 363698us
I20260709 12:10:46.273624  8902 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:46.277933  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.286919  8900 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:46.271734  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1741) took 1998 ms. Trace:
I20260709 12:10:46.277202 11221 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.276568 11459 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:46.278196  9521 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.222878 11231 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.253197  8908 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:46.282766  8827 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:46.182690 11555 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:46.174577 11600 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.286207  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.289523 11493 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.289880  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.289031  8754 rpcz_store.cc:276] 0709 12:10:44.273441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.645121 (+371680us) service_pool.cc:224] Handling call
0709 12:10:44.660596 (+ 15475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.660944 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:44.661342 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.155938 (+1494596us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180045b440. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce323a 00007fce3814da2a
0709 12:10:46.271347 (+115409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.271400 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.271448 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.271514 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.271667 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":17719,"raft.queue_time_us":759,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1349,"spinlock_wait_cycles":5929216,"thread_start_us":114387,"threads_started":1}
W20260709 12:10:46.302371  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 207788us
I20260709 12:10:46.303575  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:46.294396 11557 consensus_meta.cc:287] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.002s
I20260709 12:10:46.266067 11603 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.308173  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.336589  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.339098  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:46.340548  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:46.308547  8799 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:46.352550  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44074.8us
I20260709 12:10:46.285591 11665 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.357844  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.362018  8752 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:46.363968  8905 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.369771  9525 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEARNER]: Advancing to term 6
I20260709 12:10:46.370894  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1736) took 2135 ms. Trace:
I20260709 12:10:46.371299  8757 rpcz_store.cc:276] 0709 12:10:44.235070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.359375 (+124305us) service_pool.cc:224] Handling call
0709 12:10:44.383550 (+ 24175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.586140 (+1202590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.370648 (+784508us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540014d7d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.370834 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644461312}
I20260709 12:10:46.372844  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.373180  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.294430 11221 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.294277 11459 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.299062 11573 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.374363  8827 raft_consensus.cc:1217] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Deduplicated request from leader. Original: 4.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 12:10:46.383623  8908 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:46.362970 11493 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.305277 11555 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.385360  8827 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:46.377504  9525 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:46.378530  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.428220  9522 raft_consensus.cc:2368] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:46.365124 11231 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:46.407778  9519 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.387725  8831 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:46.366245 11658 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:46.387224  8908 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:46.437253 11456 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.438355 11641 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.313225 11557 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:46.427206 11591 consensus_meta.cc:287] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.003s
I20260709 12:10:46.365384 11650 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.286165 11483 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.391010 11604 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.378435  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.376780  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.429132 11493 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:46.373292 11644 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.354607  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:46.305388  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.445757 11635 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.381245  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 507) took 2740 ms. Trace:
I20260709 12:10:46.430516 11231 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:46.466828  8902 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:46.458770  8828 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.467967  8909 raft_consensus.cc:2393] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:46.451261 11666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.032s	sys 0.024s
W20260709 12:10:46.467924  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 113423us
I20260709 12:10:46.450850 11604 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:46.445482 11637 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:46.465754 11493 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.468494 11586 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.450081 11591 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:46.490715 11666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.037s	sys 0.026s
W20260709 12:10:46.502065  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 165094us
I20260709 12:10:46.447605 11658 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.475298 11231 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:46.496563  9517 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:10:46.535899  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.543342 11603 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:46.545003  8903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2122) took 1733 ms (client timeout 2126 ms). Trace:
I20260709 12:10:46.543435 11221 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.546706  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1736) took 2159 ms. Trace:
I20260709 12:10:46.547585  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1902) took 1786 ms. Trace:
I20260709 12:10:46.548707  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.550030 11555 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:46.550982  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.474596 11635 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.469621 11650 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.556301  8801 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:46.557698  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.566313  8905 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.564494  8903 rpcz_store.cc:269] 0709 12:10:44.811332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.857890 (+ 46558us) service_pool.cc:224] Handling call
0709 12:10:46.544662 (+1686772us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b540019d054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:46.544918 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43476224}
I20260709 12:10:46.565311  8756 rpcz_store.cc:276] 0709 12:10:44.392886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.601296 (+1208410us) service_pool.cc:224] Handling call
0709 12:10:45.601640 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.775472 (+173832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.546414 (+770942us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540008a2d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.546636 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390495104}
I20260709 12:10:46.565442  8833 rpcz_store.cc:276] 0709 12:10:44.761222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.764758 (+  3536us) service_pool.cc:224] Handling call
0709 12:10:44.765236 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.314748 (+549512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.547287 (+1232539us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400051754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.547509 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040994176}
I20260709 12:10:46.567247 11483 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:46.569948 11627 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.398s	user 0.000s	sys 0.005s
I20260709 12:10:46.574939  9525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:46.600210  9525 raft_consensus.cc:606] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:46.599925 11536 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:46.601016  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.591344  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.594086  9488 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:46.555733 11600 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.558123 11674 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:46.564126 11258 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.575486 11497 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:46.597054 11660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.052s	sys 0.108s
I20260709 12:10:46.602514 11555 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.612119  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.609179  8724 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:46.636883  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.601735 11221 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.619025  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.472081  9520 rpcz_store.cc:276] 0709 12:10:43.640259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.640399 (+   140us) service_pool.cc:224] Handling call
0709 12:10:43.640822 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.641233 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.646930 (+  5697us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.756607 (+109677us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.929400 (+172793us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:43.929460 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.929555 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.872851 (+1943296us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:46.366084 (+493233us) raft_consensus.cc:1685] finished
0709 12:10:46.366107 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.380254 (+ 14147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6694,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":31068,"spinlock_wait_cycles":4709248,"thread_start_us":166778,"threads_started":1,"wal-append.queue_time_us":372884}
I20260709 12:10:46.603746 11509 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.596647 11662 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.650331  8905 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:46.553121 11604 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.659795 11604 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.652850  8724 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.605782 11586 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:46.646332 11660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.053s	sys 0.109s
I20260709 12:10:46.653484 11673 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.672521 11660 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:46.673731 11660 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.653687 11606 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.675393 11673 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:46.614099 11596 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:46.667130  8903 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:46.664710 11662 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.668051 11659 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.613587 11468 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.668715 11658 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:46.669574 11678 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:46.665973  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:46.651193 11603 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:46.613476 11573 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.682832  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.644852 11497 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.603472 11652 consensus_queue.cc:1059] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:46.637487 11545 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.699292  8833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:10:46.610358 11674 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:46.691556  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.684975 11606 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.658370 11637 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.697041  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.683885 11557 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.613824 11258 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:46.678821  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 66841.3us
I20260709 12:10:46.701511  8905 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:46.714769  8905 pending_rounds.cc:85] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 4
I20260709 12:10:46.715040  8905 pending_rounds.cc:107] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:46.655392 11221 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.697595  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:46.710292  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.662187 11509 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.715301  8905 raft_consensus.cc:2889] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.699920  8833 raft_consensus.cc:606] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:46.695706  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.692456 11596 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:46.691978 11603 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:46.693305 11267 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.718524  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.726631  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.727087 11673 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.727807  8826 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:46.729086 11598 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.731397  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.719719  8755 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:46.723230  8827 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.724161  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.724519  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.724912  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.680514 11586 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.733579  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.734326  8834 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:46.726102  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.727555  8875 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.718662  8903 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:46.734758  9525 raft_consensus.cc:2368] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6.
I20260709 12:10:46.738199  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1742) took 1056 ms. Trace:
I20260709 12:10:46.738616  8900 rpcz_store.cc:276] 0709 12:10:45.681509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.360711 (+679202us) service_pool.cc:224] Handling call
0709 12:10:46.379849 (+ 19138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.430637 (+ 50788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.430669 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.448471 (+ 17802us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.595331 (+146860us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.595374 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.595467 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.737938 (+142471us) raft_consensus.cc:1685] finished
0709 12:10:46.738007 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.738141 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18021,"raft.queue_time_us":46668,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":16281,"thread_start_us":105654,"threads_started":1,"wal-append.queue_time_us":209943}
I20260709 12:10:46.693253 11468 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.772346 11468 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.773730  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.774330  8830 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.741756  8835 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:46.777458  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:46.779037  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.779835  8834 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:46.735257  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.780500  8827 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.781545  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:46.782171  8756 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:46.783416  8757 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:46.784051  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 533) took 1225 ms. Trace:
I20260709 12:10:46.743484 11652 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:46.785084 11652 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:46.742579  8875 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.790817  8726 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:46.746742 11221 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.752812  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.753540 11591 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.756419 11258 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.757321  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.809908  8833 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.760124  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.762024 11545 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.764269 11509 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.765374  8903 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:46.730383 11267 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:46.777765  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:46.817142  8835 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:46.745258 11635 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.744589 11662 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:46.731603 11603 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.795287  9521 rpcz_store.cc:276] 0709 12:10:45.558373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.558614 (+   241us) service_pool.cc:224] Handling call
0709 12:10:45.562318 (+  3704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.288769 (+726451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.783676 (+494907us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54005339d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.783960 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637280128}
W20260709 12:10:46.810546  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68363.6us
I20260709 12:10:46.788429 11652 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:46.827431  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:46.828040  8756 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.828223  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:46.820652 11437 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.835286  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:46.835887  8757 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.819344  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 76819.1us
I20260709 12:10:46.837828  8827 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:46.825678  8903 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.813951  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:46.833220  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.833613  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.838900  8826 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.819185  8830 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:46.820740 11606 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.821339 11598 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.851367  8900 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:46.844301  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.855582  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.853271  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:46.855978 11596 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:46.856645  9522 raft_consensus.cc:2368] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:46.856956  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1742) took 2581 ms. Trace:
I20260709 12:10:46.821275 11267 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.857322  8760 rpcz_store.cc:276] 0709 12:10:44.275460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.917228 (+641768us) service_pool.cc:224] Handling call
0709 12:10:44.917582 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.371956 (+454374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.856669 (+1484713us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54002c24d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.856892 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030693120}
I20260709 12:10:46.860901  9516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 529) took 1553 ms. Trace:
I20260709 12:10:46.861505  9516 rpcz_store.cc:276] 0709 12:10:45.307523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.308853 (+  1330us) service_pool.cc:224] Handling call
0709 12:10:45.326752 (+ 17899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.376392 (+ 49640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.386002 (+  9610us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.400209 (+ 14207us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.801748 (+401539us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.804515 (+  2767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.860286 (+1055771us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54005c1054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.860367 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.860442 (+    75us) raft_consensus.cc:1685] finished
0709 12:10:46.860461 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.860816 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4235,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1678,"spinlock_wait_cycles":71766784,"thread_start_us":387160,"threads_started":1,"wal-append.queue_time_us":407549}
I20260709 12:10:46.864650 11549 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.867445  8757 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:46.867589  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1732) took 1216 ms. Trace:
I20260709 12:10:46.869455  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1739) took 2364 ms. Trace:
I20260709 12:10:46.941167  8752 rpcz_store.cc:276] 0709 12:10:44.505318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.710171 (+1204853us) service_pool.cc:224] Handling call
0709 12:10:45.711962 (+  1791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.362621 (+650659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.869116 (+506495us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54001a18d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.869375 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494112128}
I20260709 12:10:46.869777  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:46.870312  8908 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.875082 11280 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:46.841933 11635 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:46.877928 11643 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.868021  8657 catalog_manager.cc:5697] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
W20260709 12:10:46.880366  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 45864.9us
I20260709 12:10:46.886021  8828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 1977) took 1035 ms. Trace:
I20260709 12:10:46.888283  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1906) took 2125 ms. Trace:
I20260709 12:10:46.954589  8874 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:46.955083  8829 rpcz_store.cc:276] 0709 12:10:44.762617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.768356 (+  5739us) service_pool.cc:224] Handling call
0709 12:10:44.768706 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.783751 (+ 15045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.783785 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.783826 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.783856 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.887980 (+2104124us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54001ee954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.888042 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.888210 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34110720}
I20260709 12:10:46.888897 11665 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:46.890357 11555 raft_consensus.cc:3055] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:46.893340 11620 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:46.897115 11598 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:46.906461 11641 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:46.907922  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.913552  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.998162  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.925287  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.932399  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.933637  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:47.003019  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.936666  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.940196  8909 rpcz_store.cc:276] 0709 12:10:45.651640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.651764 (+   124us) service_pool.cc:224] Handling call
0709 12:10:46.867311 (+1215547us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54003e8854. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:46.867507 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815708928}
I20260709 12:10:46.954602 11607 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.004412  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:46.948021  8833 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
W20260709 12:10:46.948662  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 78952.5us
I20260709 12:10:46.950765  8826 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:46.957083  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:46.959031  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 280333us
I20260709 12:10:46.958423  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.008157  8832 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.954442  8828 rpcz_store.cc:276] 0709 12:10:45.850703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.850877 (+   174us) service_pool.cc:224] Handling call
0709 12:10:45.851162 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.474798 (+623636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.885657 (+410859us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540006a254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:46.885928 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396884736}
I20260709 12:10:47.008932  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.009282  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.010761  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.837185 11231 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.013815  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.014308  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:47.014699  8753 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:47.015528  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:46.950310 11280 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.026872  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:47.027872  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.028522  8909 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.011119  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.012413  8752 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:47.031061  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.011792  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:46.937608 11682 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:47.018345  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.033864  8753 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.018638  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:46.962834  8657 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 5, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 5 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.021734  8903 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:47.022171  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.024616  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:46.962496 11468 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.025616 11231 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:47.048574  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:47.049075  8907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1736) took 1378 ms (client timeout 1545 ms). Trace:
I20260709 12:10:47.049767  8903 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:47.049455  8907 rpcz_store.cc:269] 0709 12:10:45.670663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.681055 (+ 10392us) service_pool.cc:224] Handling call
0709 12:10:47.048899 (+1367844us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b54001635d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:47.049021 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229771136}
I20260709 12:10:47.049460  8904 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:46.852489 11493 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.051852  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.031548  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.038264  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.052943  8833 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:47.025200  8754 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:47.040277  8759 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:46.994428 11509 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.961958 11456 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:47.042374  8657 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 3 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.043939  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:47.044953  8757 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:46.995186 11555 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:46.961413 11635 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:47.046487  8829 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.962162 11643 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:47.057608  9524 raft_consensus.cc:606] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:47.041700 11595 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:47.062837 11509 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:47.062709 11456 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.069216 11509 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:47.069309 11456 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.048420 11682 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.070879 11459 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.041002  9517 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.041239 11468 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:47.072521 11468 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.072965  8657 catalog_manager.cc:5697] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 5, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.074438  8657 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 4, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 4 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.075551  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.076084 11684 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:47.077256  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.077490  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.078783 11684 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.079169 11684 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:47.057596  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.075785  8657 catalog_manager.cc:5697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 5 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.037762 11641 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.080010 11684 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.090867  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.093083  8902 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:47.032187 11620 consensus_queue.cc:1243] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:47.026219 11557 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:47.108445  8757 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.056295 11606 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.091219  8657 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 4, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 4 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.072428 11682 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:47.026476 11591 consensus_queue.cc:1059] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:47.108194  8754 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:47.086397 11636 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.016s
I20260709 12:10:47.056519 11650 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.060691 11579 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.038120 11623 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:47.126935  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.076097 11652 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:47.132651  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:47.106233  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.136937  9523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:47.098320 11509 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.142580 11636 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.003s	sys 0.016s
I20260709 12:10:47.166028  8753 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:47.166457  8757 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:47.148866  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 103929us
I20260709 12:10:47.131134 11586 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:47.149509  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.105309 11674 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:47.152254  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.099181 11637 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.169731  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.171864  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.172813  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.148488 11456 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.092032 11643 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.102476 11641 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.175695  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.183606  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.190344  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.190742  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.191468  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.191605  8760 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:47.147712 11596 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.193427 11596 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.146451 11684 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.141757 11607 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.197538 11607 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.184235  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.201133  8757 raft_consensus.cc:2368] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6.
I20260709 12:10:47.202167  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.202852  8757 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:47.203805  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.205273  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.211809  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:47.210414  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.206301 11596 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.217033  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.217936  8760 raft_consensus.cc:2410] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:47.139770 11644 consensus_queue.cc:1059] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:10:47.218955  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48419.6us
I20260709 12:10:47.171030 11573 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.090466 11598 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.171312 11459 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:47.140774 11606 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.165022 11650 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.225517  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.253324  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1751) took 1439 ms. Trace:
I20260709 12:10:47.174657  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.228026  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.266820  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.174070 11637 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:47.271499  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 46102.3us
I20260709 12:10:47.271080  8905 rpcz_store.cc:276] 0709 12:10:45.815307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.654323 (+839016us) service_pool.cc:224] Handling call
0709 12:10:46.654630 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.717725 (+ 63095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.252999 (+535274us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54003e9254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:47.253237 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104713600}
I20260709 12:10:47.281061  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.276270  8754 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:47.282648  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.277021  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.284168  8872 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.171320 11509 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.272034  8657 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 5, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.292543  8753 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:47.293181  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.285594  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.297148  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.298452  8872 leader_election.cc:400] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6.
I20260709 12:10:47.289294 11682 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:47.286089  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 120331us
I20260709 12:10:47.286219  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.303642  8760 raft_consensus.cc:2410] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:47.305141  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.303987  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.266285 11536 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.260855 11573 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.233686 11216 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:47.299278  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:47.175129 11635 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.275148 11596 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.314896  8756 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:47.318046  9520 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:47.319613 11692 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:47.309748 11700 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:47.321770 11493 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:47.309998 11644 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.361405  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1735) took 2974 ms. Trace:
I20260709 12:10:47.361829  8755 rpcz_store.cc:276] 0709 12:10:44.386634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.205289 (+818655us) service_pool.cc:224] Handling call
0709 12:10:46.236559 (+1031270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.732499 (+495940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.360204 (+627705us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540014c8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:47.361214 (+  1010us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540014c8d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:47.361326 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481302272}
I20260709 12:10:47.307273 11557 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:47.300976 11483 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.301451 11638 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.289326 11217 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.280931 11683 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.328763  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.227385 11456 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:10:47.341663  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.372126  8657 catalog_manager.cc:5697] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
W20260709 12:10:47.349659  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 50441us
I20260709 12:10:47.274330 11467 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:47.301054 11658 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.350335 11662 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.358563  8757 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:47.271677 11459 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:47.368654 11688 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:10:47.359105 11536 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:47.363595 11573 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.361524 11509 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:47.377182  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:47.432737  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 104089us
I20260709 12:10:47.434573  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.435937  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:47.380820  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 109374us
I20260709 12:10:47.437934 11702 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.438751 11702 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:47.440809 11649 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:47.442531 11649 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.443306 11649 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.444147 11607 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:47.445874 11607 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:47.448508  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.449260  8754 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:47.353045 11603 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.440435 11702 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:47.452802 11649 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:47.455071 11700 consensus_queue.cc:1059] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:47.484597  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.385653 11662 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.385243 11638 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:47.459106  8758 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.460225 11231 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:47.462961  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 85880.5us
I20260709 12:10:47.463346 11555 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.466200 11459 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:47.358623 11623 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:47.468586 11683 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.469040  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.514889 11683 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.518249 11697 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.518447 11683 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.518743 11697 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.519706 11697 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.471002  8657 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:47.521260 11697 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:47.450403  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 161899us
I20260709 12:10:47.521507  8657 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:47.522469  8724 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.456537  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 485) took 1597 ms. Trace:
I20260709 12:10:47.487437  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:47.488211 11700 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.503199 11662 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.529251  8657 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:47.489948 11380 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:47.488114  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.494319 11606 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.507300  8872 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.508929  8751 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.506633 11231 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:47.516572 11555 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.523254  8908 rpcz_store.cc:276] 0709 12:10:45.859139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.661145 (+802006us) service_pool.cc:224] Handling call
0709 12:10:46.870032 (+208887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.947859 (+ 77827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.456302 (+508443us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003e8850. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:47.456463 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479569280}
I20260709 12:10:47.385943 11650 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.534698  8657 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 3, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
W20260709 12:10:47.551856  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44671.9us
I20260709 12:10:47.551573  8657 catalog_manager.cc:5697] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:47.542816  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:47.541723  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.553376  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.559219  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.560114  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.560329  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:47.561900  8903 raft_consensus.cc:2410] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:47.554546  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:47.528995 11700 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.564440  9487 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:47.564487  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:47.567701  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.532122 11641 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.510115 11638 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.586901  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.583634  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.585717  8827 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.590898  8904 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:47.591893  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.551431 11606 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.592643  8904 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:47.580298  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.550904 11643 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.553514 11509 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.558794 11467 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.600231  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.577780 11380 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.580950 11275 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:47.609920  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 172452us
I20260709 12:10:47.618515  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:47.627333  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:47.628501  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.627367 11682 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:47.630654 11280 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:10:47.631099 11280 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.633303  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:47.634737 11703 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:47.637061  8752 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:47.637413  8752 pending_rounds.cc:85] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 6
I20260709 12:10:47.637624  8752 pending_rounds.cc:107] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:47.637835  8752 raft_consensus.cc:2889] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:47.619714  8905 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:47.641961 11280 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.626318 11231 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.645016 11717 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.646080 11638 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:47.646893  8799 leader_election.cc:400] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:47.647251  8799 leader_election.cc:403] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:47.648067 11717 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:47.601877  8901 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:47.583000 11497 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.584793 11586 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.652983 11717 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:47.570158 11673 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:47.653417 11456 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.653644 11717 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:47.598555 11468 consensus_meta.cc:287] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.004s
I20260709 12:10:47.656561 11644 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.656598 11717 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.626091 11380 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.657701 11380 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.599023 11659 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:47.622891  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:47.618682 11267 consensus_meta.cc:287] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.761s	user 0.004s	sys 0.008s
I20260709 12:10:47.661325 11267 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.663636  8726 leader_election.cc:400] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6.
I20260709 12:10:47.663692 11267 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:47.664116  8726 leader_election.cc:403] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:47.664443 11586 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:47.660414  8760 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:47.606690  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.585006 11710 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:47.647296 11603 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:47.666992  8726 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.669013  8752 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:47.669675 11275 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:47.678649  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:47.679927  8752 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.602228  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:47.732524  8835 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.709915  8760 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.737432  8906 raft_consensus.cc:1275] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:47.738155  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:47.741093  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.731796  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.671031 11644 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6.
I20260709 12:10:47.695629  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:47.731279  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:47.772429  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.731738  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.751579  9519 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.734972  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.665407 11586 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:47.745852  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.690630 11659 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:47.809084  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.777256  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1749) took 1970 ms. Trace:
I20260709 12:10:47.812748  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:47.813802  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 82594.8us
W20260709 12:10:47.807575  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.819017  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.821101  8753 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:47.700100 11689 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.513s	user 0.000s	sys 0.004s
I20260709 12:10:47.674476 11456 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.813402  8902 rpcz_store.cc:276] 0709 12:10:45.784395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.472773 (+688378us) service_pool.cc:224] Handling call
0709 12:10:46.477039 (+  4266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.093467 (+616428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.754490 (+661023us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400153bd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:47.754735 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416007040}
I20260709 12:10:47.829568  8833 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:47.668586 11468 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.692945 11483 raft_consensus.cc:3055] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.697077  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:47.833856  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.831686 11607 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:10:47.834988  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 100168us
I20260709 12:10:47.824206 11555 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:47.854470  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.815021 11480 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.824379 11504 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:47.864049  8801 leader_election.cc:400] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:47.697760 11668 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 12:10:47.811775 11659 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:47.864557  8760 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:47.673180 11710 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.698179 11666 consensus_queue.cc:1059] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 12:10:47.876394  8801 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.837134 11651 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.871760  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:47.876818  8909 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.884963  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.675330 11683 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.876171  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:47.880159  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 299952us
I20260709 12:10:47.852782 11483 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:47.734267 11719 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:10:47.885751  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.670956 11700 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.897815  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:47.697281 11535 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260709 12:10:47.902401 11715 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:47.882046 11555 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.905016  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.906126 11717 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.906718 11483 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.907446 11267 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.907266 11662 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.909392  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:47.875720 11504 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:47.693583 11275 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.878908 11480 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.914527 11509 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:47.915140  8900 raft_consensus.cc:2368] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8.
I20260709 12:10:47.903784 11713 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:47.923002  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.923586 11652 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.921257 11380 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.915506 11725 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:47.943661  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.928455 11643 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.959362  8902 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:47.951555  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 255037us
I20260709 12:10:47.922189 11715 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:47.963733 11715 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.965438 11644 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:47.966758 11644 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.967224 11644 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:47.924103 11555 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:47.968364 11644 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.970153 11644 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.972296  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:47.974025  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:47.978534  8828 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.974069  8902 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.981760  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:47.993175  8830 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.935627 11683 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:47.935742  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:48.020495  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44490.4us
W20260709 12:10:48.022644  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 87038.4us
I20260709 12:10:48.024425  9523 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:48.023887  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:47.939148 11267 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:47.944346 11509 raft_consensus.cc:697] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:47.994511 11483 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.052973 11651 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.065169  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.029561 11644 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.959971 11674 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:10:48.027354 11467 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.064090 11651 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.091807 11267 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:47.952270 11659 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:48.094609 11720 log.cc:927] Time spent T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:10:48.095451 11721 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:10:48.096423 11724 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:48.097160 11380 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:48.053175 11535 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:47.988452 11717 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:10:48.098104 11467 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.037204 11504 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.000609 11702 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:10:48.054345 11643 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.029631 11652 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:10:48.145198  8831 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:47.953843 11725 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:48.149964  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 240424us
I20260709 12:10:48.145960 11493 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:48.190518  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 274196us
I20260709 12:10:48.173844 11659 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.175876 11504 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.177202 11493 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:48.207010 11662 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:48.199862 11670 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:48.200336 11682 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:10:48.240502  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 275735us
I20260709 12:10:48.184544 11509 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:48.246194 11730 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:48.247622 11682 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.248159 11682 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:48.249091 11682 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.250511 11682 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.263067  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36564 (request call id 5) took 1126 ms. Trace:
I20260709 12:10:48.265159 11469 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.263630  9523 rpcz_store.cc:276] 0709 12:10:47.136448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.136734 (+   286us) service_pool.cc:224] Handling call
0709 12:10:48.262809 (+1126075us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400753ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813d853 00007fce3d10b60a 00007fce366917d4 00007fce36691762 00007fce36691691 00007fce3669160c 00007fce366908c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:48.262946 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001180032}
I20260709 12:10:48.279654  9523 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:48.282068 11727 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:10:48.283905 11728 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:10:48.282107 11651 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.290987 11656 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.291447 11656 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:48.292452  8753 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:10:48.272220  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 214923us
I20260709 12:10:48.296526  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:48.260226 11722 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:10:48.297304  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 194389us
I20260709 12:10:48.311936  8759 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:48.315032  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 117583us
W20260709 12:10:48.318053  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.320010  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.322841  8798 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:48.330155  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.292464 11656 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.341876 11725 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.242234 11493 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.314929 11504 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:48.321341 11467 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:48.373850  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.365020  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:48.321931 11692 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.367069 11656 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.369746 11610 raft_consensus.cc:993] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:48.322371 11572 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:48.375267  8828 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.327142 11702 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.324416  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.385293  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:48.316560 11715 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:48.399437  8759 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.407589  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.408309  8759 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:10:48.381856 11732 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:10:48.410077 11750 raft_consensus.cc:1081] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:48.410367 11493 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.364833 11734 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:10:48.392962 11504 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.435514 11280 raft_consensus.cc:3055] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:48.436064 11280 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:48.438963  8901 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.440237  8828 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:48.440260  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:48.441125  8905 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.445570  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.446533  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.451213  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.452499  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.457921 11745 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:48.458694 11745 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.461588 11745 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.463460  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:48.462553  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47425.8us
I20260709 12:10:48.485276  8905 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:48.457182  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.491765  8901 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.496042 11280 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.497488 11280 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.452559 11715 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.501194 11480 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.504037 11504 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.482928 11737 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:10:48.496871 11753 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:48.481504 11641 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.481571 11606 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:48.511232  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58757.8us
I20260709 12:10:48.489735 11572 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.516147  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.530435  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.486132 11734 consensus_queue.cc:1048] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:48.534107  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:48.529786  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:48.515723 11572 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:48.527707 11467 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.530916 11641 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.545360 11641 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.546124 11641 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.547855 11742 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:10:48.550094 11591 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.550556 11591 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:48.548810 11663 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.551406 11663 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.551692 11591 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.552871  8756 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:48.552925 11591 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.536366 11643 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.561187 11643 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.560887 11467 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.561318 11682 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:48.561714 11643 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.562013 11682 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.562330 11591 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.564834 11467 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:48.565285 11591 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.565964 11682 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:48.543617 11572 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.568372 11591 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.570865 11682 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:48.571385 11682 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.543805  9517 raft_consensus.cc:606] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:48.573408 11682 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.574028 11572 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.576653 11572 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.539407 11744 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.583009  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:48.584988  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:48.585031 11646 raft_consensus.cc:3055] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:48.585731 11646 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:48.585937  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.586803 11646 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:48.615608  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.622421  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.623274  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.627977  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.588521 11646 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:48.630676  8829 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:48.633956  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.634411  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.635213  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.630702  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:48.641883 11711 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
W20260709 12:10:48.642356 11711 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:48.630290  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:48.644832  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2148) took 1106 ms. Trace:
I20260709 12:10:48.645205  8909 rpcz_store.cc:276] 0709 12:10:47.538140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.542005 (+  3865us) service_pool.cc:224] Handling call
0709 12:10:47.542335 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.891766 (+349431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.644532 (+752766us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000b3454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:48.644765 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768470400}
I20260709 12:10:48.650550 11723 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.651135 11723 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:48.651209  8826 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.652971  9523 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.630929  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:48.657871  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.661459  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.664664  8832 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:48.663000 11280 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.679327 11280 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.679836  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.681829 11280 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.682281  8875 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:48.684037 11682 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.687011  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1940) took 1942 ms. Trace:
I20260709 12:10:48.687471  8831 rpcz_store.cc:276] 0709 12:10:46.744978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.064837 (+1319859us) service_pool.cc:224] Handling call
0709 12:10:48.686810 (+621973us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b5400324454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:48.686939 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182208256}
I20260709 12:10:48.677722  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1763) took 1499 ms. Trace:
I20260709 12:10:48.690781  8756 rpcz_store.cc:276] 0709 12:10:47.178185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.358933 (+180748us) service_pool.cc:224] Handling call
0709 12:10:47.360261 (+  1328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.553554 (+1193293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.677337 (+123783us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000f6ed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:48.677631 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741863296}
I20260709 12:10:48.692036  8760 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:10:48.693197  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.694144 11682 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:48.694975 11682 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.656802 11725 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:48.696393 11710 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.696621 11719 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.668659 11483 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.698446  8828 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.676127  9517 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.701687 11467 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.702772 11467 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.703087 11467 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:10:48.703325  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.690053 11708 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.197s	user 0.007s	sys 0.011s
I20260709 12:10:48.703833 11467 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.708091 11682 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.708362 11610 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.708809 11705 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:48.708930 11649 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.709035  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.710577  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:48.711575  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 66885.2us
I20260709 12:10:48.709307 11650 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.709654  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.718183  8904 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:48.721410  8902 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.723945  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.725418  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.678737 11636 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:48.726097  8904 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:48.726428 11636 consensus_queue.cc:1243] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:48.749505  8904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38210
I20260709 12:10:48.759663  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.770226  8904 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:10:48.751080  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1765) took 1572 ms (client timeout 1977 ms). Trace:
W20260709 12:10:48.771842  8757 rpcz_store.cc:269] 0709 12:10:47.178658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.203545 (+ 24887us) service_pool.cc:224] Handling call
0709 12:10:48.750818 (+1547273us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001cbe54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:48.750996 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354358656}
I20260709 12:10:48.770462  8902 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:48.718537 11591 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.723659 11649 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.770895  8904 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:48.783926  8902 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:48.785717  8902 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:48.786170  8902 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:48.787184  8902 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.791349 11700 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.793351  8902 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.749373 11467 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.718519 11610 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.729360  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.697238 11719 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.747810 11637 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:48.725112 11705 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:48.805233  8754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1772) took 1577 ms (client timeout 1702 ms). Trace:
W20260709 12:10:48.807094  8754 rpcz_store.cc:269] 0709 12:10:47.227838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.284310 (+ 56472us) service_pool.cc:224] Handling call
0709 12:10:48.805035 (+1520725us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000f69d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:48.805171 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357190528}
I20260709 12:10:48.689365 11723 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.810735 11610 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.813055 11623 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.813632 11623 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.814028 11649 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.723376 11650 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.816460 11641 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.825277  8756 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:48.825484 11650 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.826606 11623 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.825343 11489 raft_consensus.cc:3055] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:48.828508 11489 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:48.828754 11705 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.829576 11489 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.830709 11489 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.832293 11643 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.833683  8755 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:48.833967 11641 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.793015 11591 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.836074 11591 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.837262  8902 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:48.838160  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.832208 11719 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.849329  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.855525  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.860730  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:48.865440  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.866531  8908 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:48.868203  8908 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:48.873044 11591 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.873705 11591 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:48.873824  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.874202 11591 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.874984  8904 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.850909 11719 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.880198  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.881024  8757 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:48.892400 11719 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:48.893805  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.894829 11719 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.895352  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.896373  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 584) took 2120 ms. Trace:
I20260709 12:10:48.896783  8751 rpcz_store.cc:276] 0709 12:10:46.776332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.788906 (+ 12574us) service_pool.cc:224] Handling call
0709 12:10:46.789214 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.534492 (+745278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.896120 (+1361628us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54002c1ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:48.896291 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654586624}
I20260709 12:10:48.896165  8757 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:48.899343  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.883126  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.883850  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.905349  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.906145  9518 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:48.906421  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 622) took 1366 ms. Trace:
I20260709 12:10:48.885489 11641 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.906831  9520 rpcz_store.cc:276] 0709 12:10:47.540337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.547141 (+  6804us) service_pool.cc:224] Handling call
0709 12:10:48.905233 (+1358092us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:10:48.906326 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13429504}
I20260709 12:10:48.907227 11641 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.886066  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.886471 11623 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.909749 11641 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.887241 11610 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:48.889194  8904 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:48.878101 11650 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:48.911597  8801 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:48.891748  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.882054  8908 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:48.904421  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:48.904492  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.917520  9523 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:48.918392  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.919389  8751 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:48.905416  9517 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:48.909400 11623 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.884243 11649 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:48.910555  8754 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:48.913335  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.869654 11713 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:48.854961 11643 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.928172  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.921976  8757 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.929929  8751 raft_consensus.cc:2393] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:48.931901  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:48.933139  8751 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:48.937665  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2003) took 1195 ms. Trace:
I20260709 12:10:48.938109 11663 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:48.938184  8833 rpcz_store.cc:276] 0709 12:10:47.742378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.743337 (+   959us) service_pool.cc:224] Handling call
0709 12:10:47.743653 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.830126 (+ 86473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.937386 (+1107260us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54003895d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:48.937589 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196538240}
I20260709 12:10:48.941033  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:48.943359  8757 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:48.944571  8902 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:48.950953 11705 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.963828  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:48.949972 11651 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.979970  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:48.930584 11713 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.951723 11717 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.959636 11705 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.951694 11657 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.990392  8798 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:48.992826 11650 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:10:48.992753 11657 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:48.993726 11650 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:48.993944 11657 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.997404  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 588) took 1433 ms. Trace:
I20260709 12:10:48.998037  8758 rpcz_store.cc:276] 0709 12:10:47.563902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.634447 (+ 70545us) service_pool.cc:224] Handling call
0709 12:10:47.634795 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.916801 (+282006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.916835 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.916883 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.916912 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.997015 (+1080103us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54000f50d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:48.997092 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.997312 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647939456}
I20260709 12:10:49.000411  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:49.001226  9517 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:49.002081 11467 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:48.969431 11555 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.017966  9523 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:49.026469 11697 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:49.027778  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.030094 11468 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.013592 11635 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.039008 11635 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:48.984915 11651 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.047920  8751 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.014510 11638 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:49.007032 11705 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.988255 11717 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.049150  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.053182  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.064601  8751 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.065121  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.066902  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:48.976518 11649 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:49.006809 11610 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.006583 11750 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:49.017617 11650 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:49.015450 11719 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:49.069721  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.069247 11731 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:10:49.072613  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.073599  8756 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.079749  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.041671 11692 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.090480  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.015060 11555 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.041736 11509 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:49.093549 11636 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:49.093899  8901 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.093951 11637 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.095650  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.130393  8751 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:49.130926  8907 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.096230 11719 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:49.081532 11610 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:49.084736  8758 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.135293  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.101747  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.138075  8906 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:49.071396 11606 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.122187  8827 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
W20260709 12:10:49.123145  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 43517.1us
I20260709 12:10:49.129774  8903 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.132339  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.150342  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 596) took 1487 ms. Trace:
I20260709 12:10:49.150924  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:49.133241  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.150835  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.153024  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.153033  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.155284  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.156970  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.159749  8724 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:49.183562  8756 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.186069  9488 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:49.071571 11638 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.150755  8752 rpcz_store.cc:276] 0709 12:10:47.663300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.680507 (+ 17207us) service_pool.cc:224] Handling call
0709 12:10:47.680804 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.859239 (+178435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.859295 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.869339 (+ 10044us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.107641 (+238302us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.185592 (+ 77951us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.185883 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.115787 (+929904us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54002b25d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:49.115844 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.115894 (+    50us) raft_consensus.cc:1685] finished
0709 12:10:49.150062 (+ 34168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.150255 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25249,"prepare.queue_time_us":64957,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":24343,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":22772,"spinlock_wait_cycles":355237632,"thread_start_us":212097,"threads_started":1,"wal-append.queue_time_us":302228}
I20260709 12:10:49.184660  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.197697  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.113050 11692 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:49.201308  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.205562  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.206379  8756 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.195493  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.210062 11202 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:49.133795 11598 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.229048  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.230718  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.183943 11637 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.239473 11637 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:49.240715  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 54746.8us
I20260709 12:10:49.242089 11267 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.242475 11267 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:49.242817 11267 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.149612 11636 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.244812 11668 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:49.246781 11636 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.246909 11535 raft_consensus.cc:993] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:49.248215 11535 raft_consensus.cc:1081] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:10:49.249419 11692 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.250491 11692 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.134608 11719 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.259364 11657 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.260926 11649 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:49.261498 11649 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.263624 11649 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.151500 11717 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.192550 11644 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:49.192312 11646 consensus_queue.cc:1059] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:49.265215 11644 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.240535  8901 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:49.265926 11646 raft_consensus.cc:3055] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.266363 11646 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:49.266921  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.267377 11644 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.267217 11646 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.267963 11644 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:49.189446 11729 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.149381 11610 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.271054 11638 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.268558  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.185204 11663 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.134964 11509 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.189241 11656 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.273571  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.188824 11467 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.208711  8752 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:49.275241  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.275995  8752 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:49.272187 11713 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.278761  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:49.285738  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.286712  8752 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:49.287894  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.268543 11646 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.325078  8726 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.332175  8756 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:49.333851  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.190236 11606 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:49.334515  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.291080  8907 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:49.291630  8752 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:49.293802  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.343192  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.344138  8906 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
W20260709 12:10:49.343688  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.367394  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.333952 11713 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:49.374661  8906 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.374688  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.381011  8906 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.340250 11635 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.391673  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.392697  9521 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.297149  9517 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
W20260709 12:10:49.395866 11735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:49.394352 11606 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.282860 11555 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.423936  8907 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.295156 11267 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.368736 11591 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.448329  8907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:10:49.449297  8907 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.450270  8907 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.421878 11656 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.453497  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.406945 11713 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:49.459429  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 266135us
I20260709 12:10:49.460426  9525 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.464385  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:49.439731  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.474833 11693 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.476593 11604 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.445995 11555 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.482491  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:49.484429  8900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2149) took 1946 ms (client timeout 2126 ms). Trace:
W20260709 12:10:49.492425  8900 rpcz_store.cc:269] 0709 12:10:47.538461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.542565 (+  4104us) service_pool.cc:224] Handling call
0709 12:10:49.482907 (+1940342us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540019d054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:49.484352 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831593856}
I20260709 12:10:49.494055  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.451567 11456 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.486827  9519 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:49.462960 11786 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.456883 11202 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:49.489080 11657 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.485792 11636 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:49.510334  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.503669  8907 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.529006 11636 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.530092  8905 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.530652  8907 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.463078 11656 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.532081 11636 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.467533 11713 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.489796 11663 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:49.517788 11674 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.519053  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:49.519553  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.520664 11202 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:49.525172  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.514235 11786 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.511230 11456 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:49.537094 11775 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.690s	user 0.004s	sys 0.001s
I20260709 12:10:49.517247 11787 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.580109 11713 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.585953 11786 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:49.586875 11705 consensus_meta.cc:287] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.002s
I20260709 12:10:49.576695 11674 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.587347 11705 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.589982 11456 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.582792 11657 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:49.591948 11657 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.593097  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 599) took 1351 ms. Trace:
I20260709 12:10:49.584233  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.540840  8900 raft_consensus.cc:2410] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:49.533562 11656 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:49.517861 11783 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:49.490162 11693 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.573351  9519 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.507893 11604 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:49.602684 11604 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.603087 11604 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:49.603197  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.603900 11604 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.578163  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:49.578473  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:49.578804  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:49.579113  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.583499  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:49.593580  8753 rpcz_store.cc:276] 0709 12:10:48.242232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.308970 (+ 66738us) service_pool.cc:224] Handling call
0709 12:10:48.309365 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.316095 (+  6730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.316127 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.746630 (+430503us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b2c000014c8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:10:48.747133 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.820587 (+ 73454us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.820664 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.820753 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.536328 (+715575us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:49.592760 (+ 56432us) raft_consensus.cc:1685] finished
0709 12:10:49.592796 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.593023 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6185,"raft.queue_time_us":6286,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":4509,"spinlock_wait_cycles":8883328,"thread_start_us":73104,"threads_started":1,"wal-append.queue_time_us":99738}
W20260709 12:10:49.601133  8872 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.654s (SENT) [suppressed 16 similar messages]
I20260709 12:10:49.607542  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.584163 11787 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.514801 11789 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.608520  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.613349  8753 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.613628  8834 raft_consensus.cc:2393] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:49.606839  8833 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:49.573458 11791 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:49.591325 11790 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:49.609995  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.609004  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.619313  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.619490  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.622100  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:49.617116  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:49.627699  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.618852 11674 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.626353  8753 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:49.626403  8834 raft_consensus.cc:3055] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:49.635813  8834 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.635119  8833 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:49.638381  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.639134  8832 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:49.616041 11789 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.644909  9519 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:49.625962 11456 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.648377  8801 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:49.637876  8834 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.650815  8834 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:49.636533 11713 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.644304  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.657063 11591 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.663699  9516 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:49.664876 11657 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.626811 11791 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.665666  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.667317  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.667739 11791 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.668217  8755 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:49.653880  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.659446  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:49.670106  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:49.670414  9519 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.670768  8909 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.653609 11786 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:49.675396  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:49.655783 11713 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:49.684131  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.660058 11705 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.685706  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1974) took 1056 ms. Trace:
I20260709 12:10:49.690552  8826 rpcz_store.cc:276] 0709 12:10:48.629553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.664917 (+ 35364us) service_pool.cc:224] Handling call
0709 12:10:48.715021 (+ 50104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.815105 (+100084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.815234 (+   129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.815286 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.815327 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.685488 (+870161us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b540037b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:49.685531 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.685642 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229723904}
I20260709 12:10:49.693638  8834 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:49.693796  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1774) took 1293 ms. Trace:
I20260709 12:10:49.665681 11267 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.694375  8759 rpcz_store.cc:276] 0709 12:10:48.400900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.409026 (+  8126us) service_pool.cc:224] Handling call
0709 12:10:48.805166 (+396140us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.805535 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.805562 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.806143 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 12:10:48.931253 (+125110us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.931296 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.931360 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.982504 (+ 51144us) raft_consensus.cc:1685] finished
0709 12:10:48.982546 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.685245 (+702699us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54000f69d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:49.693696 (+  8451us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":346,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8908,"spinlock_wait_cycles":910225152,"thread_start_us":105574,"threads_started":1,"wal-append.queue_time_us":155442}
W20260709 12:10:49.697021  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.697726  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.698510  8759 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.701658  8909 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:49.652877 11719 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.685127 11713 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.685312 11786 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:49.690294  9517 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:49.718410  8826 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:49.689177 11610 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.683167 11789 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:49.739241  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 138140us
W20260709 12:10:49.740443  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.748981  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.743038 11636 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.753213  8826 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.748660 11789 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.759166  8826 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.752560 11202 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.754946 11795 log.cc:927] Time spent T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:10:49.759822  9519 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:49.755259 11787 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.755074 11719 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.756433 11725 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:49.801873 11725 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.768780 11202 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.807945 11202 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.752605 11693 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.793612 11610 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.754395 11636 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.761940 11635 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:49.797219  8753 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.826957 11635 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:49.827713  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:49.828399  8753 raft_consensus.cc:2376] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8. Re-sending same reply.
I20260709 12:10:49.755034 11786 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:49.823439  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:49.829668  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.831769  8753 raft_consensus.cc:2393] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.834327  8759 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.836422  8759 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.839550  8826 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:49.840801 11729 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:49.842839  9488 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:49.845784  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.960525  8753 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:49.966528  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:49.967386  8756 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:49.967868  8752 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:49.970322  8756 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.978325  8751 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:49.986706  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:49.988883  8832 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:49.990195  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.855212  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1784) took 1144 ms. Trace:
I20260709 12:10:50.012187  8908 rpcz_store.cc:276] 0709 12:10:48.711262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.869486 (+158224us) service_pool.cc:224] Handling call
0709 12:10:48.869876 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.917197 (+ 47321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.854997 (+937800us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400115b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:49.855160 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27320064}
I20260709 12:10:49.875680  9489 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:49.875624  9520 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:50.017086  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 141323us
I20260709 12:10:49.885684 11509 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.848863 11618 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:50.035423 11618 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:49.900898 11623 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:49.849659 11725 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.849443 11635 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:49.852033 11636 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:49.906224 11651 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.040311 11750 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.041580 11750 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.042817 11651 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.842132 11763 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:10:50.045753  8875 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:50.046270 11763 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.046766 11763 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:50.047529  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:49.837116 11267 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:50.049698 11267 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:50.049860  8829 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:50.051245 11638 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:49.884372 11231 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.908833 11604 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.052695  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:50.054803  8826 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.055068  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:49.879277 11713 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.010792  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:50.018276  8799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.015s	sys 0.028s
I20260709 12:10:50.023989 11572 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.025327 11723 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.033721 11646 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.056113  8901 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:50.051440  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.046784  8830 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.061805 11786 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.068254  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 82139.4us
I20260709 12:10:50.051783 11267 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:50.064443  8799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.015s	sys 0.029s
I20260709 12:10:50.077464  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.080267 11636 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:50.081398 11636 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.085318 11636 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:50.086601 11750 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:50.089043 11745 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:50.090230 11745 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.091017 11710 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.092018 11710 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.060339 11572 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.095249 11710 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.049698 11467 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:50.103058 11509 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.109203 11641 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:50.111796 11572 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.114411  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.114948 11786 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.112524 11646 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.116845  8827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1962) took 2144 ms (client timeout 1897 ms). Trace:
I20260709 12:10:50.116261  8801 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.065070  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:50.096225  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.096259 11623 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.095119 11649 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:50.125566  8832 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
W20260709 12:10:50.103856  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 111373us
W20260709 12:10:50.122548  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 1.0816e+06us
I20260709 12:10:50.099198 11713 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:50.125921  8827 rpcz_store.cc:269] 0709 12:10:47.971902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.973723 (+  1821us) service_pool.cc:224] Handling call
0709 12:10:50.116393 (+2142670us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400324954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:50.116581 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638710016}
I20260709 12:10:49.681033  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:50.136032 11509 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:50.127912 11623 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.123040  8724 leader_election.cc:336] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.126s (SENT)
I20260709 12:10:50.160177 11786 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.161054  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.161152  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:50.162429  8900 raft_consensus.cc:2410] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:50.136322 11467 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:50.164999 11729 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.169737  8874 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.171679 11725 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.173166 11509 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.174170  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.174928  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.176542  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.176879  9523 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.177214  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:50.177343  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.179376 11649 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.180161 11509 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.182089 11649 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.181981 11646 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.184954  8831 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:50.185966 11467 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.187515 11745 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.193171 11750 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:50.192878 11618 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.194602  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.193588 11750 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.196163 11750 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:50.192880  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 76845.4us
I20260709 12:10:50.197217  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.197891  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.199779 11789 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.200392 11789 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:50.201133  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.201853 11789 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.203943  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.204877  9516 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:50.207139 11717 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.188400  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.212952 11713 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.218988  8901 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.172191  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.221778 11723 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.223461  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51415.7us
I20260709 12:10:50.225179  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.189332  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.228394  8830 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:50.121981 11763 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:50.227118  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.212284  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 158521us
I20260709 12:10:50.236675  9523 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:50.151541 11623 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.232610 11646 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:50.281551  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 92807.8us
I20260709 12:10:50.284817  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.284358  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:50.301385  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 90714.8us
I20260709 12:10:50.301952  8826 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:50.303117 11649 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:50.304569  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.305831  8801 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.306783 11745 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.307461 11745 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.308593 11725 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.312135  8830 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:50.280315 11636 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.334057 11719 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:10:50.341198  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.342605 11791 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.343684 11791 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.346823  8872 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.348006 11725 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.276795 11723 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:10:50.315740 11745 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:50.320075 11786 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.353647 11786 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.354151 11786 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.357568  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.360345 11745 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.360916 11745 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:50.361392 11745 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.364167  8760 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:50.365073 11655 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.365629 11655 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.366057  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1796) took 1156 ms. Trace:
I20260709 12:10:50.366501  8760 rpcz_store.cc:276] 0709 12:10:49.209803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.230390 (+ 20587us) service_pool.cc:224] Handling call
0709 12:10:50.365786 (+1135396us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540008b1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:50.365972 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604571904}
I20260709 12:10:50.352746  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:50.291741 11713 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.290426 11638 consensus_queue.cc:1059] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:10:50.379565 11572 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.380112 11572 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:50.381379 11572 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.382928 11572 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.375289 11791 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:50.352887  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.388589  8834 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:50.395398 11655 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.324993 11636 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.278399 11729 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:10:50.403875  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.412410  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.403337 11636 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.410555  8724 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:50.432093  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 129749us
W20260709 12:10:50.441352  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55199.9us
W20260709 12:10:50.443655  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53047.1us
I20260709 12:10:50.445218  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:50.446280  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 77413.3us
I20260709 12:10:50.432029 11655 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:50.434429 11638 raft_consensus.cc:3055] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.452657 11729 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.453305 11638 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:50.453457 11655 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.454738 11638 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.455158 11729 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:50.469925  8828 raft_consensus.cc:2410] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:10:50.470243  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 43934us
I20260709 12:10:50.438149 11713 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.471313  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:50.473155 11713 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.477434 11636 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.478598 11635 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.480516 11636 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:50.489332 11636 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.489920 11509 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.489961 11636 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.490927 11636 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.490998 11509 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:50.509596  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:50.499790 11638 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.514860 11509 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.520258 11231 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.524952  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1796) took 1072 ms. Trace:
I20260709 12:10:50.492667 11750 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.554122  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.558439  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.559542  8827 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:50.559675  8755 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:50.562992  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.525547  8759 rpcz_store.cc:276] 0709 12:10:49.342191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.837216 (+495025us) service_pool.cc:224] Handling call
0709 12:10:49.837654 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.838095 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.838126 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.838664 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.020120 (+181456us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b1800448360. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:10:50.135847 (+115727us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.147036 (+ 11189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.163063 (+ 16027us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.375845 (+212782us) raft_consensus.cc:1685] finished
0709 12:10:50.375911 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.414120 (+ 38209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":545,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3268,"spinlock_wait_cycles":20917504,"thread_start_us":98468,"threads_started":1,"wal-append.queue_time_us":440943}
I20260709 12:10:50.566072  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.567106  8829 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:50.566959  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 95902.5us
W20260709 12:10:50.576304  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 145015us
I20260709 12:10:50.579953  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.584039  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:50.591240  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 265316us
I20260709 12:10:50.558444 11651 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.569479 11655 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.601181  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.614378  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:50.597314 11651 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.619685  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:50.618752  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.616212  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 156201us
W20260709 12:10:50.625555  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.616158  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 157327us
I20260709 12:10:50.633767  8831 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:50.613886  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:50.635456  8832 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:50.645315  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.647357  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 78199.2us
I20260709 12:10:50.633502 11651 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.651310  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:50.652364  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.662993  8724 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:50.668548  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.673205  8752 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:50.664197  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:50.674338  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 229334us
W20260709 12:10:50.684401  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.677985  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.686489  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.707481  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:50.685779  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:50.708285  8751 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:50.710052  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:50.716748  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 67596.8us
I20260709 12:10:50.713058  8829 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:50.650780 11745 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.732266  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:50.729604  8831 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:50.729921  8832 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:50.661130 11604 consensus_queue.cc:1059] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 12:10:50.743723  8835 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:50.740891  8758 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:50.747833  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:50.726994 11826 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.764955  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.745921 11509 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:50.742650 11750 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:50.773222  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 86626.3us
I20260709 12:10:50.772872 11826 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:50.774358 11817 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:10:50.779872  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 162809us
W20260709 12:10:50.789302  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.789687 11826 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:50.789958  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1803) took 1115 ms. Trace:
I20260709 12:10:50.792058  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:50.819640  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:50.820773 11832 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.821578 11832 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:50.822044 11745 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:50.824426  8828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2018) took 1214 ms. Trace:
I20260709 12:10:50.813019  8755 rpcz_store.cc:276] 0709 12:10:49.674333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.683844 (+  9511us) service_pool.cc:224] Handling call
0709 12:10:50.771439 (+1087595us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54001a27d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:50.789869 (+ 18430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881292672}
W20260709 12:10:50.833580  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61149.9us
I20260709 12:10:50.830027  8828 rpcz_store.cc:276] 0709 12:10:49.578278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.578553 (+   275us) service_pool.cc:224] Handling call
0709 12:10:50.766110 (+1187557us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000d93d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:50.792138 (+ 26028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891203968}
I20260709 12:10:50.845541  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:50.882496  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 133899us
I20260709 12:10:50.829195 11713 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.789660 11825 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.774412 11786 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:50.833061 11604 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:50.943186  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:50.955245  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 298316us
W20260709 12:10:50.966216  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 136220us
I20260709 12:10:50.967937  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:50.970101  8758 raft_consensus.cc:3055] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:50.971479  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 128689us
I20260709 12:10:50.970527  8758 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:50.943826 11717 raft_consensus.cc:2764] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:50.973508  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 128082us
I20260709 12:10:50.943928 11713 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:50.984371 11832 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:50.986313  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 269634us
I20260709 12:10:51.010455  9523 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:51.015863  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:51.026938  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 92779.1us
W20260709 12:10:51.034817  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71671.1us
I20260709 12:10:50.990721 11713 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.041935 11838 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:51.044822 11829 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.046814 11847 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.047508 11847 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:51.042371 11835 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:51.049500  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:51.067152 11840 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.067942 11840 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:51.068964 11641 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.069756 11641 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.070253 11641 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.070379  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 90824.7us
I20260709 12:10:51.039031 11604 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.049858 11725 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:51.084426  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45098us
W20260709 12:10:51.081601 11572 consensus_meta.cc:287] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.010s
I20260709 12:10:51.095441  9523 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:50.989921 11825 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:51.091823 11638 consensus_meta.cc:287] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 12:10:51.102569  8758 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.069150 11840 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.086745 11604 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.086889 11725 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:51.101604  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 133944us
I20260709 12:10:51.136653  8758 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.136823 11842 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:10:51.118518 11604 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.141502  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 69523.8us
W20260709 12:10:51.144861  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60452.9us
I20260709 12:10:51.149240  9525 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:10:51.122117 11725 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.135699 11623 consensus_meta.cc:287] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.000s
I20260709 12:10:51.155047  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.160458  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.161497  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:51.163131 11846 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.163640 11846 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.164016 11846 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.165990  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:51.167587  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:51.134054 11618 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.179354  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:51.176842 11623 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.201596 11623 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.205860 11849 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.206707 11849 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:51.207396 11849 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.207741 11849 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.208119 11849 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.184012 11668 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.215433 11833 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.217658 11833 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.209494  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:51.220978  8758 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:51.222869 11668 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.225322 11763 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.225695 11668 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.226891 11847 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:51.275184 11655 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:51.263643 11845 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.235883 11833 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.249676  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2017) took 1671 ms (client timeout 1805 ms). Trace:
I20260709 12:10:51.236982 11467 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:51.281356  8835 rpcz_store.cc:269] 0709 12:10:49.577990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.578253 (+   263us) service_pool.cc:224] Handling call
0709 12:10:51.249320 (+1671067us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400388bd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:51.249576 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443219840}
I20260709 12:10:51.228354 11641 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.282959 11845 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.243119 11723 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:10:51.287916  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 116608us
I20260709 12:10:51.284485 11641 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.281497 11719 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.289810 11649 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:51.285467 11845 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:51.286420  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.286742 11825 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.232429 11856 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.287233 11829 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.299701 11829 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.257915  8755 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.305109 11856 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.307608 11856 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:51.215963 11618 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:51.309084  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.308238 11846 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.310699 11618 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.312582 11846 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.281579 11467 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.317201 11467 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.328049 11841 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 12:10:51.329265 11618 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.329866 11618 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:51.220731 11636 consensus_meta.cc:287] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.003s
I20260709 12:10:51.332190 11636 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:51.228849 11651 consensus_meta.cc:287] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.005s
I20260709 12:10:51.336755 11651 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.338215  8830 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:51.298571 11713 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.355232 11725 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:51.356750  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 64788.6us
I20260709 12:10:51.357712  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:51.357985 11725 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:51.358515 11845 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.360680  8799 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:51.373394 11713 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.378410 11786 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.381141  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 519) took 1175 ms. Trace:
I20260709 12:10:51.381646  8903 rpcz_store.cc:276] 0709 12:10:50.206064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.256661 (+ 50597us) service_pool.cc:224] Handling call
0709 12:10:50.285651 (+ 28990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.355335 (+ 69684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.355375 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.721794 (+366419us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b2c000a6578. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:10:50.751001 (+ 29207us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.913135 (+162134us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.913178 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.913277 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.162820 (+249543us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b1800382e40. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:10:51.327233 (+164413us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:51.380743 (+ 53510us) raft_consensus.cc:1685] finished
0709 12:10:51.380767 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.380928 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20884,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"spinlock_wait_cycles":96720000,"thread_start_us":136092,"threads_started":1,"wal-append.queue_time_us":345599}
I20260709 12:10:51.384068  8658 catalog_manager.cc:5697] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.362968 11833 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.361717  9520 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:51.366403 11618 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.370271 11845 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.393172 11845 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:51.370829  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.385720 11636 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:51.392423 11833 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.391346  8658 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 8, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:51.394575  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 321128us
I20260709 12:10:51.363430 11829 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.369905 11604 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.424057  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:51.425434  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:51.412420 11649 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.428233 11649 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.428730 11649 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.433786  8658 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:51.435263  8658 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 6, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.437544 11509 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.427047  8904 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:51.438862  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:51.471537  8901 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
W20260709 12:10:51.471316  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 310928us
I20260709 12:10:51.438123 11509 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:51.472489  8908 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:51.488770  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:51.489972  8830 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:51.492218  8755 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.493104  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:51.441615 11826 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.495865  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:51.497933  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 137355us
I20260709 12:10:51.426153 11786 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:51.431974 11849 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.504261  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:51.511052  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 383993us
I20260709 12:10:51.508822  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:51.503965  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 336460us
I20260709 12:10:51.496188 11713 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.494562 11846 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.513980  8724 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:51.512558  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:51.519341  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 314215us
I20260709 12:10:51.513733  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:51.516616  8658 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:10:51.522966  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:51.520620  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:51.525476  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:51.508066 11789 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.576330  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:51.577384  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.542725  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:51.581043  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.581738  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:51.579577  8835 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:51.578816  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:51.583848  8832 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.586745  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58443.5us
I20260709 12:10:51.595988  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:51.595072  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 615) took 1047 ms. Trace:
W20260709 12:10:51.607039  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 81620.8us
I20260709 12:10:51.514294 11833 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:51.608100  8829 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:51.609308  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:51.604383  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35686 (request call id 561) took 1413 ms. Trace:
I20260709 12:10:51.596652  8658 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 3, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:10:51.613737  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 92213.3us
I20260709 12:10:51.594465 11267 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.529407 11713 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.524950 11825 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:10:51.519450 11826 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.596863  8760 rpcz_store.cc:276] 0709 12:10:50.547715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.547905 (+   190us) service_pool.cc:224] Handling call
0709 12:10:50.588364 (+ 40459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.636019 (+ 47655us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:51.270276 (+634257us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b1800433d20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3bb3b3c7 00007fce3814d9a7 00007fce3815d0bf
0709 12:10:51.270519 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.594636 (+324117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.594694 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:51.594741 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.594874 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.595005 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11276,"prepare.queue_time_us":25331,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":11434,"spinlock_wait_cycles":5273344,"thread_start_us":386258,"threads_started":2}
I20260709 12:10:51.573751 11725 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:10:51.624678  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.613217  8801 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:51.672868  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.676215  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 65160.8us
W20260709 12:10:51.624655  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 102553us
I20260709 12:10:51.677510  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:51.623059  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.596378 11231 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.685542  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.585466 11763 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.611029 11535 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:51.692142  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 96257.4us
W20260709 12:10:51.688551  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 174637us
I20260709 12:10:51.575886 11846 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.606719 11618 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.695616  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:51.695643  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 117826us
I20260709 12:10:51.616354 11641 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.615024 11840 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.621016 11849 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.623081 11819 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.704873 11852 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:51.702121  8835 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
W20260709 12:10:51.707803  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 94680.8us
I20260709 12:10:51.618808 11829 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.684554 11668 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.691699 11535 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.727739  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:51.728648  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 114243us
I20260709 12:10:51.712371 11717 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.614632 11789 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.690848 11763 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.686345 11267 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.739085 11535 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:51.748732  8657 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 231) took 19612 ms (client timeout 15000 ms). Trace:
I20260709 12:10:51.749984 11651 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.615207  9520 rpcz_store.cc:276] 0709 12:10:50.175101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.176762 (+  1661us) service_pool.cc:224] Handling call
0709 12:10:51.588473 (+1411711us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400501754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:51.588627 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704908416}
I20260709 12:10:51.711725 11840 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.723157 11819 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.708942 11641 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.714207 11623 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:51.685395 11467 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.738853 11717 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.747921 11745 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.748364  8901 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.743412  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:51.614444 11509 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.754719  8904 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:51.763257 11851 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.773053  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:51.754009 11763 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.752686 11267 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.758576 11819 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.785878  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 77500.4us
I20260709 12:10:51.785935  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:51.756412 11604 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.752877 11840 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.760686 11845 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.762737 11725 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.760593 11641 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.761233 11849 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.778185 11717 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:51.800345  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.801373  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 58044.7us
I20260709 12:10:51.778548 11745 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:51.808737  8874 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:51.755865 11668 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.814803  9521 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:51.817268 11865 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.817164 11666 consensus_queue.cc:1059] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:10:51.818145 11865 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.819677 11666 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.820086 11666 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:51.821105 11862 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:10:51.823241 11863 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.823769 11863 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.812981 11725 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.824812 11849 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.825884 11863 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.827155 11725 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:51.827584 11867 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:51.828766 11853 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.829352 11853 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.831391 11853 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:51.832988  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 95015.1us
I20260709 12:10:51.836724 11636 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.837216 11636 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.837311 11826 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:51.837633 11636 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.840711 11845 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.841339 11845 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.843629 11845 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.794196 11786 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.844532 11851 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.852849  9520 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:51.862491  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.863898  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.863943 11870 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:10:51.855803 11641 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.865885 11231 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:51.866443 11231 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.866850 11641 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:51.864344  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.867583  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.868124 11791 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.868598 11791 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.869102 11713 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.870600 11791 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.871655 11791 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.872265 11791 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.850121 11829 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.873648 11829 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:51.874158 11829 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.874522 11791 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.875488 11791 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.875976 11791 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:51.845265  8874 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:51.878127 11467 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.878497  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.878875 11467 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.879347 11467 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:51.848623  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1999) took 1298 ms. Trace:
I20260709 12:10:51.879767  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:51.880366 11846 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.880717  9520 raft_consensus.cc:606] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:51.813701 11719 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.881466 11719 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.881899 11719 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.879870 11791 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.883153 11489 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:51.884117 11489 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.810140 11623 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:51.898653 11723 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.892524 11623 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.899400 11723 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:51.900432 11723 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.898699 11849 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:51.879905  8826 rpcz_store.cc:276] 0709 12:10:50.549995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.550133 (+   138us) service_pool.cc:224] Handling call
0709 12:10:50.587008 (+ 36875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.347669 (+760661us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b18004583e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3813b060 00007fce3813bbfb 00007fce3814664b
0709 12:10:51.347840 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.347878 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.348524 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.615577 (+267053us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:51.615616 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.615778 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.848138 (+232360us) raft_consensus.cc:1685] finished
0709 12:10:51.848171 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.848496 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83683,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":6304,"spinlock_wait_cycles":18863360,"thread_start_us":346530,"threads_started":2,"wal-append.queue_time_us":428496}
I20260709 12:10:51.914942  9523 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
W20260709 12:10:51.917006  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139380us
W20260709 12:10:51.917163  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 185697us
W20260709 12:10:51.908572  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 226621us
I20260709 12:10:51.933902  8832 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:51.820385 11865 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:51.814596 11745 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.879781 11467 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.951110  8830 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.892472 11509 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.953742  8801 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:51.893385 11847 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.957710  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 63059.1us
I20260709 12:10:51.957365 11666 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:51.958982 11666 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.960808 11836 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:10:51.963671 11586 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.964253 11586 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:51.749230  8657 rpcz_store.cc:269] 0709 12:10:31.965661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.965918 (+   257us) service_pool.cc:224] Handling call
0709 12:10:51.529297 (+19563379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:48.212081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:48.291661 (+ 79580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:48.291722 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:48.291748 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:48.382561 (+ 90813us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:48.382653 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:48.382691 (+    38us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:10:48.384071 (+  1380us) tablet.cc:701] Row locks acquired
0709 12:10:48.384113 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:10:48.384315 (+   202us) write_op.cc:270] Start()
0709 12:10:48.384496 (+   181us) write_op.cc:276] Timestamp: P: 1783599048384244 usec, L: 0
0709 12:10:48.384521 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:48.430035 (+ 45514us) log.cc:844] Serialized 5586 byte log entry
0709 12:10:48.746182 (+316147us) op_driver.cc:464] REPLICATION: finished
0709 12:10:48.826751 (+ 80569us) write_op.cc:301] APPLY: starting
0709 12:10:48.826859 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:48.827180 (+   321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:48.827311 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:48.829292 (+  1981us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:48.829638 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:10:48.829686 (+    48us) write_op.cc:312] APPLY: finished
0709 12:10:48.830128 (+   442us) log.cc:844] Serialized 101 byte log entry
0709 12:10:48.832643 (+  2515us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:48.832828 (+   185us) write_op.cc:454] Released schema lock
0709 12:10:48.832911 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:48.833343 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:48.833374 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10489,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":74659,"apply.run_cpu_time_us":4398,"apply.run_wall_time_us":6619,"num_ops":14,"prepare.queue_time_us":539403,"prepare.run_cpu_time_us":22279,"prepare.run_wall_time_us":333275,"raft.queue_time_us":134894,"raft.run_cpu_time_us":12640,"raft.run_wall_time_us":91355,"replication_time_us":339850,"thread_start_us":515593,"threads_started":4,"wal-append.queue_time_us":145449,"wal-append.run_cpu_time_us":37581,"wal-append.run_wall_time_us":1255351}]]}
I20260709 12:10:51.965843  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.970325  8832 raft_consensus.cc:2393] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:51.972332  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.921556 11572 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:51.980000  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 181992us
I20260709 12:10:51.985381  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:51.872525 11649 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:51.981248  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 62785.1us
I20260709 12:10:51.993326  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:51.978978 11847 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.001741  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:51.993598  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.003612  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.003975  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.004683  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.005312  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:52.006146  8827 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.006120  8830 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:52.013715  8826 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.010365  8755 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 3: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:52.010751  8760 raft_consensus.cc:2393] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:51.935662 11786 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.000842 11863 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:52.041018  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.041538  8758 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:52.034965  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.009552  8751 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.036612  8828 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.042464  8752 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:52.043834  8752 pending_rounds.cc:85] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 6
I20260709 12:10:51.988953 11836 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.047469  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:52.049574  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61650.8us
I20260709 12:10:51.955875 11791 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:10:52.056529  8753 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:52.054847  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.053213  8754 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:52.052699  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.059639  8756 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 3.
I20260709 12:10:52.060825  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:52.061460  9523 raft_consensus.cc:2376] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7. Re-sending same reply.
I20260709 12:10:52.060460  8827 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:52.044176  8752 pending_rounds.cc:107] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:52.064994  8752 raft_consensus.cc:2889] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.067843  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.070863  8901 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:52.074759  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.075479  8758 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.043447 11825 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.079941  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.041010 11862 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:52.009675 11838 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:52.009829 11729 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:52.085688  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.086530  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.094054  8908 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:52.082693 11846 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:52.090577  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.096176  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.032757 11572 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.060462 11836 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:52.107261  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.106474  8901 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:52.106452  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.107650  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.107126  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.113762  8900 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:52.084254 11713 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:52.123509  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.126539  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.078958 11865 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.128073 11865 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:52.091332 11849 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:52.062281 11863 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.132035  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.107728 11857 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.139436 11668 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.140996  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.096361 11856 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:52.142442 11649 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.149487  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.143762  8903 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:52.092336 11825 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.146925  8758 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:52.132267 11789 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.153218  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.154402  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.158066  8835 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
W20260709 12:10:52.147819  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 92821.4us
I20260709 12:10:52.157092  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.163359  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.108229 11846 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.132864 11881 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.165813  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.166574  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.142829 11535 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.175539  8755 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:10:52.178344 11866 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.178665 11858 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:10:52.179605 11877 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.180959 11863 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:52.182111 11882 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:52.151182 11857 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.186141 11572 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.187777 11786 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.121213 11875 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.209s
I20260709 12:10:52.189002 11836 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.191241  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.191748  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.192752 11825 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.193224  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.111522 11862 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.219115  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.150206 11713 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:52.275794  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 84172.8us
I20260709 12:10:52.276654  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.219767  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.164988 11849 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.194191 11881 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.225332  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.226816  8826 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:52.238056  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.241736  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.281613  8757 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:52.134769 11267 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.187983 11717 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.247869  9525 raft_consensus.cc:2393] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:52.248281  8828 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:52.248737  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.250648  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:52.251662  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.308933  8908 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.217185 11668 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:52.253037  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.223975 11763 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.158550 11856 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.224360 11745 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:52.264199 11885 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
W20260709 12:10:52.264778  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.231439 11866 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.269246 11535 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.325345  8758 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:52.326601  8832 raft_consensus.cc:2368] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:52.234678 11878 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.270712  8756 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:52.242134 11865 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.286788  8907 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:52.287942  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.288331 11846 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.288607  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.334317  8830 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:52.290313  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.332549  8905 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:52.337949  8760 raft_consensus.cc:2393] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:52.290825 11267 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.291431  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.292120  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.294098 11862 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.294658 11489 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.297344  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.307386  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.308969  8901 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.299270  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.322598  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.341053  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.341724  8903 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.344796  8900 raft_consensus.cc:2393] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:52.218076 11586 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.314958 11668 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.345853 11668 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.348883  8755 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:10:52.350291  8754 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:52.351661 11896 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:10:52.351749 11231 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.354347 11231 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.339498  8909 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:52.355007  9519 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.333515  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.356068  8902 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:52.356282 11864 consensus_queue.cc:1059] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:52.357245 11857 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.360404 11713 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.361166 11713 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.362004 11866 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.364337  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.364514  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.365937  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:52.373234 11636 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 12:10:52.373739 11636 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.375916  8752 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:52.376147 11636 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.377148  8904 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:52.377477 11646 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.377985 11646 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:52.378886 11646 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.380054 11849 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.382284 11745 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.383934  8755 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:52.386126  8902 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:52.389124 11856 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.315753 11729 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:52.389886  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.388083  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.329398 11847 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.391124  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.334036 11878 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.245160 11877 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:52.360553  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61366.6us
I20260709 12:10:52.394080  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.394554 11878 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.395249 11877 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.395427  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.316509 11572 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.395957 11572 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.396323 11572 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.397882  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:52.400655 11819 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 12:10:52.401086 11819 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.403277 11819 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.403985 11847 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.404645 11860 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.405194 11860 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.405435 11666 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.389261  8909 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.406302 11666 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:52.406843 11719 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.001s
I20260709 12:10:52.407274 11719 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.405542 11847 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.407603 11666 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.410051  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.410674 11849 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.411346 11849 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.411734 11849 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.318853 11863 raft_consensus.cc:2764] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:52.415808 11878 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.416076  8908 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:52.418864  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.422853 11717 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.391124  8902 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.428067  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.392474  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.430297  8900 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.438130  8907 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:52.436916  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.442898  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.446998  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.453243  8835 raft_consensus.cc:2410] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:52.453151  8903 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:52.457397  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.463339  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.464257  8908 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
W20260709 12:10:52.488534  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.424443 11857 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.495222  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.495633  8901 raft_consensus.cc:2410] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:52.380087 11646 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:52.497090  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60262.3us
I20260709 12:10:52.498889  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.502575  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.510020  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.512933  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.505970  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.507925  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.437743 11863 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.511976  8724 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.520756  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.500983 11857 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:52.522804  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.523051  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.521992 11231 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.523191 11857 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.524029 11231 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.524525 11231 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:52.525489 11840 consensus_meta.cc:287] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.005s
I20260709 12:10:52.526043 11840 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.523564  8835 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:52.498905 11819 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:52.529088  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.530045 11819 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.530462 11819 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:52.531363 11819 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:52.532433  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.532683 11819 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.534421 11231 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.536604 11231 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.538134  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.539515 11840 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.541065  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:52.545368 11467 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.009s
I20260709 12:10:52.548161  8904 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.551165  8828 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:52.554641  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.555554  8909 raft_consensus.cc:2410] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:52.547114  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.558727  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.561017  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.553632  8900 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:52.567287  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:52.547196 11829 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 12:10:52.505424 11847 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.569733  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.568717  8755 raft_consensus.cc:2368] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:52.570360  8908 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:52.571425  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.571875  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.569775  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.554126 11467 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.576036 11604 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.576761  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.577814  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.620769  8751 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:52.580322 11763 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.588702 11888 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:10:52.514160 11509 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.596266 11863 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:52.500016 11877 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:52.601498  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.614343  8902 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:52.557122 11878 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:52.618837  8757 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:52.621318  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 58656.6us
I20260709 12:10:52.621454  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.568209 11655 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:52.628943  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.640683  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.641290  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.629863  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.643078  8826 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.634078  8905 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:52.618722 11847 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.650698  8904 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.651940  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.622910 11604 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.625463 11231 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.568050 11489 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:10:52.660131  8752 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.618582 11829 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.638643 11878 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.672201  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:52.675763  8901 raft_consensus.cc:606] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:52.676290  8901 raft_consensus.cc:614] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.648366 11719 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.655668 11847 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.680510  8826 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:52.660211 11604 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.690385  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 426636us
W20260709 12:10:52.692996  8874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.019s	sys 0.040s
W20260709 12:10:52.694463  8874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.019s	sys 0.040s
I20260709 12:10:52.640026 11509 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.694679  9516 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:52.702169  8726 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.712544  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.712787  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.673627 11231 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:52.680451 11878 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:52.718847  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.723706  8826 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.724833  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.725102  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.742141  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:52.744836  8759 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:52.729854  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:52.657709 11877 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.733345  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.749131  8833 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:52.746289  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:52.747756  8832 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:52.753600  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:10:52.754155  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.757512  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.673583 11572 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.711989 11865 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.763337  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:52.767017  8830 raft_consensus.cc:2368] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:52.768723  8752 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:52.769466  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:52.785594  8906 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:52.786499 11897 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:10:52.788369  8751 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.760648 11838 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:52.799322  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 228578us
I20260709 12:10:52.820204  8724 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.804656  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.800683  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:52.805949  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:52.812646  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.798749  9519 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:52.820824  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.824707  9516 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:52.807982  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:52.817138  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.822021  8724 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.834457  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.837126  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.748427 11840 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:52.760345 11856 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.761804 11846 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.847208  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.847290  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:52.848745  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:52.841230  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:52.839392  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.850225  8908 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:52.851099  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.851647  8908 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.853981  9519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
W20260709 12:10:52.799909 11895 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:10:52.856026  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:52.885862  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.886888  8907 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:52.887751  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:52.856923 11655 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.889421 11655 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:52.889845 11655 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.834470 11865 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.892369 11586 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.856092 11866 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.888337  8907 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:52.859280 11467 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.859788 11846 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.856834 11719 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:52.895123 11719 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.861572 11713 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.863966 11231 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.866206 11875 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.818452 11860 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.868839 11509 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.872820  8725 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:52.873183  8756 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:52.801023  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.801899 11890 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.762086 11863 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.876861 11877 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.878088 11849 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:52.880518 11572 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:52.856767 11535 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:52.881699  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 128163us
I20260709 12:10:52.881778 11829 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:52.854815  9519 raft_consensus.cc:606] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:52.893555 11866 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:52.858073  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:52.904022  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 54427.7us
I20260709 12:10:52.906826  8757 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:10:52.910113  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 468732us
I20260709 12:10:52.799346 11838 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:52.911345 11586 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:52.896313 11846 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:52.920059  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.990288  8908 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:52.794217 11668 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:52.961423 11890 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:53.005524  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.035339  9525 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:53.042027  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.045919  8907 raft_consensus.cc:2410] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:52.985109 11866 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.060154  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.020982 11509 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.021413 11875 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:10:53.072145  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.984493  9517 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:53.074646  9521 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:53.069087 11646 consensus_meta.cc:287] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 12:10:53.077427 11586 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.024926 11836 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.083071  9487 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.080221  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.089285  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:53.084419  8726 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:53.092545  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:53.094062  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:53.095368  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:53.046545  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:53.101343  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.102490  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:53.102159  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:52.912190 11763 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
W20260709 12:10:53.071856 11880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.007s	sys 0.021s
I20260709 12:10:53.100349 11838 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.117473 11572 consensus_queue.cc:1059] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:53.118454 11572 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.118775 11572 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.119081 11572 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.088405 11509 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.120909 11655 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.123117 11509 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:53.123616 11655 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:53.123677 11890 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.105331 11489 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:10:53.127724 11604 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:53.091776 11846 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:53.106724 11860 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:53.129261 11846 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.129971  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.130692  8906 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:53.131553  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.131801  8874 leader_election.cc:400] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:53.132113  8906 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:10:53.132601 11890 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.135957 11604 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:53.136842  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:53.137007 11719 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:53.137467  8828 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.140061  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:10:53.129972 11860 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:53.142740 11857 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.143122 11860 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.107620  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.144817  9520 raft_consensus.cc:606] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:53.132133  8874 leader_election.cc:403] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.146901  8874 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:53.147455 11509 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.147969 11829 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.148380 11829 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.148801 11829 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.100287 11836 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.150671  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.151245 11836 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:53.152208  8874 leader_election.cc:400] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:53.152067 11898 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:53.152757 11635 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.152877  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.152544  8874 leader_election.cc:403] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.162042  8828 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:53.163648  8909 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:53.165978  8726 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:53.145874  9518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 558) took 1374 ms. Trace:
I20260709 12:10:53.087783 11877 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.153985 11635 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:53.199981  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47916.7us
I20260709 12:10:53.069646 11840 consensus_queue.cc:1059] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:10:53.108421 11880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.007s	sys 0.022s
I20260709 12:10:53.047005 11467 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:53.204748  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:53.211040  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:53.211396  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:53.215924  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:53.212218  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:53.245409  8827 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:53.246052  8831 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:53.216266  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.201484  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:53.103612 11888 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.246904 11888 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:53.132378 11846 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:53.235908  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 101304us
I20260709 12:10:53.237214  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 576) took 1001 ms. Trace:
I20260709 12:10:53.216997 11635 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:53.238763  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:53.217438 11862 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.124503 11655 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.245184  8828 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:53.247722  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.216988 11604 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:53.259984  8904 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.045s	sys 0.037s
W20260709 12:10:53.393428  8904 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.045s	sys 0.037s
I20260709 12:10:53.291577  9522 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:53.389953  8906 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:10:53.390583  8901 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.022s
I20260709 12:10:53.291232  9523 rpcz_store.cc:276] 0709 12:10:52.235575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.245442 (+  9867us) service_pool.cc:224] Handling call
0709 12:10:52.269093 (+ 23651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.269328 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:52.717463 (+448135us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.236737 (+519274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.236820 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.236883 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.236967 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.237132 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81793,"prepare.queue_time_us":479163,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":94370,"thread_start_us":884680,"threads_started":2}
I20260709 12:10:53.248708 11839 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.394893  8902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.021s	sys 0.012s
W20260709 12:10:53.401422  8901 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.022s
I20260709 12:10:53.415619  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.200143 11856 consensus_queue.cc:1059] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:53.250573 11888 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.415391  8902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.021s	sys 0.012s
I20260709 12:10:53.252818  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:10:53.422919  8724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.012s	sys 0.011s
I20260709 12:10:53.255134 11877 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:53.424753  8724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.013s	sys 0.011s
W20260709 12:10:53.445982  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 598867us
I20260709 12:10:53.420447  8908 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.423527  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:53.397902 11916 raft_consensus.cc:3055] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:53.451800  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 579033us
I20260709 12:10:53.456876  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:53.421707 11865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.023s
I20260709 12:10:53.422842  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:53.445451 11467 raft_consensus.cc:3055] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.445480 11877 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.455154 11916 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:53.481334  8906 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:10:53.475175 11865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.001s	sys 0.023s
I20260709 12:10:53.473605 11509 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8.
I20260709 12:10:53.479552  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.455386 11604 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.498799  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.502902  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:53.469033 11849 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:53.510248  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:53.549541  8755 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.484405 11877 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.550948  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:53.483820 11840 raft_consensus.cc:3055] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:53.476969 11467 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:53.552304  8754 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:53.554570  8903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.017s	sys 0.043s
W20260709 12:10:53.568140  8903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.017s	sys 0.043s
I20260709 12:10:53.478924 11918 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.414764 11875 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.495499 11604 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:53.571064  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2199) took 1116 ms. Trace:
W20260709 12:10:53.578672  8798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.006s
I20260709 12:10:53.577665  8903 rpcz_store.cc:276] 0709 12:10:52.454590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.454752 (+   162us) service_pool.cc:224] Handling call
0709 12:10:52.455140 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.455400 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:53.022961 (+567561us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.570434 (+547473us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.570663 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.570720 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.570785 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.570872 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.570999 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":400481,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":1018426,"threads_started":2}
I20260709 12:10:53.483870 11865 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:53.571108  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.587424  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:53.579037  8798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.015s	sys 0.006s
I20260709 12:10:53.580472  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:53.621876  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 580947us
I20260709 12:10:53.557018 11840 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:53.630995  8906 raft_consensus.cc:2368] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:53.634156  8834 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:53.579694 11604 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.557157 11635 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:53.694375 11717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.024s
W20260709 12:10:53.695456 11908 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
W20260709 12:10:53.701638 11913 log.cc:927] Time spent T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 12:10:53.702677 11920 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:10:53.695502  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.196781  9518 rpcz_store.cc:276] 0709 12:10:51.770986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.802213 (+ 31227us) service_pool.cc:224] Handling call
0709 12:10:51.816898 (+ 14685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.353053 (+536155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.353087 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.353664 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.741535 (+387871us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:52.747857 (+  6322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.145160 (+397303us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400500ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:53.145231 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.145294 (+    63us) raft_consensus.cc:1685] finished
0709 12:10:53.145314 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.145632 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15275,"raft.queue_time_us":34426,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":1059520384,"thread_start_us":342875,"threads_started":1,"wal-append.queue_time_us":473451}
I20260709 12:10:53.705024  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:53.579485 11836 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:10:53.712762 11924 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:53.714154 11649 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.714620 11649 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:53.701361 11717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.024s
I20260709 12:10:53.715515 11649 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:53.717226  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 70412.7us
I20260709 12:10:53.718843  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:53.730597  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:53.733608  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 435812us
I20260709 12:10:53.734508  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:53.586686 11846 consensus_queue.cc:1059] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:10:53.637557 11921 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.689275 11713 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.743876  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:53.617077 11655 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 12:10:53.695115 11910 log.cc:927] Time spent T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:10:53.705293 11586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.003s	sys 0.028s
I20260709 12:10:53.694033 11917 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.759450  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.742903 11763 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:53.755178 11896 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:53.752767 11535 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.757246 11586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.004s	sys 0.028s
I20260709 12:10:53.750191 11717 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.787943  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1795) took 1098 ms. Trace:
I20260709 12:10:53.754789 11635 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.782991  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:53.782222 11847 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 1.068s	user 0.011s	sys 0.003s
I20260709 12:10:53.799115  8757 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:53.754835  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.692411 11467 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.788412  8901 rpcz_store.cc:276] 0709 12:10:52.689084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.786495 (+ 97411us) service_pool.cc:224] Handling call
0709 12:10:52.786887 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.799906 (+ 13019us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:53.416852 (+616946us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.787559 (+370707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.787620 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:53.787667 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.787745 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.787879 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80528,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"thread_start_us":943453,"threads_started":2}
W20260709 12:10:53.807909  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 338161us
W20260709 12:10:53.792870 11912 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:10:53.787660 11717 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.788445 11763 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:53.811833  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.742479 11865 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:53.818472  8753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.015s	sys 0.025s
I20260709 12:10:53.826318  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:53.844172  8753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.016s	sys 0.026s
I20260709 12:10:53.758303 11840 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.809494 11836 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:53.790191 11535 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:53.840112  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 341394us
I20260709 12:10:53.852039 11231 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.805612 11847 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.852811  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:53.856947 11535 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:53.861034 11878 consensus_meta.cc:287] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 1.090s	user 0.010s	sys 0.003s
I20260709 12:10:53.862895  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 632) took 1141 ms. Trace:
I20260709 12:10:53.843467 11717 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.869947  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:53.874301  8757 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:53.863421  8753 rpcz_store.cc:276] 0709 12:10:52.710734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.726551 (+ 15817us) service_pool.cc:224] Handling call
0709 12:10:52.756900 (+ 30349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.757231 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:52.817624 (+ 60393us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.140600 (+322976us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800455560. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce323a 00007fce3814da2a
0709 12:10:53.851719 (+711119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.851792 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.851842 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.851934 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.852061 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60160,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":7050,"spinlock_wait_cycles":24824192,"thread_start_us":668805,"threads_started":1}
I20260709 12:10:53.860399 11839 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:53.890422  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 160032us
I20260709 12:10:53.893090  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:53.893347  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:53.898524  8757 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:53.894354  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:53.904007  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51346.5us
I20260709 12:10:53.906232  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.904374  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:53.908006  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.908255  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:53.914412 11572 consensus_meta.cc:287] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
I20260709 12:10:53.889017 11840 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:53.921017 11914 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:10:53.922626  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 542) took 1463 ms. Trace:
I20260709 12:10:53.923112  8755 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.917026 11863 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.917233  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:53.918809 11924 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:53.919945 11829 consensus_meta.cc:287] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.000s
I20260709 12:10:53.923036  8902 rpcz_store.cc:276] 0709 12:10:52.459649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.643125 (+183476us) service_pool.cc:224] Handling call
0709 12:10:52.643870 (+   745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.665429 (+ 21559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.665480 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.674557 (+  9077us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.424254 (+749697us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:53.424333 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.425178 (+   845us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.922329 (+497151us) raft_consensus.cc:1685] finished
0709 12:10:53.922354 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.922547 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12517,"raft.queue_time_us":1715,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":26188,"thread_start_us":659672,"threads_started":1,"wal-append.queue_time_us":866351}
W20260709 12:10:53.925879  8752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1838) took 1370 ms (client timeout 1673 ms). Trace:
I20260709 12:10:53.926452 11847 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:53.861111 11763 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.916610 11846 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.920455 11572 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:53.934722 11489 raft_consensus.cc:993] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:53.861510 11878 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.928345  9525 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:53.916728 11925 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.945429 11924 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:53.948990 11649 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.949461 11829 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:53.951732 11865 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:53.958164 11849 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.900518 11836 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:54.010939 11942 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:10:54.011668 11836 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:53.904736 11857 consensus_meta.cc:287] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.002s
W20260709 12:10:53.947603  8752 rpcz_store.cc:269] 0709 12:10:52.556017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.561219 (+  5202us) service_pool.cc:224] Handling call
0709 12:10:53.925664 (+1364445us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b540014c8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:53.925802 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95952640}
I20260709 12:10:53.966725  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:53.877090 11923 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.184s
I20260709 12:10:54.019330  8905 raft_consensus.cc:2368] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:53.961882  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:53.937364 11945 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:53.984234  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 74649.8us
I20260709 12:10:53.996083  8758 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.977300 11924 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.998245 11572 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.001483 11949 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:54.003718  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.005298 11922 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:10:54.006541 11829 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:54.007922 11944 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:10:53.972144 11936 raft_consensus.cc:1081] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:54.006222  8906 raft_consensus.cc:2368] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
W20260709 12:10:54.008807 11927 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:54.009760 11878 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.009948 11932 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:10:53.971966 11925 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.025245  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.029273  8902 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:10:54.034318  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.034796 11949 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.048578  8902 pending_rounds.cc:85] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 6
I20260709 12:10:54.006227 11916 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:54.048902  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.050464  8902 pending_rounds.cc:107] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:54.050905  8902 raft_consensus.cc:2889] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:54.050897  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.051753  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1813) took 1108 ms. Trace:
I20260709 12:10:54.052079  8902 rpcz_store.cc:276] 0709 12:10:52.943095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.978922 (+1035827us) service_pool.cc:224] Handling call
0709 12:10:54.026939 (+ 48017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.051502 (+ 24563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.051702 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.029659 11945 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:54.073491 11945 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.052567 11949 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:54.054549 11939 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:54.054682  8902 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:54.078039  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1816) took 1134 ms. Trace:
I20260709 12:10:54.078399  8902 rpcz_store.cc:276] 0709 12:10:52.943994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.052892 (+1108898us) service_pool.cc:224] Handling call
0709 12:10:54.054417 (+  1525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.077746 (+ 23329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.077969 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.079958  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 548) took 1098 ms. Trace:
I20260709 12:10:54.043875 11763 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.052912 11951 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.081053 11951 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.080968 11763 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.081614 11951 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.028980 11865 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.083343 11763 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.062021  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 636) took 1235 ms. Trace:
I20260709 12:10:54.050911 11925 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.084821  8751 rpcz_store.cc:276] 0709 12:10:52.826384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.826564 (+   180us) service_pool.cc:224] Handling call
0709 12:10:52.863133 (+ 36569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.203241 (+340108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.203272 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.203781 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.653521 (+449740us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.653584 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.653824 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.061767 (+407943us) raft_consensus.cc:1685] finished
0709 12:10:54.061789 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.061952 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":672,"raft.queue_time_us":161449,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13659,"thread_start_us":788826,"threads_started":2,"wal-append.queue_time_us":608353}
I20260709 12:10:54.063009 11668 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.060040  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.066562  8799 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.023550 11836 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:54.092168  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.096194  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 546) took 1284 ms. Trace:
I20260709 12:10:54.080265  8902 rpcz_store.cc:276] 0709 12:10:52.982055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.079132 (+1097077us) service_pool.cc:224] Handling call
0709 12:10:54.079495 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.079666 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.079691 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.079730 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:54.079758 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.079806 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.079909 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.099850  8909 rpcz_store.cc:276] 0709 12:10:52.811458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.417638 (+606180us) service_pool.cc:224] Handling call
0709 12:10:53.417986 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.806156 (+388170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.806202 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.829174 (+ 22972us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.977025 (+147851us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.977079 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.977175 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.095954 (+118779us) raft_consensus.cc:1685] finished
0709 12:10:54.095977 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.096126 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48538,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11282,"thread_start_us":513532,"threads_started":2,"wal-append.queue_time_us":196113}
I20260709 12:10:54.093922 11847 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.108918 11847 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.109859  8872 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.111264 11847 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.113757 11877 consensus_meta.cc:287] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.004s
I20260709 12:10:54.113832 11951 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.114283 11877 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.093664 11836 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.116330 11877 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.116569  8755 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:54.090148 11941 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:10:54.116329 11951 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.118752  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52310.9us
I20260709 12:10:54.118922 11951 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.119421 11917 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.120052  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.121757 11666 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.122843 11923 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.123649 11719 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.124205 11719 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.126468 11719 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:54.127993 11866 consensus_meta.cc:287] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.028s	user 0.013s	sys 0.000s
W20260709 12:10:54.130515 11888 consensus_meta.cc:287] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.002s
I20260709 12:10:54.131160 11925 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:54.097424 11943 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:54.117908 11954 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:54.089701 11950 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:10:54.096596 11922 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:54.049566 11838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.020s	sys 0.030s
I20260709 12:10:54.131107 11888 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:54.094853 11862 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.000s
I20260709 12:10:54.093272 11916 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.121845 11924 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.142490  8902 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:54.091012 11863 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.144129  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.089732 11668 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.135394 11836 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.155730  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1819) took 1083 ms. Trace:
I20260709 12:10:54.156247 11862 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:54.180575  8902 rpcz_store.cc:276] 0709 12:10:53.075473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.103070 (+1027597us) service_pool.cc:224] Handling call
0709 12:10:54.142225 (+ 39155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.155396 (+ 13171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.155682 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.146386 11954 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.182765  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.134338 11866 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.183552  8834 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:54.155047 11618 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.186226  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.166268 11924 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.167804 11925 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.153909 11838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.020s	sys 0.030s
I20260709 12:10:54.168911 11888 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.174283  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1809) took 1232 ms. Trace:
W20260709 12:10:54.154950  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 106569us
I20260709 12:10:54.182566  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.137578 11923 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:54.154297 11890 consensus_meta.cc:287] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 1.021s	user 0.009s	sys 0.004s
I20260709 12:10:54.183868  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1794) took 1523 ms. Trace:
I20260709 12:10:54.184572  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.196051  8900 rpcz_store.cc:276] 0709 12:10:52.941859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.458688 (+516829us) service_pool.cc:224] Handling call
0709 12:10:53.459039 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.466622 (+  7583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.466657 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.470108 (+  3451us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.764774 (+294666us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.790149 (+ 25375us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.173648 (+383499us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b1800033580. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287 00007fce3815e208
0709 12:10:54.173808 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.173879 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.173921 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:54.174025 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.174192 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10661,"prepare.queue_time_us":28356,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":425476,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":13870,"spinlock_wait_cycles":2381056,"thread_start_us":294250,"threads_started":1,"wal-append.queue_time_us":397315}
I20260709 12:10:54.185701  8905 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.186868  8828 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.186950  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:54.188746  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44756.3us
I20260709 12:10:54.196758  8833 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.197305  8835 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:54.201611  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.201859  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.204594  8798 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.206945  8828 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
W20260709 12:10:54.208019  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 98263.2us
I20260709 12:10:54.208487 11923 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.210070 11636 raft_consensus.cc:3055] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.210453  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.211210 11729 raft_consensus.cc:3055] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.211616 11729 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:54.211807  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.208563 11856 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:54.212598 11729 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.212796 11856 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.213759 11729 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.215189 11856 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.208917 11725 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.208858 11937 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:54.210551 11636 raft_consensus.cc:740] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:54.208341  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.186475 11618 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:54.183280 11668 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.197232 11836 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.199251  8904 rpcz_store.cc:276] 0709 12:10:52.660310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.669897 (+  9587us) service_pool.cc:224] Handling call
0709 12:10:52.670324 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.670620 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:53.394034 (+723414us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.183499 (+789465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.183562 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.183614 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.183680 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.183814 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366889,"prepare.queue_time_us":209577,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":367024,"spinlock_wait_cycles":4452224,"thread_start_us":1074591,"threads_started":2,"wal-append.queue_time_us":559236}
I20260709 12:10:54.216012 11937 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:54.251649 11937 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.221339 11668 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.221550  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.232654 11865 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.350744  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.351081  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.268965  8900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:10:54.238931 11881 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.352736  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.346227 11819 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.354028 11819 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.354408 11819 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.354635 11857 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.355129 11857 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.215970 11725 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.357483 11713 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:54.358134 11713 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.359157 11725 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.357292 11857 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.360915  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.361167  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.362044  8904 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.362927  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.363261  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.235951 11717 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.217847 11866 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.218022 11954 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:54.227993 11928 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260709 12:10:54.222075  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.215788 11949 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.369199 11717 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.369501 11949 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.247305 11618 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.370738  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1815) took 1427 ms. Trace:
I20260709 12:10:54.370646 11937 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.371868  8900 raft_consensus.cc:606] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:54.372267  8900 raft_consensus.cc:614] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.371320  8905 rpcz_store.cc:276] 0709 12:10:52.943708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.029638 (+1085930us) service_pool.cc:224] Handling call
0709 12:10:54.184099 (+154461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.200390 (+ 16291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.370504 (+170114us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540009ced0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:54.370656 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354067200}
I20260709 12:10:54.183485 11604 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.224707 11925 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:54.341651  8798 leader_election.cc:400] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:54.216712 11636 consensus_queue.cc:260] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:54.344326  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.219033 11856 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.218343  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.216864 11829 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.216694 11862 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.220901 11898 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:54.217850  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.345005  8835 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:54.349004 11921 raft_consensus.cc:3055] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:54.346828  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.341003  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 635) took 1580 ms. Trace:
I20260709 12:10:54.344732 11863 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:54.346025 11649 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.348500  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.348879  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.403759  8909 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.404383  8906 raft_consensus.cc:2410] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:54.349998  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.405371  8908 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:54.341164  8903 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:54.377709  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.378132  8905 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.380264  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:54.381801  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 180042us
I20260709 12:10:54.382452  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.382550  8798 leader_election.cc:403] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.383888  8829 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:54.409150  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68904.5us
I20260709 12:10:54.410518  8754 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.400329  8760 rpcz_store.cc:276] 0709 12:10:52.761033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.761231 (+   198us) service_pool.cc:224] Handling call
0709 12:10:52.801060 (+ 39829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.205156 (+404096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.205198 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.397452 (+192254us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.757176 (+359724us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:53.757217 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.240509 (+483292us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54001caf54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:54.240567 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.240623 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:54.240658 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.340901 (+100243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150180,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5794,"spinlock_wait_cycles":219756928,"thread_start_us":613401,"threads_started":2,"wal-append.queue_time_us":420227}
I20260709 12:10:54.410825  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:54.384459  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 166224us
I20260709 12:10:54.385229  8901 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:54.417871  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.388578  8904 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:54.395171  8758 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.396873 11636 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.402398  8907 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:54.402962  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 185185us
I20260709 12:10:54.446601  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.424505  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.425730  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.447510  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.448211  8902 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:54.448297  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.449174  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.426007  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.450352  8906 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:54.425951  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.425953  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.427788 11231 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.424386 11717 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:10:54.428972  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:54.386217 11839 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:54.466702 11839 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.430282  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:54.470201  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52429.3us
I20260709 12:10:54.470417 11635 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.470930 11635 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:54.471288 11635 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.471324  8874 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.473357 11862 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.473903 11862 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:54.474767 11862 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.403574 11864 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.400565 11949 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 12:10:54.476881  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.480670 11729 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.481247 11729 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.460778 11836 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.482312  9517 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:54.400745 11898 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.485014  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.430172 11863 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.431303  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.485659  8906 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.432446  8799 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.433385  9522 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.381728 11467 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.496955 11924 consensus_queue.cc:1059] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.497946  8908 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.498088 11924 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:54.499070 11924 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.499382  8908 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:54.499579 11924 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.457432 11725 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.500948  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.501500 11725 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.501974  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.502822  8752 raft_consensus.cc:2393] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:54.503818  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.433929 11604 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.434638  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.433776  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:54.435441 11954 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:54.436548 11918 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:54.445135  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.383941 11856 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.427412  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45074.4us
I20260709 12:10:54.447605  8832 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:10:54.518107  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.437048  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.519065  8756 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:54.519259  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.456336  8909 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:54.393452 11866 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.451735  8753 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:54.459894 11649 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.463174  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.464766  9518 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.463835 11946 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.465525 11961 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.487196  8906 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.485731  8760 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.569646  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.400067 11921 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:54.495894  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1827) took 1011 ms. Trace:
I20260709 12:10:54.496876 11819 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.503881 11725 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.504558  8900 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:54.440342 11858 raft_consensus.cc:993] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:54.437109  8755 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:54.501978  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.584313  8755 pending_rounds.cc:85] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 5
I20260709 12:10:54.584729  8755 pending_rounds.cc:107] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:54.584986  8755 raft_consensus.cc:2889] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.508124  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.442989 11713 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.510273  8752 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:54.510200  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.523869 11836 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.412873 11829 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.514694  8829 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:54.572011 11604 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.516283  9525 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:54.445614  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.522709  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.601903  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:54.524017  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 60917us
I20260709 12:10:54.464921 11881 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.517252  8754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:10:54.525913  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.605162  8754 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.605548  8753 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:54.526633  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 94276.6us
I20260709 12:10:54.605633  8754 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:54.526749 11960 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.529839  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:54.530714 11876 consensus_queue.cc:1059] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:54.531473 11666 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:54.532801 11840 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.505169 11864 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.533485  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:54.609293 11819 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.609701  8907 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:54.522579 11866 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.535367 11646 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:54.610481 11866 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.536339 11888 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:54.612036 11713 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.537137 11649 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.612774  8751 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.613557 11899 raft_consensus.cc:1081] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:10:54.613623 11649 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.590328 11860 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.615037 11860 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.536568  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.537782  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:54.517390 11951 raft_consensus.cc:3055] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.539254  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.623809  8758 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.523546 11918 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.545967  9518 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 4.
I20260709 12:10:54.547406  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:54.551420 11949 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.561065  8904 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:54.561326  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1828) took 1085 ms. Trace:
I20260709 12:10:54.629877  8904 pending_rounds.cc:85] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
W20260709 12:10:54.568012  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48827.1us
I20260709 12:10:54.630424  8904 pending_rounds.cc:107] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:54.630860  8904 raft_consensus.cc:2889] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.631985  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.575277  8903 rpcz_store.cc:276] 0709 12:10:53.475242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.580161 (+104919us) service_pool.cc:224] Handling call
0709 12:10:54.486627 (+906466us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400282154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:54.486739 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301691648}
I20260709 12:10:54.508723 11898 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.582197  8831 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:54.524063 11925 raft_consensus.cc:3055] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:54.524665 11856 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.510839  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.601713  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.609484  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.609894  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.538669  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:54.618741  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 88955.9us
I20260709 12:10:54.619897  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.578711 11961 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.660107  8752 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.633051  9519 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:54.629971  8901 rpcz_store.cc:276] 0709 12:10:53.475499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.811392 (+335893us) service_pool.cc:224] Handling call
0709 12:10:54.561112 (+749720us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002e2a54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:54.561251 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900488576}
I20260709 12:10:54.635401  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:54.666584  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46771.7us
I20260709 12:10:54.667294  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.660491  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:54.668465  8903 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:54.637730  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.626736 11951 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.642319 11839 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.643707 11866 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.639047 11604 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:54.645171 11655 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.669242  9517 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:54.667946 11936 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.635547  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:54.687599  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52112.4us
I20260709 12:10:54.667412  8872 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.573232 11946 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.627321 11945 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.688282  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:54.660365  8756 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.670347  8799 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.668903 11954 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.682260  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.698987  8829 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
W20260709 12:10:54.666021  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 127452us
I20260709 12:10:54.664544  8726 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:54.681995 11949 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.684921 11951 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.702687  8908 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.690845  8758 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:10:54.678862 11881 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:54.713112  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 202336us
I20260709 12:10:54.677909 11719 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.657657 11888 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:54.723485  8752 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:54.641688 11925 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.700366  8754 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.692832 11860 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.698573 11916 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.632486 11267 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.704262 11231 raft_consensus.cc:2764] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:54.677459 11898 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.713819  8755 raft_consensus.cc:1240] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:54.712800 11937 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.663714  9487 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:54.697633 11863 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.657763 11960 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.720542  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.719478 11717 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.724881  8759 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:54.729022  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.693959  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:54.704062  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:54.703004 11840 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.739571  8756 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:10:54.740275 11267 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.764324  8752 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.741263  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.765278  8829 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:54.743229  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.714638  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.719470 11881 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:54.657828 11921 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:54.749097  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 85483us
I20260709 12:10:54.750241  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.751677  8754 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:54.805963  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 55796us
I20260709 12:10:54.697814 11936 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.807560  8835 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.807876  9487 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:54.804011  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 100016us
I20260709 12:10:54.815845  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.807060  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:54.748413 11962 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:10:54.821447  8755 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.741205 11951 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.747623 11655 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:54.827374 11655 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:54.741183 11860 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.714270 11945 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:54.824489  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.831807 11937 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.832357 11655 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.821005 11961 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.832357 11937 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.837978 11937 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.838424 11862 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:54.840090  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 125494us
W20260709 12:10:54.840579  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 176087us
I20260709 12:10:54.843142  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:54.846748  8756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:10:54.847348  8756 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.847750  8756 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.848272  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:54.848891  9524 raft_consensus.cc:3055] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:54.849184  9524 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:54.850126  9524 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.851110  9524 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:54.852878  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.853998  9487 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:54.774258  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.846700  8872 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.831516 11945 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.864183  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48505.7us
I20260709 12:10:54.748221 11916 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:54.756704 11719 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.871253  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.763298 11924 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.860913 11975 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.872532  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.749797 11898 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:54.758450 11839 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.857419  8756 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.876761  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1827) took 1382 ms. Trace:
I20260709 12:10:54.803755 11949 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.803382 11267 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.757483 11960 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.906684  8756 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:54.882818  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.821851 11881 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:54.824659 11938 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:54.825752 11865 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:10:54.697783 11836 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:54.888816  9524 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:54.922703  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.822127 11857 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.896576  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:54.897426  8755 raft_consensus.cc:1240] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:54.895066  8757 rpcz_store.cc:276] 0709 12:10:53.483022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.899762 (+416740us) service_pool.cc:224] Handling call
0709 12:10:54.865402 (+965640us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540014d7d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:54.865542 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322571520}
I20260709 12:10:54.900134 11924 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.931486 11729 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.897689 11839 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.869709 11717 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:54.900918 11719 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.828961 11860 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.917948  8828 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.824453 11875 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:10:54.880411  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 185141us
I20260709 12:10:54.822754 11819 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.925175  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:54.926611  8832 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.897872 11898 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.893837 11945 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.932979  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:54.940527  8724 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:10:54.971688  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 100589us
I20260709 12:10:54.918556 11725 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.951849  8835 raft_consensus.cc:1240] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:54.922278 11949 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:54.868310 11925 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:54.961925 11946 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:54.962468  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.963016 11916 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:54.964053 11864 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:54.965154  8833 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.967926 11866 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:54.972358  8829 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:54.947216  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 125431us
I20260709 12:10:55.003516  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.989598  8760 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:54.936326 11839 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.972800 11971 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:10:55.005753  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:54.948125 11717 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:55.002585  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.969116 11945 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.004587  8753 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:55.010556  8834 raft_consensus.cc:2368] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:55.011555  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:54.989326 11863 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.995375  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:54.943966 11972 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.010033  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:54.973344 11829 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.017540  8832 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:55.023813  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.025125  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.006330 11946 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.038506 11863 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:55.045217  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:55.046859  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.013190 11918 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.053079  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.053857  8904 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:55.054045  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.048260  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.054416  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.055392  8906 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:55.055751  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.054653  8757 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.018584 11980 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.029474 11925 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:55.045615  8799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.654s (SENT) [suppressed 7 similar messages]
I20260709 12:10:55.060494  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.064344  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.032426 11866 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.065225  8756 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:55.067432  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.068126  8832 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:55.067596  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.033106 11972 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:55.108078  8757 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:55.075873  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:54.972975 11960 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.111187  8756 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 4: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:55.029047 11934 consensus_queue.cc:1059] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:10:55.112694  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.065287  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:55.111789  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.116767  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.060284 11649 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.128788 11949 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.129151 11972 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.057159 11717 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.058491 11719 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.126464  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.137877  8907 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:55.138919  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.139582  8832 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:55.089154 11968 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:10:55.128275 11635 consensus_meta.cc:287] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 12:10:55.059402 11946 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.129432 11649 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.115553 11918 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.128533 11960 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.171542  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.172593  8832 raft_consensus.cc:2410] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:55.127338  8903 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:55.141330  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.109220 11604 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.150039  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 84828.4us
I20260709 12:10:55.094338 11881 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.185501  8755 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:55.108752 11980 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:55.133298 11979 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:10:55.191713  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.074426 11961 consensus_queue.cc:1059] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 12:10:55.166636  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 121050us
I20260709 12:10:55.065502 11924 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.177048  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:55.161948 11719 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:55.180197  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.162840 11866 raft_consensus.cc:3055] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.188546  8827 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:55.164666  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.195654  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:55.204124  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.204893  8799 leader_election.cc:400] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:55.205605 11725 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.206163 11725 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:55.201798 11924 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.207131 11725 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.191190 11988 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:55.209209 11988 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.209497 11924 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.204922  8832 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:55.210559  8757 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:55.211542 11988 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.205274  8799 leader_election.cc:403] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.187386 11863 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.164451 11635 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.237866  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.196619 11989 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.243049  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.240607  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.244405  8907 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:55.245927  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.247772  8907 raft_consensus.cc:2393] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:55.219022 11929 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.203167 11866 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:55.258600  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.249097 11989 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.265050 11989 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.265671 11267 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.267933 11267 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.265707 11945 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.175712 11918 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.273700 11881 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.241086 11924 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:55.275177 11918 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.275758 11649 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.187214 11604 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.280743 11980 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:55.282485 11985 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:10:55.282636 11635 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.250983 11929 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.283752 11929 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.220038 11860 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.289212 11866 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.290524 11866 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.243620 11994 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:10:55.294973 11946 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.295270 11646 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.296157 11646 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:55.297261  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.297935  8828 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.255787  8902 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.303499  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.305296  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.262583 11719 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.307433  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.229171 11862 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:55.250038  8799 leader_election.cc:400] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8.
I20260709 12:10:55.292107 11898 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.329890 11646 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.330704 11898 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.317193  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.331835  8755 raft_consensus.cc:2368] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:55.331640 11646 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.334824  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 85046.7us
I20260709 12:10:55.318115  8907 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:55.241878 11949 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:55.336586  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.339349  8828 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
W20260709 12:10:55.328583 11636 consensus_meta.cc:287] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.867s	user 0.013s	sys 0.000s
I20260709 12:10:55.310492 11860 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:55.347337  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.344228  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:55.351092 11954 consensus_meta.cc:287] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.005s
I20260709 12:10:55.351712 11954 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.352591  8831 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:10:55.357304 11975 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.301374 11717 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:55.361155  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.362208  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.362914  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.363058  8835 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:55.363885  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.364583  8830 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:55.365312  8828 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:55.365829  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.359055 11636 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:55.348042 11635 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.367741 11829 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.368053 11636 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.368918 11725 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.367432  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:55.369495  8833 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.368125 11635 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.369571  8826 raft_consensus.cc:1240] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.367760  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.370132  8834 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:10:55.367070  8874 leader_election.cc:400] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:55.373433  8874 leader_election.cc:403] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.369571 11725 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:55.377862  8829 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.378460 11725 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.380003 11725 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.380522 11635 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.381721  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.382570  8826 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:55.326403 11973 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:10:55.387377  8835 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:10:55.387399  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:55.462088  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 74741.8us
I20260709 12:10:55.463232  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:55.473976 11993 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:10:55.477427  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:55.485011  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:55.487119  8902 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:10:55.366739 11860 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:55.500209  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.512502  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.515810  8756 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:55.507520 11604 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.508766 11984 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.475843 11972 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:55.481986  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 115050us
I20260709 12:10:55.487421 11949 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.487649 11467 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7.
I20260709 12:10:55.482496 11951 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.486829 11717 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.487018 11924 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.525664  8872 leader_election.cc:400] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:55.438334 11836 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:10:55.482522 11862 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.529531  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:55.523656 11945 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.537665  8874 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:55.529639  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1842) took 1038 ms. Trace:
I20260709 12:10:54.649333  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:55.532611  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.522787 11918 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.535432  8872 leader_election.cc:403] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.540452  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:55.523216 11984 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:55.538334  8759 rpcz_store.cc:276] 0709 12:10:54.491231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.491415 (+   184us) service_pool.cc:224] Handling call
0709 12:10:55.529422 (+1038007us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001a13d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:55.529565 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512751488}
I20260709 12:10:55.526114 11949 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.543087  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:55.543551 11989 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.550772  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:55.552026  8872 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:55.540498 11467 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:55.544569 11856 consensus_meta.cc:287] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.003s
I20260709 12:10:55.556896 11467 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:55.544042 11839 consensus_meta.cc:287] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.007s
I20260709 12:10:55.540776 11618 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.551896 11989 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:55.551698 11937 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.553035 11949 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.527762 11972 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.576357  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 573) took 1134 ms. Trace:
I20260709 12:10:55.543984 11713 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:55.555136 11973 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:55.567145  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.557404 11509 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:55.554582 11924 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.583503  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.544330 11945 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.568969 11467 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.540776 11862 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.570711 11989 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.617686  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.576920  9522 rpcz_store.cc:276] 0709 12:10:54.441850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.545362 (+103512us) service_pool.cc:224] Handling call
0709 12:10:54.545702 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.545896 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:54.623952 (+ 78056us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.575845 (+951893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.575938 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.576007 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.576106 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.576274 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646599,"prepare.queue_time_us":152716,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3409,"thread_start_us":381562,"threads_started":2,"wal-append.queue_time_us":305157}
I20260709 12:10:55.618891  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:55.603843  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:55.553678 11918 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.572865 11975 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.574014 11881 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.576555 11666 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.608266 11972 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.561017 11929 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.581867 11984 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.564024 11856 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:55.626354  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 772396us
I20260709 12:10:55.612955 11924 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.614416 11945 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.628104  8835 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:55.628824  8726 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:55.621024  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 70409.5us
I20260709 12:10:55.632328  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.615522 11636 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.570291 11839 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.633034  8756 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:55.625300  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 73369.8us
I20260709 12:10:55.634186  8874 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:55.634337  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.635497  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.638785  8759 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:55.586417 11713 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.644569  8907 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:55.624809 11881 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.643314  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.645664  8757 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:55.622332 11954 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.641911  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:55.648710  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:55.651662  8874 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:55.652184  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.634382 11984 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.635097 11945 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:55.676206 11945 raft_consensus.cc:697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:55.677210 11945 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.665930 11839 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.679994  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.655632  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:55.681213  9522 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.661001 11725 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.681620  9522 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:55.634064 11899 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.682366 11899 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.685184 11899 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.685336  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1846) took 1193 ms. Trace:
I20260709 12:10:55.667084 11857 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.667694 12004 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:55.673815 11998 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.686094 11857 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:55.686583 11998 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.686946 11857 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.687062 11998 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:55.688550 11987 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.466s	user 0.002s	sys 0.000s
I20260709 12:10:55.686277 12004 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.663753 11924 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:55.648988 11881 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.682444  9522 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:55.685804  8753 rpcz_store.cc:276] 0709 12:10:54.492353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.681178 (+188825us) service_pool.cc:224] Handling call
0709 12:10:55.004331 (+323153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.013602 (+  9271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.685129 (+671527us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002c1fd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:55.685273 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704058752}
I20260709 12:10:55.674233 11713 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:55.694625  8903 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:55.636258 11860 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:55.698534  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44755.8us
I20260709 12:10:55.699575  9487 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:55.696823  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.703620  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.705920  8758 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:55.654747 11636 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.706274  8756 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:55.697440 11838 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:10:55.709801  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 653) took 1258 ms. Trace:
I20260709 12:10:55.712105  8751 rpcz_store.cc:276] 0709 12:10:54.451301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.451437 (+   136us) service_pool.cc:224] Handling call
0709 12:10:54.460309 (+  8872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.613248 (+152939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.709512 (+1096264us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540033d454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:55.709728 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350182144}
I20260709 12:10:55.712548  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.710865 11898 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:55.713115  8903 raft_consensus.cc:2376] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7. Re-sending same reply.
I20260709 12:10:55.717092  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:55.714814  9522 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.718833  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.729408  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:55.729741  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.730129  8756 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.730648  8752 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:55.730782  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.734889  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:55.733397 11666 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.737027 11890 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.737628  9516 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.737902 11921 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.742532  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:55.766292  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2222) took 1246 ms. Trace:
I20260709 12:10:55.768548  8908 rpcz_store.cc:276] 0709 12:10:54.519923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.521091 (+  1168us) service_pool.cc:224] Handling call
0709 12:10:54.521336 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.703119 (+181783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.765967 (+1062848us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400282b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:55.766214 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416658176}
I20260709 12:10:55.767119  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.718935  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:55.770437  8903 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:10:55.770717  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51852.6us
I20260709 12:10:55.772128  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.772512  8751 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.772706  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 559) took 1207 ms. Trace:
I20260709 12:10:55.772823  9519 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:55.714479 11839 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.776574  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.774371  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.777272  9524 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:55.773072  8909 rpcz_store.cc:276] 0709 12:10:54.564854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.565050 (+   196us) service_pool.cc:224] Handling call
0709 12:10:54.565463 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.565862 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:54.710592 (+144730us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.772245 (+1061653us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b1800243640. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287
0709 12:10:55.772341 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.772390 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.772434 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.772505 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.772622 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307789,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4508,"raft.queue_time_us":54952,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":17711,"spinlock_wait_cycles":59851008,"thread_start_us":274024,"threads_started":2}
I20260709 12:10:55.777285  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:55.769901  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.777909  8756 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:55.778820  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.778972  8908 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:55.780072  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.780563  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.781234  8900 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:10:55.782065  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.783072  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.783805  8900 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:55.784982  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:55.714636 11898 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:55.780786  8908 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:55.790524  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:55.791456  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.789884  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.792430  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:55.729242 11636 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:55.739213 11729 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.717496 11467 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:55.773360 11934 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.774226 11972 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.853961  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 52251.1us
I20260709 12:10:55.728950 11646 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:10:55.855424  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64977.8us
I20260709 12:10:55.776221 11725 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.850980 11729 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.797577 11876 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:10:55.743698 12005 consensus_queue.cc:1059] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 12:10:55.971921  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 45844.3us
I20260709 12:10:55.855289 11839 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:55.938438  8909 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:55.892220  8900 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:55.891865 11936 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:55.795542 11888 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.797350 11858 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.931864  9487 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:56.009886  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 78127.2us
I20260709 12:10:55.988981 11729 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.795778 11975 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.195s
W20260709 12:10:55.936597 11981 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.847s	user 0.000s	sys 0.004s
W20260709 12:10:55.918116 12002 log.cc:927] Time spent T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:10:55.919126 11875 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.859906 11973 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:10:56.022414 11875 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.022940 11875 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.981614 11725 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.028373  9523 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:56.029072 11829 raft_consensus.cc:3055] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.029593 11829 raft_consensus.cc:740] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:56.030575 11829 consensus_queue.cc:260] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.032311 11829 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.015827 11936 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.033231 11936 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:56.034196 11936 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:56.037019  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.018373 12009 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:10:56.034660 11975 raft_consensus.cc:3055] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.008390 11888 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.937961  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:55.891749 11972 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:56.043017  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.990856 11949 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.049897 11888 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.044858 11975 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:56.065263  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.065641 11975 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.040729 11725 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.027465 11929 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.037923 11636 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.017035 11858 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:56.069164  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:55.989930 11898 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.075927 11975 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.081921 11924 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.058794 11875 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.080977 11858 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.100965  8904 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:56.104166  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:56.003556 11856 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.108017  8904 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:56.122184 11857 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.125672 11618 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:56.093008 11954 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:56.132789 11963 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.326s	user 0.003s	sys 0.000s
I20260709 12:10:56.137104 11972 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:56.145087 12011 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:10:56.283923 11857 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:56.149139  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.286018  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1837) took 1222 ms. Trace:
I20260709 12:10:56.286722  8906 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:56.167802 11646 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:56.103410 11949 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:56.185796 11982 log.cc:927] Time spent T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.983s	user 0.000s	sys 0.003s
I20260709 12:10:56.101341 11467 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.189981 12003 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.193436 11989 consensus_meta.cc:287] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.005s
I20260709 12:10:56.196960 11925 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.150305 11875 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:56.111129 11866 consensus_meta.cc:287] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.000s
I20260709 12:10:56.242614 11888 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.247152  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1856) took 1737 ms. Trace:
I20260709 12:10:56.331692  8758 rpcz_store.cc:276] 0709 12:10:54.510172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.715608 (+205436us) service_pool.cc:224] Handling call
0709 12:10:54.716313 (+   705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.706505 (+990192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.246655 (+540150us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000f69d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:56.247063 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274573056}
I20260709 12:10:56.231817 12013 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:56.253952 11725 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.094038 11839 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.259178 11729 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.381230 11729 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.264598  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:56.104755 11998 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.270375  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2038) took 1230 ms. Trace:
I20260709 12:10:56.315960 11972 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:56.386811  8827 rpcz_store.cc:276] 0709 12:10:55.040325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.042510 (+  2185us) service_pool.cc:224] Handling call
0709 12:10:55.066652 (+ 24142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.203563 (+136911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.270045 (+1066482us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54003bc254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:56.270296 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279454976}
I20260709 12:10:56.272949  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 148) took 6854 ms. Trace:
I20260709 12:10:56.275069  8904 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.389910  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:56.390659  8904 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:56.277096  9522 consensus_meta.cc:287] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
I20260709 12:10:56.392352  9522 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:56.277200  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 559) took 1410 ms. Trace:
I20260709 12:10:56.281561 11618 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.282397 11954 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.286477  8907 rpcz_store.cc:276] 0709 12:10:55.063953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.343963 (+280010us) service_pool.cc:224] Handling call
0709 12:10:56.285807 (+941844us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540001aed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:56.285951 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672919808}
I20260709 12:10:56.296666  8906 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:56.271391 11881 consensus_meta.cc:287] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:10:56.317727 11921 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.319541 11916 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:56.393353  8831 rpcz_store.cc:276] 0709 12:10:54.866966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.872239 (+  5273us) service_pool.cc:224] Handling call
0709 12:10:56.276998 (+1404759us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400389ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:56.277131 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063098880}
W20260709 12:10:56.338753 11984 consensus_meta.cc:287] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.001s
I20260709 12:10:56.405869  8902 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.407389  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:56.398020  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:56.410913  8907 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.313495 11646 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.412467  8900 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:56.322161 11949 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:10:56.322382 11925 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.356061 12013 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.389082 11829 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:56.319985 11989 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.388249  8658 rpcz_store.cc:276] 0709 12:10:49.443187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.493762 (+ 50575us) service_pool.cc:224] Handling call
0709 12:10:56.252554 (+6758792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:52.159737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:52.225921 (+ 66184us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:52.225984 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:10:52.226008 (+    24us) tablet.cc:662] Decoding operations
0709 12:10:52.295863 (+ 69855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:52.295977 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:52.296013 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:52.296784 (+   771us) tablet.cc:701] Row locks acquired
0709 12:10:52.296844 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:10:52.297033 (+   189us) write_op.cc:270] Start()
0709 12:10:52.297187 (+   154us) write_op.cc:276] Timestamp: P: 1783599052296947 usec, L: 0
0709 12:10:52.297207 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:52.297900 (+   693us) log.cc:844] Serialized 2452 byte log entry
0709 12:10:53.929223 (+1631323us) op_driver.cc:464] REPLICATION: finished
0709 12:10:54.056183 (+126960us) write_op.cc:301] APPLY: starting
0709 12:10:54.056316 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:54.056549 (+   233us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:54.056738 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:54.057799 (+  1061us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:54.058148 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:54.058204 (+    56us) write_op.cc:312] APPLY: finished
0709 12:10:54.058613 (+   409us) log.cc:844] Serialized 53 byte log entry
0709 12:10:54.059745 (+  1132us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.059871 (+   126us) write_op.cc:454] Released schema lock
0709 12:10:54.059943 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:54.060381 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.060415 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":526687,"reported_tablets":16,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":117437,"apply.run_cpu_time_us":3327,"apply.run_wall_time_us":4215,"num_ops":6,"prepare.queue_time_us":382661,"prepare.run_cpu_time_us":33978,"prepare.run_wall_time_us":1123155,"raft.queue_time_us":225915,"raft.run_cpu_time_us":24106,"raft.run_wall_time_us":92797,"replication_time_us":1631831,"thread_start_us":1370048,"threads_started":4,"wal-append.queue_time_us":942794,"wal-append.run_cpu_time_us":12705,"wal-append.run_wall_time_us":1824692}]]}
I20260709 12:10:56.320261 12003 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.413301 11876 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.440173 11876 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.442948 11876 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.443059 11646 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:56.448056  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.434830 11725 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.438930 11888 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.414960 11916 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.442749 11829 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.456341 11819 raft_consensus.cc:3055] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:56.443763  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2233) took 1136 ms. Trace:
I20260709 12:10:56.456843 11819 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:56.457157 11618 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.458282 12004 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.458904 12013 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.454919 11923 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:56.459774 11923 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:56.460282  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.446070 11998 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.447098 11994 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.463038 11994 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:56.463584 11994 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.460224 11923 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:56.465044 11923 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.465917 11994 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.466802 11923 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.467813  8908 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.469050  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2230) took 1214 ms. Trace:
I20260709 12:10:56.469422  8908 rpcz_store.cc:276] 0709 12:10:55.254721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.792421 (+537700us) service_pool.cc:224] Handling call
0709 12:10:55.792730 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.468243 (+675513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.468806 (+   563us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540019b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:56.468991 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552125184}
I20260709 12:10:56.470486 11924 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.470623  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:56.471381  8908 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.471653  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:56.427525  8906 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:56.457104  8903 rpcz_store.cc:276] 0709 12:10:55.307452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.793799 (+486347us) service_pool.cc:224] Handling call
0709 12:10:55.794235 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:55.857057 (+ 62822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.857328 (+   271us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:55.912855 (+ 55527us) log.cc:844] Serialized 52 byte log entry
0709 12:10:56.295030 (+382175us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:56.295057 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.295109 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.443544 (+148435us) raft_consensus.cc:1685] finished
0709 12:10:56.443564 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.443703 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57100,"raft.queue_time_us":61830,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":38350,"thread_start_us":282477,"threads_started":1,"wal-append.queue_time_us":444143}
I20260709 12:10:56.446013 11954 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.398029 11972 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.457767 11819 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.473629  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:56.424388 11655 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.479764  8909 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:56.426420  8904 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:10:56.409145 11881 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.468412 11989 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.411970 11921 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.483870  9488 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:56.494392  8908 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:56.469904 11925 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.492601 11655 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.504845 11972 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.497680 12003 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.498198 11819 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:56.498639 11916 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.498740 11888 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.502341 11881 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.481504 11934 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.510564  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 238382us
I20260709 12:10:56.532889  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:56.523758  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.534790  9525 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:10:56.524006 11972 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.523751 11888 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.546111  8801 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:56.541496 12003 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.550734 11972 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.555264 11829 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.538519 11934 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.557523 11655 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:56.507833 11980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.013s	sys 0.039s
I20260709 12:10:56.562175 11888 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.561683 12003 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.589715  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:56.582931 11980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.014s	sys 0.039s
I20260709 12:10:56.579816 11719 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.582322 11925 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.597213  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:56.596836  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 273486us
I20260709 12:10:56.603652  8759 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.592788 12003 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.613232  8758 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:56.605568  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 341067us
I20260709 12:10:56.621999  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:56.622640  8754 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.625177  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:56.625942  8756 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.626107  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.626915  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:56.626854  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.619124  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:56.627969  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:56.630640  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:56.598765 11925 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:56.632596  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.631683  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:56.643803  8756 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:56.644910  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.646896  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.689054  8754 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:56.689452  8757 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:56.646507  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.652271  8725 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:56.651999  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:56.653499  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.690922  8758 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:56.632707 11916 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.600327 11719 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.647822 11925 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.659862  8726 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:56.632401 11881 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:56.639348 11994 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:10:56.717170  9523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35690 (request call id 574) took 2274 ms (client timeout 1707 ms). Trace:
I20260709 12:10:56.715947 12007 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.717141  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:56.719307  9524 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:56.719107  8907 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
W20260709 12:10:56.717374 12019 log.cc:927] Time spent T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:56.691877 11980 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.723773  9522 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.724165  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.660792 12023 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:56.718585  9523 rpcz_store.cc:269] 0709 12:10:54.442186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.536298 (+ 94112us) service_pool.cc:224] Handling call
0709 12:10:56.716925 (+2180627us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400528fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:56.717047 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245889408}
I20260709 12:10:56.726989  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1850) took 1077 ms. Trace:
I20260709 12:10:56.701099 11921 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:56.728765  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.729545  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 564) took 1154 ms. Trace:
I20260709 12:10:56.732347  8902 rpcz_store.cc:276] 0709 12:10:55.575465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.022906 (+447441us) service_pool.cc:224] Handling call
0709 12:10:56.023239 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.410128 (+386889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.729253 (+319125us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000b2554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:56.729467 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879450368}
I20260709 12:10:56.696106 12026 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.753530  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:56.719081 11862 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.727600  8905 rpcz_store.cc:276] 0709 12:10:55.649895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.260353 (+610458us) service_pool.cc:224] Handling call
0709 12:10:56.269826 (+  9473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.270318 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.270348 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.270947 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.510301 (+239354us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:56.726310 (+216009us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.726678 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.726750 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.726793 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:56.726804 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.726923 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5183,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6266,"thread_start_us":420539,"threads_started":2,"wal-append.queue_time_us":345834}
I20260709 12:10:56.768432  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.756029  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:56.776856  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 124913us
I20260709 12:10:56.752805 11839 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.753643 12026 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.779291  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.729652 12028 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.784118  8875 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:56.728336 11916 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:56.808930  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 156814us
I20260709 12:10:56.755580 12023 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:56.755771 11921 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.812875  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.814321  8875 leader_election.cc:403] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:56.772154 11655 raft_consensus.cc:2764] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:56.820822  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:56.722226 11881 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:56.820005 12021 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:10:56.811225 11972 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.729354 11980 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.810074 11862 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:56.822229 11857 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:10:56.832309  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 54622us
I20260709 12:10:56.724941 12007 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.813621 12026 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.823359 12016 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 12:10:56.834895 12028 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:10:56.873559 12010 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.018s	user 0.007s	sys 0.000s
I20260709 12:10:56.819053 11934 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.818071 11839 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.874986 11655 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.825855 11921 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.876118 11921 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.876756 11839 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:56.839056 12018 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:10:56.842527  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:56.844931  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.847398 11719 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:56.850500 12020 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:10:56.851274 12025 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:10:56.851835 12034 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:56.852761 11857 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.854521 11881 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:56.857947 12006 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.845090 11916 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:56.833575 11989 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:10:56.864146 11980 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:10:56.821589  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44844us
I20260709 12:10:56.869065 11994 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:56.846380 11862 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:56.909415  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 66962us
I20260709 12:10:56.910835 12042 raft_consensus.cc:2764] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:56.901549 12013 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.882710 11840 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:10:56.913064  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 253045us
I20260709 12:10:56.903612 12006 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:56.917598 12006 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.918556 12007 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.918839 12006 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.920418  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:56.928705  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:56.932284  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 112046us
I20260709 12:10:56.935199  8726 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:56.937994 12034 consensus_queue.cc:1243] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:56.938598 12034 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.939149 12034 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:56.939071 12040 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:56.939498 11916 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.940032 11916 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:56.938767  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:56.941159 11916 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.942703 11916 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.938508 11888 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.945533 12028 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.946295 12028 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.946738 12028 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.919804 11829 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.947808  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.934429 11946 raft_consensus.cc:2764] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:56.892663 12023 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.970142  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:56.919682 12013 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.935340 12033 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.978298  9519 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:56.949218 11888 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:56.956276 12039 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:56.997772  8759 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.991834  8760 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.998493  9522 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:57.001103  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:56.972512 11840 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.003084  8751 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:57.003226 11840 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:56.958421 11924 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:57.005239  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:56.960135 11954 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.960352 11923 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.002049  9525 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:57.005497  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:56.973789 11980 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:56.987651 12000 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:56.940097 12034 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.010254  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:56.955010 11829 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:56.991288 12040 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:56.974913 11509 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:57.019317 11646 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:57.019362 12040 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.022646 11934 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.022763 12040 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.023099 11934 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:57.023923 11934 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.011260 11924 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.018765 11840 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:57.059273 11840 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:57.059899 11840 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.062088  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.062610 11840 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:57.062987  9516 raft_consensus.cc:2410] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:57.047935 12040 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:57.065056  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.065627 11924 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.012283 11954 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.066926  8909 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:57.067765 11954 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:57.014671 12032 consensus_queue.cc:1175] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd116b86a1e4445c994a361f776beba1" responder_term: 7 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:57.071065 11829 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.012501 11923 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:57.041328  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.074299 11918 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.076217 12028 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.077600  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.078364  8903 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:57.081090 12026 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.081606 12003 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.083846 12003 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.084115  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.052446 12022 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:57.084982  9516 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:57.085088 12022 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.087527 12022 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.088084 11984 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.088508 11984 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:57.089448 11984 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.089692 11925 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.090615 11984 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.087546  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2226) took 2038 ms. Trace:
I20260709 12:10:57.092092  8901 rpcz_store.cc:276] 0709 12:10:55.048808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.060553 (+ 11745us) service_pool.cc:224] Handling call
0709 12:10:55.060965 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.542166 (+1481201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.542203 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.546001 (+  3798us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.686123 (+140122us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:56.686189 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.087113 (+400924us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400117954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:57.087164 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.087217 (+    53us) raft_consensus.cc:1685] finished
0709 12:10:57.087232 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.087472 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1076,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":18778,"spinlock_wait_cycles":3405351296,"thread_start_us":129103,"threads_started":1,"wal-append.queue_time_us":218034}
I20260709 12:10:57.093152 11925 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.040688  9525 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:57.094161  9525 pending_rounds.cc:85] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting all ops after (but not including) 6
I20260709 12:10:57.094455  9525 pending_rounds.cc:107] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 12:10:57.094756  9525 raft_consensus.cc:2917] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 12:10:57.095152  9525 raft_consensus.cc:2889] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.045147  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:57.015334 12041 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.096444  8908 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.096764  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:57.096585 12041 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.014464 11980 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.098744 11509 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.099154 11509 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.099298 12041 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.013979 11888 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.099858 11980 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.100127 11888 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:57.041723 11862 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.044605  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:57.101104 11888 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:57.102105  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 57583.6us
I20260709 12:10:57.010195 12039 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:57.057737  8905 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.063335  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.064919 12033 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:57.124089 11857 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.074070 12013 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:57.099493 11509 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.037048  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.106279  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.047082  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.056398  8906 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:57.112100  9488 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:57.131718  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.119131  8908 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:57.015684 12000 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.126030  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:57.120424  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.018215 11839 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.113822  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.044798 12034 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.143860  8758 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:57.134286  8905 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:57.128576  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.149277  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.140276  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.141732  8904 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:57.150453  8903 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
W20260709 12:10:57.150764  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.151118  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:57.152117  8904 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:57.142498  8799 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.654s (SENT)
I20260709 12:10:57.149374  8909 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:57.142586  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.133426  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:10:57.144698  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 69717.4us
W20260709 12:10:57.154340  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.161734  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.074340 11923 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:57.161737  8799 leader_election.cc:336] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.673s (SENT)
I20260709 12:10:57.172755  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 563) took 1601 ms. Trace:
I20260709 12:10:57.173193  8900 rpcz_store.cc:276] 0709 12:10:55.570794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.011330 (+440536us) service_pool.cc:224] Handling call
0709 12:10:56.011811 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.414140 (+402329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.172371 (+758231us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400115b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:57.172579 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920758016}
I20260709 12:10:57.129668 12040 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:57.180790  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49624.1us
I20260709 12:10:57.145296 11934 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.156051  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.154125  8906 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:57.162112  8908 raft_consensus.cc:2376] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10. Re-sending same reply.
I20260709 12:10:57.152861 12043 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:57.214250  8904 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:57.218163  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.178442 11646 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.179381 12040 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.234808  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.220597  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.235848  8908 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:57.236958  8758 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.237501  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.223986  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.238468  8908 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:57.188537  8799 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.700s (SENT)
I20260709 12:10:57.239274  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:57.239893  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 51400.6us
I20260709 12:10:57.221635  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.240660  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.241389  8831 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:10:57.241335  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.232846  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.242568  8835 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:57.242707  8832 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:57.244204  8831 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:57.233096  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.188503 12022 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:57.233619  8753 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.165738 12033 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:10:57.237042  8755 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:57.245501  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.263362  8831 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:57.254063  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.264358  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:57.264593  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.265432  8831 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.219729  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.247671  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.248425  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:57.266937  8754 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.267704  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.268988  8834 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:57.178269 11618 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:57.226883 11925 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:57.254142  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.274108  8835 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:10:57.275264  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.276011  8835 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:57.254482  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.255118  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.278270  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.279675  8834 raft_consensus.cc:2468] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:57.280690  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.255837  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.230278 11949 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:57.256178  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.252907 11819 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.226722 11923 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:57.258070 12000 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.267741 11646 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:57.233189  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.298122  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.299124  8904 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:57.282964  8906 raft_consensus.cc:2410] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:57.223551 11980 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:57.282579 11954 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:57.282397  8752 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:57.246321 12040 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.284418  8758 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:57.285171  8754 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:10:57.236188 12003 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:57.289492  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.311859  8835 raft_consensus.cc:2410] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:57.289522  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:57.312428  8755 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.290899  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.260804  8828 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:57.314800  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.293275  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.315678  8828 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:57.293715  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.293792  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.304445  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.230031 12043 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.313112  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:57.290442 12026 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.292309 11839 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:57.273095 12022 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:57.360942  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.383116  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.312206 11655 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.338841 12003 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.428517  8755 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:57.295642 11819 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.417493  8826 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:57.417096 11646 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.417725 11924 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.297927 12039 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.421545  8833 raft_consensus.cc:2393] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:10:57.422111  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.422969  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 58087.8us
I20260709 12:10:57.423780  8829 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:57.425086  8831 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:57.421928  8832 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:57.415512  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.416725 12007 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.429970  8903 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:57.431609  8799 leader_election.cc:336] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.904s (SENT)
I20260709 12:10:57.315677 11719 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 12:10:57.456876  8799 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.913s (SENT)
I20260709 12:10:57.435724 12046 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.420325  8656 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 3 to 4, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 4 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.436015 11839 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.437069 12043 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:57.431366  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 253043us
I20260709 12:10:57.437918  8827 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.443622  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.443084  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.471423  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:57.448379  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 271067us
I20260709 12:10:57.452268  8829 pending_rounds.cc:85] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:10:57.453562  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.469372  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.358021 11921 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.429409 12026 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:57.472939  8754 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:57.568787 11719 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.570955 11719 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.571198  8829 pending_rounds.cc:107] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 12:10:57.572409  8829 raft_consensus.cc:2917] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 12:10:57.573705  8829 raft_consensus.cc:2889] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:57.566107  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.576208  8826 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.522746  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.577976  8834 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:57.488683  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.579210  8835 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.579425  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.580516  8831 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:57.471974  8656 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 4 to 6, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.505681  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:57.446760 12000 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.583271  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:57.471194  8830 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
W20260709 12:10:57.459718 12049 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.157s	user 0.003s	sys 0.005s
I20260709 12:10:57.586442  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.442894 12041 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:57.451295 11924 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:57.590032  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.433007 11655 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.587114  8829 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
W20260709 12:10:57.572499 12048 log.cc:927] Time spent T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:10:57.606108 11719 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.607978  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.599022  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:57.599543  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.592849 12000 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:57.601565  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.609046  8834 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:57.608608 11921 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.608603  8829 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.603395 12054 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.604087  8751 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.603958 12053 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:57.603312  8656 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 5 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.465391 12007 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:57.627020  8835 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:57.631613  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.627988  8827 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:10:57.626497  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.632335  8656 catalog_manager.cc:5697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 1 to 3, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 3 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.633606  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:57.634670  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:57.636758  8799 leader_election.cc:336] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.077s (SENT)
I20260709 12:10:57.637241  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:57.639355  8835 raft_consensus.cc:2410] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:57.639866  8909 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:57.642011  8829 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:10:57.609540 12022 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.643932  8835 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.625353 12054 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.652539  8835 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.657977  8835 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:10:57.643230  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44940.8us
I20260709 12:10:57.647378  8826 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:10:57.473206 12046 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.663268  8833 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:57.663843  8833 pending_rounds.cc:85] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 5
I20260709 12:10:57.664142  8833 pending_rounds.cc:107] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:57.664422  8833 raft_consensus.cc:2889] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.660194  9488 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:57.666129  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:57.588006 12026 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:57.669384  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 138918us
I20260709 12:10:57.666860  8833 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.602100 12041 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.658783  8835 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.677318  8835 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.677752  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.679850  8801 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:57.681450 12003 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.682227 12003 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.682792 12040 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.682843 11618 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.683995 11618 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.684289  8656 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 5 to 7, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:57.685269 12040 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.673992  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.689750  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:57.693902  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.641651 11719 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.725054  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:57.726182  8902 raft_consensus.cc:2410] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:57.666821 11924 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:57.728461 12050 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 12:10:57.733716 12059 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:57.763744  8835 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:10:57.768252  8835 pending_rounds.cc:85] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 5
I20260709 12:10:57.769562  8835 pending_rounds.cc:107] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:57.770707  8835 raft_consensus.cc:2889] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.778429  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:57.784967 11618 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:57.793205 11925 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.793342 11819 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.793958 11925 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.794220 11819 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.795158 11819 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.796396 11925 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.797106 11925 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.797564 11925 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:57.800770 12007 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:57.682736 12046 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:57.804538 12041 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:57.664304 12054 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.741053  8656 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 4 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:57.838274  8656 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 4 to 6, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:57.792265 11509 consensus_meta.cc:287] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
W20260709 12:10:57.797574 12006 consensus_meta.cc:287] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.871s	user 0.018s	sys 0.000s
W20260709 12:10:57.964511  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.002341  8833 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:10:57.735862 11857 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.794283 12026 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:58.065564  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.020202  8656 catalog_manager.cc:5697] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:57.997044 11998 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.148164 11934 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.000s
I20260709 12:10:57.997916 11509 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.164067  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.153060  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:58.160578  8905 consensus_meta.cc:287] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.552s	user 0.028s	sys 0.026s
I20260709 12:10:58.168440  8905 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:10:58.168741  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2250) took 1040 ms. Trace:
W20260709 12:10:58.167371  8907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.019s	sys 0.036s
W20260709 12:10:58.169440  8907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.020s	sys 0.036s
I20260709 12:10:58.170315  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:58.169138  8904 rpcz_store.cc:276] 0709 12:10:57.128368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.299888 (+171520us) service_pool.cc:224] Handling call
0709 12:10:57.300197 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.311115 (+ 10918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.311153 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.421147 (+109994us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.642891 (+221744us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.642935 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.643002 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.160059 (+517057us) raft_consensus.cc:1685] finished
0709 12:10:58.160094 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.168665 (+  8571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8022,"raft.queue_time_us":121019,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9227,"spinlock_wait_cycles":42240,"thread_start_us":175472,"threads_started":1,"wal-append.queue_time_us":235177}
I20260709 12:10:58.175385  8756 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:58.180369  8835 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:58.117403 11857 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:58.188349  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:58.189213  8752 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:58.189074 11857 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.184649  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:58.193182  8756 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:58.150058 11819 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:58.160923 11998 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.160976 11924 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.187556 11980 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:58.187472  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:58.198702  8901 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:58.185927  8656 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 4 to 5, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 5 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.200333  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.202584  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:10:58.196144 11998 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:58.199046  8835 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:58.205554  8835 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:58.207485  8835 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.213723  8835 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.198400 11719 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:58.184566 12022 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.230522  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:58.231383  9519 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.218422 11509 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:58.212387  8754 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:58.226378  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.201383 12042 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.235069  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:10:58.236685  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.237057  8759 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.239106  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.240137  8751 raft_consensus.cc:2410] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:58.240950  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:58.242379  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.243139  8874 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:58.251441  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.252513  8754 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:10:58.235275 11646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.024s	sys 0.048s
W20260709 12:10:58.254688 11646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.025s	sys 0.048s
I20260709 12:10:58.228400 11925 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:58.256179  8758 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:58.196520 12046 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:58.259965  8835 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.250509  8656 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 4, term changed from 3 to 5, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to <none>, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:10:58.263046  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:58.263890  8835 raft_consensus.cc:2376] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8. Re-sending same reply.
I20260709 12:10:58.266994  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.267838  8751 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:58.269546  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.270373  8835 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:10:58.271353  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:58.276379 12063 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:58.281235  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.281919  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2247) took 1170 ms. Trace:
I20260709 12:10:58.282267  8828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2101) took 1025 ms. Trace:
I20260709 12:10:58.248699 11840 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.249078 11934 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.234165 11819 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:58.282785  8828 rpcz_store.cc:276] 0709 12:10:57.257195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.356482 (+ 99287us) service_pool.cc:224] Handling call
0709 12:10:57.435068 (+ 78586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.452733 (+ 17665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.452776 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.453225 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.815770 (+362545us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.815833 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.815948 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.275773 (+459825us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:10:58.281881 (+  6108us) raft_consensus.cc:1685] finished
0709 12:10:58.281921 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.282184 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58119,"raft.queue_time_us":12369,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8557,"spinlock_wait_cycles":5334272,"thread_start_us":242791,"threads_started":1,"wal-append.queue_time_us":656447}
I20260709 12:10:58.243274 12042 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.282301  8901 rpcz_store.cc:276] 0709 12:10:57.111525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.140038 (+ 28513us) service_pool.cc:224] Handling call
0709 12:10:58.281653 (+1141615us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540019b254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:58.281820 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410273536}
I20260709 12:10:58.295666  8752 raft_consensus.cc:2393] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:58.290459  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.297152  8754 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:58.285354  8835 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:10:58.305133  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.263998  8656 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 2 to 3, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:58.264797 11925 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:58.292309  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.310070  8828 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:58.311264  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:58.306452  9488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.014s	sys 0.032s
W20260709 12:10:58.312002  9488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.015s	sys 0.032s
I20260709 12:10:58.312052  8828 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:58.307986  8758 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:58.289695 11840 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:58.312115  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.307274 11934 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:58.306239  8829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.020s
W20260709 12:10:58.350713  8829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.007s	sys 0.021s
I20260709 12:10:58.288134  8759 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:10:58.342617  8828 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:58.353475  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.357725  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.357780  8656 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:10:58.316104 11840 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.361562  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:58.362129  9525 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.363306  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.350512 11934 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.372269  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.373340  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.373867  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.378472 12000 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:58.379582 12042 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:58.384600  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2084) took 1150 ms. Trace:
I20260709 12:10:58.394925  8827 rpcz_store.cc:276] 0709 12:10:57.234427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.234568 (+   141us) service_pool.cc:224] Handling call
0709 12:10:58.384419 (+1149851us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540037c654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:58.384539 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465571712}
I20260709 12:10:58.386076  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.396046  9516 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:10:58.396235  8833 raft_consensus.cc:2368] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7.
I20260709 12:10:58.392978  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.394294 11934 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.406773 11898 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.397368 11819 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:58.410769  9525 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:10:58.408982  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 165917us
W20260709 12:10:58.411985  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 164572us
I20260709 12:10:58.412705  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:58.420835  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 253017us
I20260709 12:10:58.421855  9519 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:10:58.428227  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:58.430984  8827 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:58.432828  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.433758  8827 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:58.435073  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.437742  8827 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.439625  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:10:58.445997  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 216407us
I20260709 12:10:58.446774  8799 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:58.449959  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.451217  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:58.454716  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:10:58.426105  8872 connection.cc:256] RPC call timeout handler was delayed by -1.0647345219997533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:10:58.459004  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:58.453882 12054 consensus_meta.cc:287] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260709 12:10:58.464808  8724 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.452476 12013 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.473603  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2066) took 1177 ms. Trace:
I20260709 12:10:58.474030  8831 rpcz_store.cc:276] 0709 12:10:57.296647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.653384 (+356737us) service_pool.cc:224] Handling call
0709 12:10:57.678289 (+ 24905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.806066 (+127777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.806112 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.806174 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.806223 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.473354 (+667131us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000d89d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:58.473401 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.473538 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293247744}
I20260709 12:10:58.476069  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2100) took 1219 ms. Trace:
I20260709 12:10:58.476491  8832 rpcz_store.cc:276] 0709 12:10:57.256871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.290586 (+ 33715us) service_pool.cc:224] Handling call
0709 12:10:58.475888 (+1185302us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003bcc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:58.476005 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248389504}
I20260709 12:10:58.466588  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:58.453526 12033 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.460110 11729 consensus_queue.cc:1059] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:58.454928 11819 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.469353 12039 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.465085 12003 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.462472 12026 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:58.498638  8799 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:58.474460 12080 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.519374 11729 raft_consensus.cc:3055] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:58.473348 12054 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.520408 11936 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.535797 11936 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.537686 12026 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.504370 12000 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.538811 11936 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:58.501888 12042 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.504855 12078 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.540701 12078 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.541219 12078 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.506639 12039 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.542119 12039 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.507135 12033 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.505585 11819 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.545797 11819 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.547324 12033 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:58.555895  9489 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:58.534675 11729 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:58.538921 12000 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.521374 12043 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:10:58.529304 12067 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:10:58.530103 12044 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.229s	user 0.010s	sys 0.013s
I20260709 12:10:58.530478 12080 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:58.564335  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:58.564811 12042 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:10:58.601511  8756 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.498857 12013 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:58.565285 12007 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.519038 12079 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.566004  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2095) took 1319 ms. Trace:
W20260709 12:10:58.566804  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 68255.7us
I20260709 12:10:58.614665  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.615991  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.518282  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2062) took 1257 ms. Trace:
I20260709 12:10:58.569295  8832 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:58.572909  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:58.577939  8755 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:58.579770  9516 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.618428  9522 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:58.580549  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:58.587088  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:58.621121  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:58.588011  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:10:58.589552  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 135546us
I20260709 12:10:58.622921  8758 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:58.592175  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.595135  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:58.594425  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:58.623867  8831 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.624293  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.608922  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:58.584257 11857 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.584350 12000 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.634709 12013 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:58.635780 12013 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.638149  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2102) took 1380 ms. Trace:
I20260709 12:10:58.638604  8834 rpcz_store.cc:276] 0709 12:10:57.257538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.613751 (+356213us) service_pool.cc:224] Handling call
0709 12:10:57.614132 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.614536 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.614570 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.615239 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.962128 (+346889us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.310595 (+348467us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.310876 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.310954 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.637919 (+326965us) raft_consensus.cc:1685] finished
0709 12:10:58.637942 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.638085 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415597,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1473,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":4856,"thread_start_us":693760,"threads_started":2,"wal-append.queue_time_us":778877}
I20260709 12:10:58.613835  8830 rpcz_store.cc:276] 0709 12:10:57.246670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.247398 (+   728us) service_pool.cc:224] Handling call
0709 12:10:58.565822 (+1318424us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000e5954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:58.565938 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470260096}
I20260709 12:10:58.624109  9523 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:58.533936 11980 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.582165 12081 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:58.614203  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 155304us
W20260709 12:10:58.662761  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 198023us
I20260709 12:10:58.616812  8829 rpcz_store.cc:276] 0709 12:10:57.261052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.653444 (+392392us) service_pool.cc:224] Handling call
0709 12:10:57.653745 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.654207 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.654233 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.654712 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.351429 (+696717us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.516862 (+165433us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.517864 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.517979 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.518037 (+    58us) raft_consensus.cc:1685] finished
0709 12:10:58.518055 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.518213 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37870,"prepare.queue_time_us":26547,"raft.queue_time_us":749,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":16719,"spinlock_wait_cycles":22161280,"thread_start_us":702171,"threads_started":2,"wal-append.queue_time_us":666602}
I20260709 12:10:58.627681 11646 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.626535  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:58.671954  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 45517.4us
I20260709 12:10:58.673070  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:58.656908  9489 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:58.653492  8831 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:58.659690  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2249) took 1538 ms. Trace:
I20260709 12:10:58.663138  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:58.655670  8726 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:58.622323 12054 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:58.671988  9487 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:58.683848  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:10:58.671296 12044 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:58.657775 11980 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:58.643235 12082 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.655499 12076 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.614009 12042 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.721751  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:58.676690 12043 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.622880 12079 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.682534 12003 raft_consensus.cc:2764] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:58.663676  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:58.643451 12013 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.672559 11857 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:58.674695 12006 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:58.688524 12089 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.671706 12026 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:58.682369 11888 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:10:58.718138 11666 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:58.682220 11839 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:58.724496 12046 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.692718 11949 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:58.727975 11646 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:58.734927 11924 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.003s
I20260709 12:10:58.708956 12077 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:58.774202  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 151026us
I20260709 12:10:58.675446  8907 rpcz_store.cc:276] 0709 12:10:57.121579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.299181 (+177602us) service_pool.cc:224] Handling call
0709 12:10:57.315251 (+ 16070us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:57.450153 (+134902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.450201 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.462208 (+ 12007us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.170277 (+708069us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.460367 (+290090us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.659212 (+198845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.659336 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.659405 (+    69us) raft_consensus.cc:1685] finished
0709 12:10:58.659423 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.659612 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117245,"prepare.queue_time_us":326989,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":310104,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":13463,"thread_start_us":1033788,"threads_started":3,"wal-append.queue_time_us":798705}
I20260709 12:10:58.745019 12081 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.751775  9518 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.768527 12089 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.686923 11729 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.773443 11666 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.788488 12003 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.789646 11646 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.775868 12088 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:58.834092  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 162208us
W20260709 12:10:58.837800  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 163624us
I20260709 12:10:58.795310 12081 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.687125 12080 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:58.856251 12081 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.811968 11876 consensus_queue.cc:1059] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:58.812834 12077 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:58.810045 12087 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:10:58.864785  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74281.8us
I20260709 12:10:58.838759 11646 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.850471 12079 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:58.838292 12088 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.873588 12088 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.877732 12090 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:58.879761 12090 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.880900 12091 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.793643 12046 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:58.817202 11666 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:58.859459 12003 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.848037 11819 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.804406 12089 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.962739 12079 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:58.964809 12079 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:58.965601 12079 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.807029 12085 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:10:58.940814  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 283992us
I20260709 12:10:58.988474  9489 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:58.791141 11980 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.858989 11934 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.974803  8902 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:58.979313  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.005502  8901 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:59.006845  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:58.982682  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.008494  8900 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.984651  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.010089  9489 leader_election.cc:400] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7.
I20260709 12:10:59.012713  9489 leader_election.cc:403] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.013044  8907 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.880353 12090 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.971267  8904 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:59.014789  8901 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 12:10:59.019398  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 342166us
I20260709 12:10:59.022387  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.024540  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.020085  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.024372  8904 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:59.018905  8901 pending_rounds.cc:85] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 2
I20260709 12:10:59.033676  8901 pending_rounds.cc:107] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:59.034162  8901 raft_consensus.cc:2889] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:59.019531  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 327267us
I20260709 12:10:59.027194  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:58.881543 12091 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:58.973968 11509 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:59.007006 11857 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:58.955760 12039 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.051095  8909 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:59.016924 11936 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7.
I20260709 12:10:58.882161 12087 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.027321 12026 consensus_queue.cc:1243] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:59.053972  8872 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:10:59.057082  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 393348us
I20260709 12:10:59.063679  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:59.065590  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:59.081205  8900 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:10:59.085635  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 351359us
I20260709 12:10:59.043741 11980 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.022497 12006 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:10:59.048310 12086 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:10:59.120064  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 91259us
I20260709 12:10:59.054368 11857 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:10:59.062463 12026 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:10:59.131740 11949 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.132334 11949 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:10:59.134765 11949 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.136679 11949 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.139623 12093 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:59.139937 11949 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.140805 12013 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.125195 12033 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.141611 12033 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.141981 12033 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.119923 11655 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.143070 11655 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:59.143692 11949 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.143576 11655 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.127521  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.145756 11655 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.146102 11949 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.120438 12106 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.146786 11949 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.147056 12106 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:59.148209 11840 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.780s	user 0.005s	sys 0.004s
I20260709 12:10:59.140448 11646 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.116727 11888 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:10:59.146291 11655 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.151779 11655 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.152302 11655 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:59.152777 11655 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.153448 11819 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.154767 12079 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.057963 12077 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.162484 11949 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:59.164669 11898 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.002s
I20260709 12:10:59.165800  8908 raft_consensus.cc:2410] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:59.165745 12013 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.166388 11989 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.166945 11989 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.170514  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:10:59.171250  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 105712us
I20260709 12:10:59.171500  9519 raft_consensus.cc:2376] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7. Re-sending same reply.
I20260709 12:10:59.172346  8724 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:10:59.173871  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 120013us
I20260709 12:10:59.174578  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:59.118315 12022 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:59.052762 11509 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.181288  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.215116  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:59.216609  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.122126 11936 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.219015 11936 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:59.222893  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 63919.8us
I20260709 12:10:59.013675 12085 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:59.224085  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 49038.6us
I20260709 12:10:59.212999  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.126523 12042 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.127327 11857 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:59.176913 12000 consensus_meta.cc:287] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
I20260709 12:10:59.234462  8724 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:59.062821 12046 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.206759 11898 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.235569 12116 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.238999 12122 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.170619 11646 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.242364 12106 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.202643 12054 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:10:59.177402 12113 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.284372 12091 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.234037 11936 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.271665  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1870) took 1049 ms. Trace:
I20260709 12:10:59.296088  8752 rpcz_store.cc:276] 0709 12:10:58.222161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.222957 (+   796us) service_pool.cc:224] Handling call
0709 12:10:59.271404 (+1048447us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b540033d454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:59.271567 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120403200}
I20260709 12:10:59.237715 12107 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.170354 11840 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.283524 12106 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.226857 12079 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:59.234074 12109 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:59.290436  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.246340 12000 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.245644 12125 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.282641  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64688.2us
I20260709 12:10:59.260218 12097 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.126334 12086 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.314275 12107 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.258297 12042 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.312350 12022 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:59.311969 12003 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.318917 12091 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.345063 12091 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.347536 12091 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:10:59.355882 12078 consensus_meta.cc:287] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.003s
I20260709 12:10:59.359233 11509 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.333200  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:10:59.336591  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 311485us
I20260709 12:10:59.319622 12109 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:59.340937 12022 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:10:59.372555  8799 leader_election.cc:336] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.758s (SENT)
W20260709 12:10:59.377188  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44135.7us
I20260709 12:10:59.383145  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.384073  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.323442 11934 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.391274  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:10:59.392666  8900 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:10:59.393294  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.394269  8902 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:10:59.391136  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:10:59.380559 12007 consensus_meta.cc:287] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.000s
I20260709 12:10:59.409123  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.409317  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:10:59.409828  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48468.3us
I20260709 12:10:59.390246 11509 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.414577  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2078) took 1852 ms. Trace:
I20260709 12:10:59.279388 12116 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.427242  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.424166  8827 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.429025  8835 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:10:59.424665  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.424644  8826 rpcz_store.cc:276] 0709 12:10:57.561830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.179196 (+617366us) service_pool.cc:224] Handling call
0709 12:10:58.201685 (+ 22489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.463982 (+262297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.464017 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.464464 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.794211 (+329747us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.794270 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.405613 (+611343us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54003bc254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:59.405690 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.405759 (+    69us) raft_consensus.cc:1685] finished
0709 12:10:59.405779 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.414507 (+  8728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17797,"raft.queue_time_us":33805,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":75775872,"thread_start_us":501520,"threads_started":2,"wal-append.queue_time_us":508216}
I20260709 12:10:59.432597  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:59.435592  8826 raft_consensus.cc:2376] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9. Re-sending same reply.
I20260709 12:10:59.356379 12078 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.390538 12013 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.438309  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:59.438798  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.396968 12085 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.411007 11819 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.443435 12068 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 1.249s	user 0.002s	sys 0.005s
I20260709 12:10:59.355962 11666 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.387902 12109 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.518278  9523 raft_consensus.cc:1240] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:59.386629 12076 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:59.518956 11819 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.517146  8874 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:10:59.330402 12125 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.452966  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.456411 11509 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:59.466028  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.467537  8827 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
W20260709 12:10:59.506249  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 97229.6us
I20260709 12:10:59.506630  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.509502  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:59.524111  8835 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:10:59.428078 12138 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.510440  8799 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.242s (SENT)
I20260709 12:10:59.445556 12128 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.529835  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 105275us
I20260709 12:10:59.416829 12136 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:10:59.435113 12039 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.417416 11949 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.519351 11666 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.439383  8909 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:10:59.415733 12003 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.521188  8830 raft_consensus.cc:2376] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7. Re-sending same reply.
I20260709 12:10:59.551621  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.524212  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.524438  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:10:59.427783 12033 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.526255  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.526419  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:10:59.526417  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:10:59.528554  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62701.2us
I20260709 12:10:59.552397  8830 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:10:59.566293  8833 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
W20260709 12:10:59.566392  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 55995.9us
I20260709 12:10:59.567420  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.530740  8725 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.516292 11924 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.570087  8835 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:10:59.417032 12089 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.574153 12022 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.574893 11934 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.575169 12089 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.553843  8827 raft_consensus.cc:2376] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5. Re-sending same reply.
I20260709 12:10:59.576874 12125 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.577104 12128 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.577776 12128 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.533695 11949 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:10:59.578281 12128 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:59.579095 11949 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.579252 12128 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.580374 11949 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.580794 11924 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.583367 11924 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.548300 11840 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.585086  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.585410 12022 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.586133  9518 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:10:59.586019 12022 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.588801 11729 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:59.589437 12131 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:10:59.591259  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60623.7us
I20260709 12:10:59.592226  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.569772  8872 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.506042 12013 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.535125  8826 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:10:59.571496  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:59.512840 12108 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:59.524953 12076 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.598193 12116 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.552505 12117 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.599171 12117 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.599642 12076 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.601908 12117 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.603152 12107 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.573096 11998 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:59.604437 11998 consensus_queue.cc:1243] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer 005ae7a1e140481db6cc04faeb268d9c log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:59.605348 12000 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:10:59.596287 12066 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.400s	user 0.002s	sys 0.005s
I20260709 12:10:59.533146 12091 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.601972 12078 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.596791  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.594591  8872 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.611238  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.648787  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.649646  8900 raft_consensus.cc:3060] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.653568  8904 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:59.648854  8902 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:59.657110  8901 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:59.661510  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 67027.9us
I20260709 12:10:59.674364  8900 raft_consensus.cc:2468] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:59.572671 12138 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.675170  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 236926us
I20260709 12:10:59.543022 12086 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.679879  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.691962  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:59.681070  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.681823  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.692204  8902 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:10:59.694689  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.687825  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.576910 12121 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
W20260709 12:10:59.676373  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 84220us
I20260709 12:10:59.703174  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.575067 12033 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.572371 12043 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.693202  8724 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:59.604130 11509 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:10:59.737385  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44241.5us
I20260709 12:10:59.709607 11857 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.610131 12139 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 12:10:59.742174  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:10:59.743424 12139 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.743868 12139 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:10:59.744251 12139 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.744903 12033 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.685941 12117 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:59.745348 11655 consensus_meta.cc:287] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.006s
I20260709 12:10:59.745926 12013 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.746937 11989 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.677673 12146 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.689689 12085 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.745365 12033 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.747893 12085 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:59.748171 12033 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.749044 12085 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.750468 11857 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.750192 11819 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:10:59.752673  9524 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.752815 12007 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:59.753697 12054 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.745934 11655 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.754149 12054 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:10:59.703254 12108 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.755385 12108 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.755211 12054 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.755875 12108 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.709174 12091 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:10:59.757100 12054 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:59.758002 12088 consensus_meta.cc:287] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.005s
I20260709 12:10:59.758437 12088 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:10:59.759095 12111 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:59.706419 12087 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.762884  9523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 684) took 1105 ms. Trace:
I20260709 12:10:59.763348  9523 rpcz_store.cc:276] 0709 12:10:58.657019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.657615 (+   596us) service_pool.cc:224] Handling call
0709 12:10:59.352400 (+694785us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:59.352778 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.518692 (+165914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.762644 (+243952us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540074e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:59.762823 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388588032}
W20260709 12:10:59.773150  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.783735  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.757766 12091 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.784552  8906 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.796438  8751 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.796948  8751 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:10:59.799364  9518 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:59.810065  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:10:59.813120 12090 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:10:59.820960 12117 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.824049  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:10:59.824049  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.836349  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:10:59.838937 12146 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.820340  8726 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:10:59.842036  9516 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:59.843515 12117 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:59.853404 12081 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.982s	user 0.021s	sys 0.000s
I20260709 12:10:59.854072 12081 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:10:59.854744  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 685) took 1197 ms. Trace:
I20260709 12:10:59.855167  9524 rpcz_store.cc:276] 0709 12:10:58.657340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.657492 (+   152us) service_pool.cc:224] Handling call
0709 12:10:59.452191 (+794699us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:10:59.452493 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.753242 (+300749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.854505 (+101263us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400600ed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:59.854682 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698562816}
I20260709 12:10:59.857642  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38194 (request call id 2252) took 2715 ms. Trace:
I20260709 12:10:59.858072  8908 rpcz_store.cc:276] 0709 12:10:57.141739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.239000 (+ 97261us) service_pool.cc:224] Handling call
0709 12:10:59.857387 (+2618387us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400116554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:10:59.857547 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4428317440}
I20260709 12:10:59.859372  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:10:59.860162  8908 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:10:59.861112  8903 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:10:59.861414  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.639189 11840 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.861990 11840 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.862383 11840 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.588851 12022 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:10:59.704119  8909 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:10:59.865043  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.866333  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.641822 12097 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.697922  8902 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:10:59.726970 12144 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:59.728773 12137 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.714747  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:10:59.729817 12089 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:59.727604 12113 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.732043  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.676664 11666 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:10:59.734174  9488 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:10:59.861533  8903 pending_rounds.cc:85] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
I20260709 12:10:59.933825  8903 pending_rounds.cc:107] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:59.934422  8903 raft_consensus.cc:2889] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.867810  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.935580  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.936111  8908 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:10:59.938580  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.886656  8906 raft_consensus.cc:2410] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:59.700035  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.923794  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.915676  8901 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:10:59.869851  9519 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
W20260709 12:11:00.153825  8798 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.081s (SENT) [suppressed 35 similar messages]
W20260709 12:11:00.093832  8827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.010s
W20260709 12:11:00.157819  8827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.011s
W20260709 12:11:00.158519  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 443874us
I20260709 12:11:00.159432  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:00.156539  8833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.028s
I20260709 12:10:59.937103  8909 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
W20260709 12:11:00.161314  8833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.003s	sys 0.028s
I20260709 12:11:00.161818  8900 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:11:00.153117  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 365542us
W20260709 12:11:00.152942  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 346609us
I20260709 12:11:00.164973  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:00.167395  8760 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:00.153391  8905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.010s	sys 0.003s
I20260709 12:10:59.940997  8751 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:00.173123  8905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.010s	sys 0.003s
I20260709 12:11:00.174006  8751 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.156504  8799 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 2.157s (SENT)
I20260709 12:11:00.171864  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:00.175256  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.172241  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:00.172312  8902 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:11:00.175957  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.174439  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:00.176275  8799 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:00.176959  8760 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:00.171008  8725 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:00.167467  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:00.189949  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.190676  8909 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:00.191537  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.191709  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.194803  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.195091  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.195516  8832 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:00.195701  8831 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:00.196408  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:00.194804  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.197405  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:00.197922  8830 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.198168  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.190979  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.197111  8832 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.199832  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.196450  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:00.200718  8831 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:00.201726  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:00.202498  8831 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:00.204155  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.205350  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.206489  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:10:59.909314 12097 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.219238  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:00.221465  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 49293.4us
I20260709 12:10:59.919251 12111 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:00.229091  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61709.1us
I20260709 12:11:00.052008 12138 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.220501  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:00.239101  8909 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.141858 12109 consensus_meta.cc:287] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.006s
W20260709 12:11:00.146986 12140 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.382s	user 0.006s	sys 0.000s
I20260709 12:11:00.244796 11876 raft_consensus.cc:2804] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.247548  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:00.224560  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.249013  8758 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:11:00.248764 12113 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.250094  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.250016 12109 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:00.251368  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.225502  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:00.156616 12114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.005s	sys 0.011s
I20260709 12:11:00.223956  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:00.226879  8835 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:00.228261  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.252918  8760 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:00.253448 11857 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.253646  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.254099 11857 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.254595  8900 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.255527  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.256150  8760 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:00.257066 11876 raft_consensus.cc:697] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:00.258124 11876 consensus_queue.cc:237] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.230942  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:00.252481 12114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.006s	sys 0.011s
I20260709 12:11:00.230189  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:00.204859  8902 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
W20260709 12:11:00.232666  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 76195.3us
W20260709 12:11:00.261569 12147 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:11:00.261727  8902 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:00.263234  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:10:59.957182 11949 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.127463 12081 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:00.234189  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 70546.6us
W20260709 12:11:00.234057  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 499974us
I20260709 12:11:00.028759 12088 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:00.169528 12094 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.957276 11666 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.251924 12054 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.259999  8826 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:00.242636  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:00.189803 12117 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.264376  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.277643  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:00.266000  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:00.278995  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.190024 12022 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:00.281612  8908 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:00.283524  8751 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:11:00.224438 11925 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.264457  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:00.312278  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47882.7us
I20260709 12:11:00.313069  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:00.228578 12097 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.285370  9524 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:00.287075  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:00.284022  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:00.252367 12109 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.289961  8832 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:00.307309  9519 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.230085 12079 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.219370 12143 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:11:00.284548 11819 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.309137 12106 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.220911 12136 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:00.233943 12080 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.319504  9525 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:00.265872 12000 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.285431 12086 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.292188 12094 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.331045 12114 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:00.234791 12042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.009s	sys 0.016s
I20260709 12:11:00.314097 12088 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.318938 12081 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.365823 12081 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.366411 12081 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.264619 11949 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.319765 12082 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.256484 11857 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.334998 12109 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.353410 12086 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.306344 12039 consensus_queue.cc:1059] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:00.316845 12022 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:00.351745 12089 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:00.345284 12106 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:00.340186 12079 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:00.344894 12080 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.305830 12054 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.366801 12094 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:00.443969 12108 consensus_meta.cc:287] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
W20260709 12:11:00.445362 12149 log.cc:927] Time spent T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.704s	user 0.012s	sys 0.000s
I20260709 12:11:00.306999  8751 pending_rounds.cc:85] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 7
I20260709 12:11:00.306795  8760 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 4.
I20260709 12:11:00.503050  8751 pending_rounds.cc:107] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:11:00.310539  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:00.506170  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.507349  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:00.508980  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.328038 11509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.010s	sys 0.022s
W20260709 12:11:00.537369 11509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.011s	sys 0.022s
I20260709 12:11:00.538982  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.540493  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:00.510216  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 166985us
I20260709 12:11:00.509028  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 592) took 1110 ms. Trace:
I20260709 12:11:00.550770  8829 rpcz_store.cc:276] 0709 12:10:59.398005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.401405 (+  3400us) service_pool.cc:224] Handling call
0709 12:10:59.411850 (+ 10445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.462846 (+ 50996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.462884 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.464595 (+  1711us) log.cc:844] Serialized 52 byte log entry
0709 12:10:59.683849 (+219254us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:59.702673 (+ 18824us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.778733 (+ 76060us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.831843 (+ 53110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.834180 (+  2337us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b540006bb54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:10:59.834249 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.397290 (+563041us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:00.508064 (+110774us) raft_consensus.cc:1685] finished
0709 12:11:00.508123 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.508566 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136245,"prepare.queue_time_us":27758,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":32303,"raft.queue_time_us":132413,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":43533,"spinlock_wait_cycles":469196928,"thread_start_us":218783,"threads_started":1,"wal-append.queue_time_us":264547}
W20260709 12:11:00.323693  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 57807.8us
I20260709 12:11:00.322261  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.511765  8906 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:00.512048  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.503855  8751 raft_consensus.cc:2889] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.513692  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2091) took 1092 ms. Trace:
I20260709 12:11:00.328819  8909 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:00.509694  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2093) took 1087 ms. Trace:
I20260709 12:11:00.549705  8908 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.321089 11925 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.666049 11925 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:00.360154 12042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.010s	sys 0.017s
I20260709 12:11:00.689658 12034 raft_consensus.cc:3055] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:00.690335 12034 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:00.354519 12077 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.383975 12086 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.697300 12077 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.698007 12077 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.383708 12109 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.370971 12114 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:00.540416  8756 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:00.350137 12139 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:00.624984  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:00.416224 12089 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:00.429960 12080 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.657682  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:00.648412  8827 rpcz_store.cc:276] 0709 12:10:59.422171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.577706 (+155535us) service_pool.cc:224] Handling call
0709 12:10:59.578037 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.589160 (+ 11123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.589195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.589927 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 12:11:00.158473 (+568546us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.158535 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.158638 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.509024 (+350386us) raft_consensus.cc:1685] finished
0709 12:11:00.509068 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.509403 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10650,"raft.queue_time_us":17125,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":568090,"threads_started":1,"wal-append.queue_time_us":774124}
I20260709 12:11:00.635175  8833 rpcz_store.cc:276] 0709 12:10:59.421595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.567299 (+145704us) service_pool.cc:224] Handling call
0709 12:10:59.640223 (+ 72924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.640758 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.640805 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.641436 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.161835 (+520399us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:00.161879 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.161945 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.512956 (+351011us) raft_consensus.cc:1685] finished
0709 12:11:00.513004 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.513436 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6931,"raft.queue_time_us":152,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":39292,"thread_start_us":520027,"threads_started":1,"wal-append.queue_time_us":794874}
I20260709 12:11:00.674890  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.676457  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2255) took 1696 ms. Trace:
I20260709 12:11:00.682942 11655 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.684827 12000 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.687440 11857 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.670938  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1890) took 1001 ms. Trace:
I20260709 12:11:00.692062  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:00.700475  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 697) took 1858 ms. Trace:
I20260709 12:11:00.384613 12082 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:00.816778 12085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.016s	sys 0.056s
W20260709 12:11:00.817256 12085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.016s	sys 0.056s
I20260709 12:11:00.646006 12108 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.820976 12108 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:00.756120  8830 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.018s
I20260709 12:11:00.821807  8756 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:00.821942  8830 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
W20260709 12:11:00.759805  8872 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.008s
W20260709 12:11:00.824365  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 585874us
W20260709 12:11:00.825793  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 654719us
W20260709 12:11:00.760048 12128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.019s	sys 0.050s
W20260709 12:11:00.828717 12128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.019s	sys 0.051s
W20260709 12:11:00.761919  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 448758us
W20260709 12:11:00.760507  8726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.002s	sys 0.013s
I20260709 12:11:00.765640 12000 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:00.782830 12109 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.783380 12026 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:11:00.783970  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:00.785146 12079 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:00.788805  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.791474  8752 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:00.791832 11857 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.780746  8908 rpcz_store.cc:276] 0709 12:10:59.666997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.547064 (+880067us) service_pool.cc:224] Handling call
0709 12:11:00.547952 (+   888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.655208 (+107256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.668427 (+ 13219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.794209 12114 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.757659  8905 rpcz_store.cc:276] 0709 12:10:58.980279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.981385 (+  1106us) service_pool.cc:224] Handling call
0709 12:10:58.981740 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.240708 (+258968us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:59.513216 (+272508us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.189832 (+676616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.189884 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:00.189929 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.675782 (+485853us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400117954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:00.675853 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.676205 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16126,"prepare.queue_time_us":150519,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":16546,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8960,"spinlock_wait_cycles":602700800,"thread_start_us":909421,"threads_started":2,"wal-append.queue_time_us":839625}
I20260709 12:11:00.800966 12054 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.801851  9524 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
W20260709 12:11:00.801011  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 513866us
I20260709 12:11:00.802520  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 599) took 1118 ms. Trace:
I20260709 12:11:00.803596 11666 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.806191 12034 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.810735 12022 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.811688 12139 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.813169 12106 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:00.823657 12113 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.781275  8751 rpcz_store.cc:276] 0709 12:10:58.842262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.842433 (+   171us) service_pool.cc:224] Handling call
0709 12:10:58.842823 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.796312 (+953489us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002b5d20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380badc0 00007fce381451c0 00007fce38146231 00007fce38142d8f 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c
0709 12:10:59.940482 (+144170us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b4c000a8700. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3640fa20 00007fce36420a29 00007fce363e6644 00007fce3640df2d 00007fce3640db93 00007fce3813e18b 00007fce3813ecb5 00007fce38139f30 00007fce3813b7de 00007fce38145b49 00007fce38146416
0709 12:11:00.699861 (+759379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.700352 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674411136}
I20260709 12:11:00.823843  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 699) took 1005 ms. Trace:
W20260709 12:11:00.841822  8726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.002s	sys 0.014s
I20260709 12:11:00.808348 11729 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:00.869593 12046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.016s	sys 0.021s
I20260709 12:11:00.903266  8756 rpcz_store.cc:276] 0709 12:10:59.818910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.741798 (+922888us) service_pool.cc:224] Handling call
0709 12:11:00.809352 (+ 67554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.822483 (+ 13131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.823333 (+   850us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000352d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:00.823746 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27528960}
I20260709 12:11:00.890151  8909 rpcz_store.cc:276] 0709 12:10:59.683795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.801070 (+1117275us) service_pool.cc:224] Handling call
0709 12:11:00.801627 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.802058 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.802084 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.802125 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.802153 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.802205 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.802329 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:00.905329 12046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.016s	sys 0.021s
W20260709 12:11:00.919596  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 755039us
I20260709 12:11:00.930954  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.940958 11949 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:00.942094 12127 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.935585  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:00.934968  8724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.008s	sys 0.016s
I20260709 12:11:00.943604  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:00.949530 12082 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:00.949988 11509 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:00.950301  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1885) took 1174 ms. Trace:
I20260709 12:11:00.950784 11509 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.951375  8756 raft_consensus.cc:1217] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-8.6]   Dedup: 4.4->[5.5-8.6]
I20260709 12:11:00.952207  8756 pending_rounds.cc:85] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 4
I20260709 12:11:00.952050 12143 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:00.952612  8756 pending_rounds.cc:107] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:00.953012  8756 raft_consensus.cc:2889] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:00.957226  8724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.008s	sys 0.016s
I20260709 12:11:00.942703 12127 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:00.974742 11729 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:00.977753 11729 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:00.979079  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:00.979627  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:00.980960  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:00.980901  9523 raft_consensus.cc:2410] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:00.923825 12106 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.970913  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1888) took 1288 ms. Trace:
I20260709 12:11:00.974063  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:00.974932  8872 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:00.971035 12091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.038s	sys 0.038s
I20260709 12:11:00.950722  8902 rpcz_store.cc:276] 0709 12:10:59.665594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.262668 (+597074us) service_pool.cc:224] Handling call
0709 12:11:00.263003 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.263243 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:00.263269 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.263720 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.789754 (+526034us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:00.789869 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.790025 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.829577 (+ 39552us) raft_consensus.cc:1685] finished
0709 12:11:00.829599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.839895 (+ 10296us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":482628,"threads_started":1,"wal-append.queue_time_us":554255}
W20260709 12:11:00.970932  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 799093us
I20260709 12:11:00.982972  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 698) took 1164 ms. Trace:
W20260709 12:11:00.997190  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 340428us
I20260709 12:11:00.975637 12127 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.999657  8753 rpcz_store.cc:276] 0709 12:10:59.818062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.818206 (+   144us) service_pool.cc:224] Handling call
0709 12:11:00.677705 (+859499us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:11:00.678123 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.678864 (+   741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.678897 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.679578 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.896639 (+217061us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.896686 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.896766 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.982417 (+ 85651us) raft_consensus.cc:1685] finished
0709 12:11:00.982454 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.982756 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2047,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":271,"spinlock_wait_cycles":48352512,"thread_start_us":216526,"threads_started":1,"wal-append.queue_time_us":296635}
W20260709 12:11:00.993921 12091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.038s	sys 0.038s
I20260709 12:11:01.010886  8905 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:01.004351  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.015663  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60845.1us
I20260709 12:11:01.019668  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:01.020349 12033 consensus_meta.cc:287] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 1.264s	user 0.011s	sys 0.011s
I20260709 12:11:01.020884 12033 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.022789  8758 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:01.023535 12128 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.020892 12139 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:01.024115 12128 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.025115 12089 raft_consensus.cc:3055] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:01.025609 12089 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:00.985697  8904 rpcz_store.cc:276] 0709 12:10:59.666425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.522731 (+856306us) service_pool.cc:224] Handling call
0709 12:11:00.523560 (+   829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.524600 (+  1040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.528718 (+  4118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.529935 (+  1217us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.743406 (+213471us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.743475 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.746339 (+  2864us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.954651 (+208312us) raft_consensus.cc:1685] finished
0709 12:11:00.954675 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.954828 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60218,"raft.queue_time_us":25832,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":343,"thread_start_us":205652,"threads_started":1,"wal-append.queue_time_us":395892}
I20260709 12:11:01.007946 12054 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:01.029378  9519 consensus_meta.cc:287] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.014s
I20260709 12:11:00.953012 12143 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.029994  9519 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:11:01.040777  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.031751  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:01.033779  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:01.040030 12111 consensus_meta.cc:287] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.003s
I20260709 12:11:01.029933 12054 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:01.028235 12128 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.049330  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:01.058810  8798 leader_election.cc:336] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.618s (SENT)
I20260709 12:11:01.037007 11898 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.067404  8874 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:01.033438 11857 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.069342 11898 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.072041 11898 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.072732  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1898) took 1330 ms. Trace:
I20260709 12:11:01.073236  8906 rpcz_store.cc:276] 0709 12:10:59.742315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.190734 (+448419us) service_pool.cc:224] Handling call
0709 12:11:01.072442 (+881708us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001635d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:01.072649 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717136768}
I20260709 12:11:01.074187  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:01.036746 12082 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.028486 12106 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.069716  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:01.081226 12170 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.083506 12000 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.083771 12170 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.101964  8902 raft_consensus.cc:2368] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:01.087390 12113 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:01.081192 12171 raft_consensus.cc:2764] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:01.089300 12082 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.090217  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.108592  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 74956.1us
I20260709 12:11:01.088274 12143 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:01.102205 12034 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:01.026895 12089 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.078045 12111 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.114650  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:01.115599  8757 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:01.115684 12106 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:01.116796 12033 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:01.114396 12179 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:11:01.111410 11509 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:01.128001  8798 leader_election.cc:336] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.672s (SENT)
I20260709 12:11:01.112212 12113 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:01.132947  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 129097us
W20260709 12:11:01.117456  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61983.3us
I20260709 12:11:01.108769 12170 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:01.150125  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 97658.5us
W20260709 12:11:01.159497  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 130776us
I20260709 12:11:01.156088  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:01.135967 12000 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:01.158743  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:01.117419 12109 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.165005  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.119055 12077 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.178284 12184 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.150204 12143 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.173936  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:01.153301 11949 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:01.184926  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2270) took 1429 ms. Trace:
I20260709 12:11:01.208065 12185 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.208742 12185 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.209111 12185 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.209542 12086 consensus_meta.cc:287] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.009s
I20260709 12:11:01.210024 12086 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:01.212966  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.215999  8827 raft_consensus.cc:2376] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6. Re-sending same reply.
W20260709 12:11:01.202472  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53373.9us
I20260709 12:11:01.217694  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:01.220278 12111 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.220888 12111 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:01.221077  8904 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:01.222237  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1876) took 3546 ms. Trace:
I20260709 12:11:01.222054 12111 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.222702  8903 rpcz_store.cc:276] 0709 12:10:57.675566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.675912 (+   346us) service_pool.cc:224] Handling call
0709 12:10:59.860750 (+2184838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.160707 (+299957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.221784 (+1061077us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400116550. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:01.222002 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4784305536}
I20260709 12:11:01.223580  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2272) took 1474 ms. Trace:
I20260709 12:11:01.213645  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:01.225397 11819 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.226585 12082 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.227761 12000 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.156791 12022 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.229568 12022 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.229993 12109 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.231256  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.232220  9519 raft_consensus.cc:2410] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:01.181432 12137 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.232151  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.237560  8833 raft_consensus.cc:2410] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:01.184666 12143 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.224004  8904 rpcz_store.cc:276] 0709 12:10:59.748909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.027837 (+1278928us) service_pool.cc:224] Handling call
0709 12:11:01.065039 (+ 37202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.221485 (+156446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.223337 (+  1852us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540009ced4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:01.223523 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358214528}
I20260709 12:11:01.203148  8905 rpcz_store.cc:276] 0709 12:10:59.746438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.027821 (+1281383us) service_pool.cc:224] Handling call
0709 12:11:01.088776 (+ 60955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.089262 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:01.113791 (+ 24529us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.175820 (+ 62029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.175903 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.175966 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.176064 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.176253 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16812,"raft.queue_time_us":28205,"thread_start_us":45723,"threads_started":2}
I20260709 12:11:01.235324  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.238616  8903 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:01.225981 11819 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.132404 12054 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.236747 12022 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:01.267103  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 64971.4us
W20260709 12:11:01.264441  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.213307 11924 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.274925 12125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.378s	user 0.031s	sys 0.031s
W20260709 12:11:01.275326 12125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.031s	sys 0.031s
I20260709 12:11:01.276355 12026 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.277170 12026 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.279625 12026 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.273351 11509 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.281257 11509 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:01.281678 11509 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.282765 12158 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.283628 12158 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:01.284932 12158 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:01.288460  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 175851us
W20260709 12:11:01.289324  8798 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.720s (SENT)
W20260709 12:11:01.291689  8798 leader_election.cc:336] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.832s (SENT)
I20260709 12:11:01.292145  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:01.292827 12081 consensus_meta.cc:287] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.006s
I20260709 12:11:01.293378 12081 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.301148  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.301893  8829 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 2.
I20260709 12:11:01.303536  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.303921 12000 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:01.306437  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.307284  8834 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.249305 12143 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.270226  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.272468 11949 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.273298 12106 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.273955  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:01.303848 11840 consensus_meta.cc:287] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.441s	user 0.007s	sys 0.012s
I20260709 12:11:01.309168 12081 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:01.272745  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 105975us
W20260709 12:11:01.306815  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.321067  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:01.330108  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 347191us
I20260709 12:11:01.322156  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.321950  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.267462 12089 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:01.231748 12185 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.351353  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:01.357415  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.370385  9516 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:11:01.371404  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 97653.7us
W20260709 12:11:01.349364 12189 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
W20260709 12:11:01.377067 12097 consensus_meta.cc:287] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.003s
I20260709 12:11:01.377357 12137 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.378162  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 86514us
I20260709 12:11:01.378844  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.379434  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.381991 12185 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:01.397419  8827 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:01.395783  8833 raft_consensus.cc:2410] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:01.382349 11949 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:01.349499 12000 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.383545 12140 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:11:01.407748  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 72841.9us
I20260709 12:11:01.334879 12086 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:01.388872  9524 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
W20260709 12:11:01.392158  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 65430.8us
I20260709 12:11:01.410727  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.306509 11819 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.389132  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.412562  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.419685  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:01.426620  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.395756 12109 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:01.349794 11840 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.440742  8833 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:01.426577  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.446663  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:01.446998  8755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1884) took 1636 ms (client timeout 1909 ms). Trace:
I20260709 12:11:01.447588  8754 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:01.449925 11509 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.446687  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:01.454200  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.454741 11840 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:01.455391  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.457281  8833 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:01.458436 12086 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:01.459050 12086 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:01.459301  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.459476 12086 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:01.461041  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 59786.9us
I20260709 12:11:01.465757 11666 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:01.467311  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.448529  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.468480  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:01.456563  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:01.447433  8755 rpcz_store.cc:269] 0709 12:10:59.810419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.811145 (+   726us) service_pool.cc:224] Handling call
0709 12:11:01.254414 (+1443269us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b5800002a98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:11:01.446912 (+192498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19984256}
I20260709 12:11:01.470546  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.501935  8834 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:01.463966 12170 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:01.431728 12106 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.452468 11509 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:01.561412  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.555892  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:01.500663  8835 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:01.403517 12097 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.566696  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 121390us
I20260709 12:11:01.550379  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.466868  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:01.554177  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.428319 12000 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.573475 12197 log.cc:927] Time spent T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 12:11:01.573776  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.574692  8828 raft_consensus.cc:2393] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:01.575659  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.577185 12114 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.576436  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:01.577791 12114 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:01.578429 12114 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:01.580835  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 114030us
W20260709 12:11:01.554248  8799 leader_election.cc:336] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.618s (SENT)
I20260709 12:11:01.500331 12081 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.424255 12113 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.572256  8832 raft_consensus.cc:2368] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:01.444860 12109 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.586030  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:01.576448  8828 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:01.445367 12127 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.621155  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:01.556212 12106 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:01.569171 11840 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.628684  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 164438us
I20260709 12:11:01.571144 12077 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:01.567091 12089 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.641050  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.644325  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.644858  8907 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:01.645982  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:01.646468 12201 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:11:01.649442  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 95221.7us
W20260709 12:11:01.650661  8799 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.720s (SENT)
I20260709 12:11:01.651199  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:01.644466  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.668866  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 49770.5us
I20260709 12:11:01.512507 12054 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:11:01.619169 11949 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.670809  8908 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:01.669955  8754 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:01.673630  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:01.686290  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:01.690267  9519 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.499568 12137 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:01.632460 12106 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.745311  8901 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:01.632105 12046 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.764876  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.767082  8834 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
W20260709 12:11:01.771342  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.777313  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 381653us
I20260709 12:11:01.694911 11819 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:01.745632  9520 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:01.885859  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 174810us
W20260709 12:11:01.835007  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 55416.7us
I20260709 12:11:01.881381  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:01.640204 12081 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.903465  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.904407  8830 raft_consensus.cc:2393] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:01.640974 11840 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.888744  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 109183us
I20260709 12:11:01.767374 12082 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:01.833343 11509 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:01.882236  9489 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:01.694698 12158 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.914426  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:01.687466 11949 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.918625  8828 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
W20260709 12:11:01.925067  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.759827 12089 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:01.921954  8798 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.896s (SENT)
W20260709 12:11:01.922183 12207 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 12:11:01.943331  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:01.888092 11819 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:01.913475 12046 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:01.966034  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 60417.4us
W20260709 12:11:01.947468  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 65386.7us
I20260709 12:11:01.976483 12169 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:01.980059 11819 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:01.980568  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61011.6us
W20260709 12:11:01.981637 12216 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:11:01.981915 12046 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:01.983083  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:01.984146  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 600) took 2291 ms. Trace:
W20260709 12:11:01.979900  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 65645.2us
W20260709 12:11:01.985229 12206 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:11:01.985924 11876 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:01.986781 12209 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:11:01.987627 11509 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:02.059804 11509 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:01.989187  8828 raft_consensus.cc:1275] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:01.989372 12208 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:11:02.061203 11898 consensus_meta.cc:287] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.989s	user 0.013s	sys 0.004s
I20260709 12:11:02.061630 11898 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:02.064505 12094 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.999476  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1878) took 2191 ms (client timeout 1531 ms). Trace:
I20260709 12:11:02.002305  8751 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.006328 12089 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:02.011417  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:02.012586 12213 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:11:02.014029 11840 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:01.947227 12143 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.004s
W20260709 12:11:02.014720 12150 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.620s	user 0.003s	sys 0.000s
I20260709 12:11:02.018126  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1904) took 1191 ms. Trace:
I20260709 12:11:01.937325 11949 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.979650  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 329012us
I20260709 12:11:02.039580  9519 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:11:02.052210  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.971827 12097 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:02.067869  9489 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:02.065958  8757 rpcz_store.cc:269] 0709 12:10:59.808042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.808230 (+   188us) service_pool.cc:224] Handling call
0709 12:11:01.999175 (+2190945us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400038ed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:01.999361 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2991690624}
I20260709 12:11:02.070864  8754 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:02.091892  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.041883  8909 rpcz_store.cc:276] 0709 12:10:59.692530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.016857 (+1324327us) service_pool.cc:224] Handling call
0709 12:11:01.070067 (+ 53210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.153382 (+ 83315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.153425 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.249129 (+ 95704us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.547175 (+298046us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.547222 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.548042 (+   820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.983788 (+435746us) raft_consensus.cc:1685] finished
0709 12:11:01.983823 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.984051 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18348,"raft.queue_time_us":35170,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"spinlock_wait_cycles":3328,"thread_start_us":199250,"threads_started":1,"wal-append.queue_time_us":381329}
I20260709 12:11:02.063825 11898 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:02.089201  8908 rpcz_store.cc:276] 0709 12:11:00.827094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.925284 (+ 98190us) service_pool.cc:224] Handling call
0709 12:11:02.017853 (+1092569us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540009c4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:02.018011 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667838336}
I20260709 12:11:02.094020  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:02.067488 12113 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:02.066005 11876 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.971619 12158 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:01.977171 12082 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:02.059834 12128 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.000s
W20260709 12:11:02.125720  8760 consensus_meta.cc:287] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.004s
I20260709 12:11:02.126642  8760 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
W20260709 12:11:02.126926  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 143982us
I20260709 12:11:02.127177  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.135708  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.136444  8757 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
I20260709 12:11:02.137382  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.138481  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:02.139500  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:02.140112  8759 consensus_meta.cc:287] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.555s	user 0.003s	sys 0.004s
W20260709 12:11:02.142604 12211 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:11:02.145031  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.103288 12022 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:02.140506  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.140491  8759 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:11:02.153102  8754 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:02.156669  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.118980 11876 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.117552 12127 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:02.147023 12216 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:11:02.167490  8906 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:11:02.168686  8757 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:02.093247 12046 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:02.096184 12143 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:02.170634  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1883) took 2505 ms. Trace:
W20260709 12:11:02.178840  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 135742us
I20260709 12:11:02.186944  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:02.146247 11819 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:02.193054  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:02.185654  8901 rpcz_store.cc:276] 0709 12:10:59.665031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.253332 (+588301us) service_pool.cc:224] Handling call
0709 12:11:02.146180 (+1892848us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400116a54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:02.170553 (+ 24373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3164686080}
I20260709 12:11:02.161360 12169 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:02.198282  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.202031  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:02.153667 12128 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:02.171914 12109 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:02.199955  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.209959  8757 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:02.197280 12086 consensus_meta.cc:287] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.735s	user 0.015s	sys 0.000s
I20260709 12:11:02.171145 11924 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.214409  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.219398  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.199131  9518 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.223850  8757 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:02.218627  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1890) took 1984 ms (client timeout 1610 ms). Trace:
W20260709 12:11:02.224221 12156 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 1.835s	user 0.006s	sys 0.000s
I20260709 12:11:02.227097  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1887) took 2560 ms. Trace:
W20260709 12:11:02.228725 12080 consensus_meta.cc:287] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 1.345s	user 0.016s	sys 0.000s
W20260709 12:11:02.230976 12114 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.004s
I20260709 12:11:02.234373  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.239934  8907 rpcz_store.cc:276] 0709 12:10:59.666163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.516502 (+850339us) service_pool.cc:224] Handling call
0709 12:11:00.517234 (+   732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.645424 (+1128190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.226680 (+581256us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b5400282154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:02.227005 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183635840}
I20260709 12:11:02.243814  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:02.233530  8758 rpcz_store.cc:269] 0709 12:11:00.228763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.251117 (+ 22354us) service_pool.cc:224] Handling call
0709 12:11:02.199375 (+1948258us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540008acd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:02.213522 (+ 14147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771432704}
W20260709 12:11:02.189738  8827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.012s
W20260709 12:11:02.248936  8827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.009s	sys 0.012s
I20260709 12:11:02.212602 12137 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:02.265333  8752 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:02.247048 12114 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:02.246258 12081 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:02.247581 12054 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.305034  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 602) took 2025 ms. Trace:
I20260709 12:11:02.240458 12222 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.218066 12086 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:02.336783  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 280866us
I20260709 12:11:02.318745  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:02.250463 12113 consensus_queue.cc:1048] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:11:02.242439 12080 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:02.345387  8757 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:02.318432 12222 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.348359 12222 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.317278 12054 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:02.350171 12054 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.351655  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:02.354957  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:02.356217  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.356302 12128 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:02.349355  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 427394us
I20260709 12:11:02.316243  8902 rpcz_store.cc:276] 0709 12:11:00.279475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.151774 (+872299us) service_pool.cc:224] Handling call
0709 12:11:01.152255 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.174478 (+ 22223us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:01.348775 (+174297us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.560227 (+211452us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.592386 (+ 32159us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.592567 (+   181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.592604 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.592696 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.223891 (+631195us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b48001e0258. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3d06caa1 00007fce3d063b37 00007fce3d0639ca 00007fce3d15b26f 00007fce3d15af37 00007fce3d16f55c 00007fce3d16f508 00007fce3d16f488 00007fce3d16f443 00007fce3d16e6ec 00007fce3c098a96
0709 12:11:02.304702 (+ 80811us) raft_consensus.cc:1685] finished
0709 12:11:02.304802 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.304963 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84558,"prepare.queue_time_us":39279,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":28773,"raft.run_cpu_time_us":2695,"raft.run_wall_time_us":678452,"spinlock_wait_cycles":24835840,"thread_start_us":238172,"threads_started":2,"wal-append.queue_time_us":140899}
I20260709 12:11:02.359951  8874 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:02.357010  8757 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:11:02.412093  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 67383.4us
W20260709 12:11:02.417652 12157 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.983s	user 0.004s	sys 0.004s
I20260709 12:11:02.420578 11876 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:02.421802  8827 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:11:02.423341  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 705) took 1340 ms (client timeout 1565 ms). Trace:
I20260709 12:11:02.426308  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:02.426549 12097 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:02.423954  8760 rpcz_store.cc:269] 0709 12:11:01.103550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.111164 (+  7614us) service_pool.cc:224] Handling call
0709 12:11:02.423080 (+1311916us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400030cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:02.423253 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756314880}
I20260709 12:11:02.317732 12137 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:02.431380 12082 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:02.441048  8798 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.041s (SENT)
W20260709 12:11:03.164752  9487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.028s
W20260709 12:11:03.170068  9487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.007s	sys 0.028s
I20260709 12:11:02.495631 12097 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:02.431041 11876 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:03.166704  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.573362  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2133) took 1123 ms. Trace:
W20260709 12:11:03.174244  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.428125 12143 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:03.182624  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 992127us
I20260709 12:11:03.187848 12249 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:03.188345  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:02.533414  8900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1891) took 2603 ms. Trace:
I20260709 12:11:03.177630  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 716) took 1129 ms. Trace:
I20260709 12:11:03.183795  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 599) took 1632 ms. Trace:
W20260709 12:11:03.120276 11840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.027s
I20260709 12:11:02.534456 12171 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:03.186707  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.188457 12249 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.190438  8834 rpcz_store.cc:276] 0709 12:11:01.551835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.770915 (+219080us) service_pool.cc:224] Handling call
0709 12:11:01.893515 (+122600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.921171 (+ 27656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.921199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.934313 (+ 13114us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.306701 (+372388us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:02.306757 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.306854 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.183489 (+876635us) raft_consensus.cc:1685] finished
0709 12:11:03.183516 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.183727 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11813,"raft.queue_time_us":105513,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":293496,"threads_started":1,"wal-append.queue_time_us":1166146}
I20260709 12:11:03.072777 12217 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.189354  8900 rpcz_store.cc:276] 0709 12:10:59.667263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.781111 (+1113848us) service_pool.cc:224] Handling call
0709 12:11:00.804512 (+ 23401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.010300 (+205788us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:01.334293 (+323993us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.559935 (+225642us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.631626 (+ 71691us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.631826 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.631872 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.631959 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.269997 (+638038us) raft_consensus.cc:1685] finished
0709 12:11:02.270025 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.270238 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46135,"prepare.queue_time_us":133893,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":49269,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":8298,"thread_start_us":480164,"threads_started":3,"wal-append.queue_time_us":255633}
I20260709 12:11:03.189484  8758 rpcz_store.cc:276] 0709 12:11:02.048376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.287902 (+239526us) service_pool.cc:224] Handling call
0709 12:11:02.333275 (+ 45373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.337466 (+  4191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.337500 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.348349 (+ 10849us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.582135 (+233786us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:02.582243 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.582393 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.177361 (+594968us) raft_consensus.cc:1685] finished
0709 12:11:03.177388 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.177561 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":589,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":66804,"thread_start_us":233255,"threads_started":1,"wal-append.queue_time_us":827201}
I20260709 12:11:03.194584  8760 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:11:03.195789 12054 consensus_meta.cc:287] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.000s
I20260709 12:11:03.173947  8835 rpcz_store.cc:276] 0709 12:11:01.450098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.669746 (+219648us) service_pool.cc:224] Handling call
0709 12:11:01.761695 (+ 91949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.921574 (+159879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.921618 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.964363 (+ 42745us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.166241 (+201878us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.167569 (+  1328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.167978 (+   409us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.573123 (+405145us) raft_consensus.cc:1685] finished
0709 12:11:02.573141 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.573295 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101853,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":139253,"threads_started":1,"wal-append.queue_time_us":469764}
I20260709 12:11:02.432053 12113 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.197830  8826 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:02.860936 12106 consensus_meta.cc:287] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.002s
I20260709 12:11:03.209221 12085 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:02.451152 12183 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.774s
W20260709 12:11:02.523896  9525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35690 (request call id 598) took 2878 ms (client timeout 1783 ms). Trace:
I20260709 12:11:03.204439  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 717) took 1150 ms. Trace:
W20260709 12:11:03.198184 11840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.000s	sys 0.028s
I20260709 12:11:03.236864  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.237669  8760 raft_consensus.cc:2368] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:03.203274 12143 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:03.227478  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 794653us
I20260709 12:11:03.203697  8754 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:03.233865  8757 rpcz_store.cc:276] 0709 12:11:02.048667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.182608 (+1133941us) service_pool.cc:224] Handling call
0709 12:11:03.198963 (+ 16355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.199149 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.199176 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.199223 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.199253 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.199312 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.199417 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:03.199684 12237 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:03.208573  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:03.233779  9525 rpcz_store.cc:269] 0709 12:10:59.645326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.653936 (+  8610us) service_pool.cc:224] Handling call
0709 12:11:02.515851 (+2861915us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400501754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:02.523668 (+  7817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439181056}
I20260709 12:11:03.244103  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.246212  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1910) took 1225 ms. Trace:
I20260709 12:11:03.246171  8834 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:03.248205 12237 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.248251 12085 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.250953 12237 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:03.246799  8754 rpcz_store.cc:276] 0709 12:11:02.020267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.268142 (+247875us) service_pool.cc:224] Handling call
0709 12:11:03.198265 (+930123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.245623 (+ 47358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.245884 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:03.240813 11949 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.004s
I20260709 12:11:03.256225  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.256914  8834 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:03.205420 12171 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.214581 12106 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.211723 12217 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:03.254690 12222 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.007s
I20260709 12:11:03.261163  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.262009  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.243862 12143 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.268997  8754 raft_consensus.cc:2410] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:03.268604  8834 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.210978 12054 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.271898  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.287053 12170 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:03.287540  8757 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:11:03.275063  8798 connection.cc:256] RPC call timeout handler was delayed by -1.2683195740000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24460000000000004s for a response
W20260709 12:11:03.288987  8798 connection.cc:256] RPC call timeout handler was delayed by -1.2486186629998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 12:11:03.290701  8798 connection.cc:256] RPC call timeout handler was delayed by -1.0592679939998106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 12:11:03.270843 12143 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.267040 12085 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:03.300786  9522 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.258682 11949 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.245440 12097 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.305781 12137 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:03.305835 12248 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:03.306617 12137 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.308871 12089 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.309356 12089 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.310855  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 692) took 1966 ms. Trace:
I20260709 12:11:03.313530  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.315267  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.315835  8835 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.270668 12222 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.322036 12222 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:03.327421  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2107) took 3133 ms. Trace:
I20260709 12:11:03.327895  8831 rpcz_store.cc:276] 0709 12:11:00.193756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.203168 (+  9412us) service_pool.cc:224] Handling call
0709 12:11:00.203417 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.686222 (+482805us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:00.924218 (+237996us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.404178 (+479960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.404247 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.404306 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.326985 (+1922679us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54003bc254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:03.327042 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.327231 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49811,"prepare.queue_time_us":289297,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":55136,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14727,"spinlock_wait_cycles":945297792,"thread_start_us":616238,"threads_started":2,"wal-append.queue_time_us":530164,"wal-append.run_cpu_time_us":2647,"wal-append.run_wall_time_us":1589671}
W20260709 12:11:03.335974 12235 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:03.337976  8757 raft_consensus.cc:2410] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:03.311280 12089 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:03.389415  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.387888  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.390633  8757 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.393523  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.396323  8826 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:03.394407  8758 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:03.398543  8834 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:03.400314  8831 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:03.400252  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.401830  8754 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:03.405671  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.406306  8826 raft_consensus.cc:2376] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10. Re-sending same reply.
I20260709 12:11:03.311265  9520 rpcz_store.cc:276] 0709 12:11:01.333189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.399647 (+ 66458us) service_pool.cc:224] Handling call
0709 12:11:01.446426 (+ 46779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.888330 (+441904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.273628 (+1385298us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400571054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:03.297140 (+ 23512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446185344}
I20260709 12:11:03.409313  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.413033  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.415585  8831 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.416867  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.404481 12137 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:03.419708  8798 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.753s (SENT)
I20260709 12:11:03.424746  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.425134  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.408456 12249 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:03.436548  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 270543us
W20260709 12:11:03.438561  8798 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.942s (SENT)
I20260709 12:11:03.438467  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.439388  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:03.438364  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 612) took 1087 ms. Trace:
I20260709 12:11:03.424494 11949 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:03.445834  8834 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:03.428107 12171 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:03.456255  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.462503  8826 raft_consensus.cc:2393] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:03.452973  8832 rpcz_store.cc:276] 0709 12:11:02.350982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.424124 (+ 73142us) service_pool.cc:224] Handling call
0709 12:11:02.430009 (+  5885us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.500591 (+ 70582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.500645 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.652134 (+151489us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.233174 (+581040us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.435662 (+202488us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.437496 (+  1834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.437576 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.437617 (+    41us) raft_consensus.cc:1685] finished
0709 12:11:03.437635 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.438297 (+   662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":903,"prepare.queue_time_us":202445,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":76707,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":12656,"thread_start_us":617668,"threads_started":2,"wal-append.queue_time_us":550901}
I20260709 12:11:03.469468  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.472311  8834 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.468993  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.471176  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.474866  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.477741  8832 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:03.445749 12106 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:03.482683  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44156us
I20260709 12:11:03.481885  9489 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:03.484467  8798 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.950s (SENT)
I20260709 12:11:03.484812 12249 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.485595 12249 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:03.486984 12249 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.493551  8754 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:03.469985  9520 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.478919 12170 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.499323  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.500303  8826 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:03.471259 12199 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.502184 12199 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:03.503278 12199 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.505204  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.513193  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:03.514081 12253 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.514497 12253 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:03.469568  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:03.530200  8835 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:03.504417 12199 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.536439  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.529080  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
W20260709 12:11:03.540724  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 56300.3us
I20260709 12:11:03.540732  9517 raft_consensus.cc:606] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:03.529215 12253 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.541818  8834 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:03.539740  8758 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:03.544981  8832 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.550534  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.551621  8900 raft_consensus.cc:2368] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:03.552804  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.542229 12106 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.558306  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.532532 12079 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:03.560120  8902 raft_consensus.cc:2368] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:11:03.559875  8757 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:11:03.552646  9518 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 10: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:03.560686  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:03.566047  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.568100  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.568979  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.570390  8757 raft_consensus.cc:2393] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:03.571759  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:03.572697  8798 leader_election.cc:336] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.081s (SENT)
I20260709 12:11:03.566883 12106 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.576125  8901 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.577692 12106 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:03.582757  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:03.574754  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.583709  8757 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:03.587481  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.588104  8900 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.588965 11949 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.589949 11840 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.590441 11840 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.590842 11840 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.591039  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.591738  8758 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:03.592585  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.593444  8758 raft_consensus.cc:2410] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:03.593638  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.594223  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.594149  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.594962  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:03.595314  8901 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.595609  8902 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.599145  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.614173  8757 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:03.602473  8798 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.929s (SENT)
I20260709 12:11:03.615758  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:03.620781  8900 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:03.627118  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.628208  8834 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.625175  8874 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:03.636572  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.640458  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.648751  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.650952  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:03.588538 12143 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.634562 11949 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.659936  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:03.619397 12137 consensus_queue.cc:1059] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:03.661788  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.662731  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:03.672245  8834 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:03.671838  8874 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:03.677063  8907 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:03.677850  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.675478  8758 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:03.647354 12258 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.673987 12249 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:03.681311 12249 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.683756 12249 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:03.684599  8835 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.687885 12143 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:03.691280  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 88838.8us
I20260709 12:11:03.677650 12255 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.692530 12106 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.695503 12255 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:03.695910  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.696735  8758 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:03.697652  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:03.698180  8758 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.700232 12217 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:03.692533  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.701967  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49173.3us
I20260709 12:11:03.703953  8835 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:03.705305  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.705801  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:03.706400  8757 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:03.681267 12258 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:03.708528  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:03.714412  8900 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:03.716157 12258 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.718206  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.718990  8757 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:03.721377  8755 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:03.722059  8755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1918) took 1207 ms. Trace:
I20260709 12:11:03.723270  8755 rpcz_store.cc:276] 0709 12:11:02.515217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.707367 (+1192150us) service_pool.cc:224] Handling call
0709 12:11:03.717651 (+ 10284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.721814 (+  4163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.722004 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:03.725878  8835 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:03.727247  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.731696 12137 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.732291 12137 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:03.733503 12137 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.735261 12137 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.737010  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.747902  8758 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
W20260709 12:11:03.750532 12094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.675s	user 0.015s	sys 0.046s
I20260709 12:11:03.765843  8901 raft_consensus.cc:2410] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:03.769826  8835 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:03.755643 12183 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.771953 12183 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:03.774616 12183 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:03.775203 12215 log.cc:927] Time spent T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.643s	user 0.010s	sys 0.014s
I20260709 12:11:03.776479  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2130) took 2327 ms. Trace:
I20260709 12:11:03.777171  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:03.776968  8829 rpcz_store.cc:276] 0709 12:11:01.449078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.454102 (+  5024us) service_pool.cc:224] Handling call
0709 12:11:01.454436 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.454938 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.454966 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.455619 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.580876 (+125257us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:01.580923 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.580988 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.774594 (+2193606us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:03.776160 (+  1566us) raft_consensus.cc:1685] finished
0709 12:11:03.776189 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.776406 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1425,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":13042944,"thread_start_us":124760,"threads_started":1,"wal-append.queue_time_us":587969}
I20260709 12:11:03.778584 12106 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.779524  8829 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.782110  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2273) took 3936 ms. Trace:
I20260709 12:11:03.696579 12255 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:03.782668  8900 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:03.782529  8906 rpcz_store.cc:276] 0709 12:10:59.845696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.074274 (+1228578us) service_pool.cc:224] Handling call
0709 12:11:02.160779 (+1086505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.179498 (+ 18719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.781907 (+1602409us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400116a50. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:03.782049 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485954304}
I20260709 12:11:03.777578  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:03.786487  8752 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:11:03.791692  8831 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:03.795499  8829 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:11:03.769627 12094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.015s	sys 0.046s
I20260709 12:11:03.809275  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:03.799350 12230 log.cc:927] Time spent T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.456s	user 0.014s	sys 0.011s
I20260709 12:11:03.833686 11840 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:03.836796  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.841750  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:03.847998  8906 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:03.861052  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1896) took 2281 ms. Trace:
I20260709 12:11:03.861637  8756 rpcz_store.cc:276] 0709 12:11:01.579501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.008727 (+429226us) service_pool.cc:224] Handling call
0709 12:11:02.009120 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.009562 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.009588 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.010226 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 12:11:02.167488 (+157262us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.211500 (+ 44012us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.211774 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.211865 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.772677 (+1560812us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18004952e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:03.785220 (+ 12543us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:03.860726 (+ 75506us) raft_consensus.cc:1685] finished
0709 12:11:03.860758 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.860963 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13577,"prepare.queue_time_us":43815,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":17345,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":16177,"spinlock_wait_cycles":243850496,"thread_start_us":144052,"threads_started":1,"wal-append.queue_time_us":260659}
I20260709 12:11:03.869104  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:03.879665  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:03.880832  8828 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:03.885205  8798 leader_election.cc:336] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.952s (SENT)
I20260709 12:11:03.886118  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:03.840358 11840 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:03.960549  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:03.971127  8902 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:11:03.972499 12275 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:11:03.963969 12237 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:04.019104  8872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.009s	sys 0.026s
W20260709 12:11:04.024966  8872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.009s	sys 0.026s
I20260709 12:11:04.025558  8828 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:04.029795 12171 raft_consensus.cc:993] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:04.030320  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:04.052094  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 82458.6us
I20260709 12:11:04.052292  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:04.053488  8829 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:04.054639  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.056361  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:04.062690  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 874349us
I20260709 12:11:04.083551  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:04.085873  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 200695us
W20260709 12:11:04.086894  8798 leader_election.cc:336] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 3.028s (SENT)
I20260709 12:11:04.073124 12164 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:04.095156  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.105073  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:04.092223 12253 consensus_meta.cc:287] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 12:11:04.118357  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:04.107412 12164 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:11:04.122826 12279 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:11:04.122586  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.129582  8835 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:04.126840 12274 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:11:04.134130 12255 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.140175  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1886) took 2754 ms. Trace:
I20260709 12:11:04.140367  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.141568 12158 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.164487  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.164808  8751 rpcz_store.cc:276] 0709 12:11:01.385549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.395562 (+ 10013us) service_pool.cc:224] Handling call
0709 12:11:02.002100 (+606538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.070055 (+ 67955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.139817 (+2069762us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400038ed0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:04.140049 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356021120}
I20260709 12:11:04.166018  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.166390 12054 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.167259 11509 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.167769 11509 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.168139 11509 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.169708  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.170400  8753 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:04.169260  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.171093  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1898) took 2154 ms. Trace:
I20260709 12:11:04.171692  8908 raft_consensus.cc:2410] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:04.172988  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.174198  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.148512  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:04.174929  8829 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.175364 12247 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.176067 12247 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:04.176532 12247 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:11:04.170486  8724 connection.cc:256] RPC call timeout handler was delayed by -1.5453762849999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:11:04.177140  8724 connection.cc:256] RPC call timeout handler was delayed by -1.4958762849998948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:11:04.177459  8724 connection.cc:256] RPC call timeout handler was delayed by -1.119403476999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:11:04.177821  8724 connection.cc:256] RPC call timeout handler was delayed by -1.0971762849999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 12:11:04.178112  8724 connection.cc:256] RPC call timeout handler was delayed by -1.0672034769997936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:11:04.177625 12247 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:04.178385  8724 connection.cc:256] RPC call timeout handler was delayed by -1.0530762849998609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 12:11:04.171463  8753 rpcz_store.cc:276] 0709 12:11:02.017030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.169781 (+2152751us) service_pool.cc:224] Handling call
0709 12:11:04.170180 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.170847 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.171041 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.149339  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:04.180989  8828 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
W20260709 12:11:04.144140 12218 log.cc:927] Time spent T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.725s	user 0.001s	sys 0.025s
I20260709 12:11:04.150442  8834 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:04.151211  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:04.127792  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:04.174347  8799 connection.cc:256] RPC call timeout handler was delayed by -1.8691457869999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4537s for a response
W20260709 12:11:04.183809  8799 connection.cc:256] RPC call timeout handler was delayed by -1.4204105769999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 12:11:04.184409  8799 connection.cc:256] RPC call timeout handler was delayed by -1.3792193350000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:11:04.184827  8799 connection.cc:256] RPC call timeout handler was delayed by -1.2670067439999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 12:11:04.163968  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.186702  8906 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
W20260709 12:11:04.162485  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.188115  8801 connection.cc:256] RPC call timeout handler was delayed by -1.1063016809998771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:11:04.185271  8799 connection.cc:256] RPC call timeout handler was delayed by -1.2305105770001319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:11:04.188947  8799 connection.cc:256] RPC call timeout handler was delayed by -1.0505105770000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
I20260709 12:11:04.188989 12022 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:04.189306  8799 connection.cc:256] RPC call timeout handler was delayed by -1.0330071419998603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 12:11:04.184963  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.189581 12022 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.190215  8902 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.191004 12237 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.191530 12237 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.191890 12022 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.192473 12022 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:04.192945 12022 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.193743 12237 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.195024 12022 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.189621  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.203469  8829 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:04.110734 12253 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.206614 12253 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.207317  9518 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:04.209185  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.209901  8906 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:04.215754  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2132) took 2766 ms. Trace:
I20260709 12:11:04.221225  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:04.222265  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.223682  8826 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.216141  8833 rpcz_store.cc:276] 0709 12:11:01.449770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.460254 (+ 10484us) service_pool.cc:224] Handling call
0709 12:11:01.460679 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.461553 (+   874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.461592 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.462162 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.670415 (+208253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.121798 (+451383us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.123150 (+  1352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.123246 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.143291 (+2020045us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:04.201348 (+ 58057us) raft_consensus.cc:1685] finished
0709 12:11:04.215525 (+ 14177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.215686 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221889,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4142,"raft.queue_time_us":2027,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":20772,"spinlock_wait_cycles":51478272,"thread_start_us":480334,"threads_started":2,"wal-append.queue_time_us":945133}
I20260709 12:11:04.229682  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.222908  8905 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:04.234472 12217 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:04.237430 12232 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.880s	user 0.015s	sys 0.009s
I20260709 12:11:04.238047  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:04.239373  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 49888.3us
I20260709 12:11:04.229305  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.239872  8907 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:04.243855  8900 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:04.212244 12022 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.238750 12137 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:04.249913  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.250355 12171 raft_consensus.cc:1081] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:04.253811  8724 leader_election.cc:400] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:11:04.254163  8724 leader_election.cc:403] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:04.254375  8905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:04.254992  8724 leader_election.cc:400] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:04.255088  8905 raft_consensus.cc:606] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:04.256103 12269 raft_consensus.cc:3060] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.202548 12164 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:04.255373  8724 leader_election.cc:403] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:04.258368  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2113) took 1081 ms. Trace:
I20260709 12:11:04.261510  8832 rpcz_store.cc:276] 0709 12:11:03.176597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.529242 (+352645us) service_pool.cc:224] Handling call
0709 12:11:03.542849 (+ 13607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.548182 (+  5333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.258155 (+709973us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5400216bd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:04.258307 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8357632}
W20260709 12:11:04.269320  8725 connection.cc:256] RPC call timeout handler was delayed by -1.2231784359998983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:11:04.268390  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 67979us
W20260709 12:11:04.271862  8725 connection.cc:256] RPC call timeout handler was delayed by -1.1655784360000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:11:04.271402  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.278218  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:04.280696 12137 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:04.281174 12164 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:04.287039  8725 connection.cc:256] RPC call timeout handler was delayed by -1.1484784360000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:11:04.289486 12171 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:04.290689  8725 connection.cc:256] RPC call timeout handler was delayed by -1.0926784359999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 12:11:04.290764  9488 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:11:04.293342  8725 connection.cc:256] RPC call timeout handler was delayed by -1.0791784359998928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 12:11:04.291880  8872 connection.cc:256] RPC call timeout handler was delayed by -2.9731425499999204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:11:04.293694  8725 connection.cc:256] RPC call timeout handler was delayed by -1.0107784360000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:11:04.294435 12054 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.295002 12054 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:04.295553 12054 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.295624 12022 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.296500 12022 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:04.302368  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.302760  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.305012  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:04.306576  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.307363  8906 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:04.308970  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.311040  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.311820  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.313315  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.314564  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.316318  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.317476  9523 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 4: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:04.321554  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.322501  9523 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:04.324991  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.325965  8906 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.326876  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.328142  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.347479  8832 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:04.354164 12164 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:04.355930  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61670.8us
I20260709 12:11:04.362187  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.365923  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.366215 11509 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:04.367156  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38804 (request call id 704) took 3306 ms (client timeout 1567 ms). Trace:
W20260709 12:11:04.373361  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.373540  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.362118  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.375197 12046 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.362146 12294 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:04.377777  9522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 623) took 4554 ms. Trace:
I20260709 12:11:04.382702 12114 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.384402 12086 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.293067 12143 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.415751  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 134666us
I20260709 12:11:04.423975  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.463565  8831 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.438680 12080 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.418210 12290 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.470736  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.446722  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.447484 12269 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:11:04.448433  8904 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:11:04.434551  8759 rpcz_store.cc:269] 0709 12:11:01.060988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.064532 (+  3544us) service_pool.cc:224] Handling call
0709 12:11:04.366961 (+3302429us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540014d2d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:04.367077 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167316352}
W20260709 12:11:04.453732  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 170974us
I20260709 12:11:04.457154  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.458061  9487 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.466169  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.450141  9522 rpcz_store.cc:276] 0709 12:10:59.823207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.823365 (+   158us) service_pool.cc:224] Handling call
0709 12:11:02.524158 (+2700793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.311487 (+787329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.376789 (+1065302us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400501754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:04.377539 (+   750us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b5400501750. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:04.377702 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7985846528}
I20260709 12:11:04.458243  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:04.432880 12243 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.468263 11509 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.469115  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.479171  8751 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:04.479147  8724 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:04.479488  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 117370us
I20260709 12:11:04.480512  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.480728  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.482734  8905 raft_consensus.cc:2393] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.463410 12139 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:04.483711  8798 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.487322  8906 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.500833  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.463692 12164 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.506703  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.471813 11924 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.507825  8905 raft_consensus.cc:2393] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.494216  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.486002  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:04.475590 12089 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.501452  9524 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:04.475291 12162 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.521241  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.521912  8758 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:04.522150  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.481963 12249 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:04.530465  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93afd25256e34a3b902813af41f349c9"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:04.470343 12290 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:04.485074 12243 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.539170 12249 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:04.539791 12249 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.541167 12302 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:04.535354 12054 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.473333 12143 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.493742 12139 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.545644 12143 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.516304 12164 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.546811 12139 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.548684  9520 raft_consensus.cc:1240] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.517995 12089 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.476393 12000 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.519109  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:04.519418  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.531153  8901 raft_consensus.cc:606] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:04.520772 12247 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:04.481699 12271 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.523059  8905 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.525334  9525 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:04.523869 12298 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:11:04.525494  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91806.3us
I20260709 12:11:04.513084  8908 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:04.522985  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.494072 12170 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.560353  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.563839 12247 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:04.573513  8874 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.584009  8874 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:04.577013  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 91176.4us
W20260709 12:11:04.577476  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 93844.5us
I20260709 12:11:04.585695  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:04.580127  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 101019us
I20260709 12:11:04.558661 12164 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.592697  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:04.579006 12299 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:04.598893  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.581421 12143 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.603420 12143 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.604255 12298 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:04.605799 12143 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.595463  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.607229  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.608283  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.608717 12303 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:04.582124 12162 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.609596 12303 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.609928 12303 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:04.611330 12162 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.611038 12303 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.585214 12170 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:04.612046 12170 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.615367 12249 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.585668  8754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:04.617115  8754 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:04.617530  8754 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.622192  8725 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.624006  8725 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.590870  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.625414  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.626235  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.628813 11509 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:04.629592 11840 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:04.630865 12106 raft_consensus.cc:2764] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:04.631278 11924 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.631592 12106 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:04.525888 12269 consensus_queue.cc:1059] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:11:04.568041 12301 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.634245 12301 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.596855  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.603952  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.595768  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.593497  8724 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.602787 12089 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.630419 12290 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.589324 12247 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.593609 12094 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:04.612406 12303 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.643256  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49042.7us
I20260709 12:11:04.650635  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:04.651497  8829 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.651278  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:04.639225  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45097.5us
I20260709 12:11:04.645565  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:04.653436  8831 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:04.596575 12097 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.636444 12301 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.657778  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:04.646936  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.658558  8834 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:04.655361  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.659583  8758 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
W20260709 12:11:04.655565  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62165.2us
I20260709 12:11:04.667352  8906 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.641522 12139 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:04.671736  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 94943.8us
I20260709 12:11:04.678539  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.650048 11924 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.648384 12272 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.641587 12304 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:04.605829 12298 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:11:04.687294  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.688949  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.690982  8901 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:04.661960 12271 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.647953 12297 raft_consensus.cc:2764] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:04.671931 12089 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.693471  8753 raft_consensus.cc:2368] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:04.700582 12171 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.694439 11949 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.701187  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.702422  8753 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:04.703481  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.693892  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.704546 12297 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.706122 12305 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.706055  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:04.663924 12302 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:04.707799 12302 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.694986 11509 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.673453 12269 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:04.679957 12094 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.686395 12164 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.688167 12304 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:04.688534 11924 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:04.718497  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91017.1us
I20260709 12:11:04.721355  8829 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:04.708261  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:04.719115 11509 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.672508 12237 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:11:04.723727  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:04.724375  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 77510.6us
I20260709 12:11:04.724423  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.726794  8753 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:04.726619  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.721547  8754 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.691032 12273 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.729190  8874 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.732832  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.714751 12298 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.713663 12305 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.738891  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.711627 12139 consensus_queue.cc:1059] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:11:04.740757  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.724449 11840 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.742718  8754 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.752039  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.728798 12089 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.723302 11924 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.752362  8901 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.755987  8901 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.723219 12304 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:04.756851  8874 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.757743  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.741384 12164 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.761140  8799 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.765231  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.739959 12298 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:04.762378  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 92689.9us
W20260709 12:11:04.768448  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.759276  8901 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.733919 12271 consensus_queue.cc:1059] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:04.754105 12089 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:04.757583 12079 raft_consensus.cc:2804] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:04.752535 12249 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.777624  8901 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.778744  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.757966 12143 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:11:04.788522  8753 raft_consensus.cc:2468] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:04.799697  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.800486  8753 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:04.800704  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.803784 12094 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.808972 12294 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.809881 12294 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.810568 12294 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.811259 12294 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.768054 12139 raft_consensus.cc:3055] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.817024 12139 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:04.818022 12139 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.819473 12139 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.824815 11840 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.735078 12273 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.831054 12273 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.832798 12237 consensus_queue.cc:1059] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:04.834451 12237 raft_consensus.cc:3055] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.834848 12237 raft_consensus.cc:740] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:04.781451 12089 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.789261 12097 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:04.789685 12308 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.791049 12170 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.792264 12079 raft_consensus.cc:697] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.777092 12046 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:11:04.868112  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 89938.7us
I20260709 12:11:04.869297  8725 leader_election.cc:400] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:04.871613  8901 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:04.874563  8753 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:04.876325  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.878434  8753 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.875414 12097 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:04.885445 12079 consensus_queue.cc:237] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.885550 12097 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:04.897215  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 245993us
I20260709 12:11:04.870522 12308 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.879676 12247 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.908145  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:04.908882  8901 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.913062 12247 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:04.919945  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:04.920917 12139 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.921391 12139 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:04.921836 12139 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.925534  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.925827 12243 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:04.897627 12298 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.928573 12298 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.929266  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.930004 12310 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.930187  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.931244  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.931936 12252 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.932736 12237 consensus_queue.cc:260] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:04.933182 12252 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.933349  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:04.933740 12290 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.934056  8909 raft_consensus.cc:606] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:04.934094 12237 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.934602  8909 raft_consensus.cc:614] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:04.904402 12308 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:04.936378 12310 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.938004  9517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:04.938627  9517 raft_consensus.cc:606] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.938949  9517 raft_consensus.cc:614] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:04.940034  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:04.940681  8757 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.941023 12273 consensus_queue.cc:1059] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.941823  8901 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:04.941865 12169 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:04.943614 12307 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.946159  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:04.947132 12252 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.947717 12252 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:04.949584  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:04.950069  8753 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:04.951116  8872 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.965471  8757 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:04.967028  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.967880  8757 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:04.969805  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.970940  8753 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:04.898182  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:04.970533  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.972151  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.973397  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.974797  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.975754 12158 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.976796 12164 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.957309 12310 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.977686  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.979794 12139 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:04.981477  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.997267  8753 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:04.997737  8872 leader_election.cc:400] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:04.999262  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:05.000370  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 102280us
W20260709 12:11:05.002360  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 277483us
I20260709 12:11:04.985900  8758 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:04.995010 12269 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.987215 11876 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.987571 12158 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.021860  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:04.991315 12086 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.920315 11924 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.024852  8905 raft_consensus.cc:2393] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:11:05.030220  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 269139us
I20260709 12:11:05.024662  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:04.980674 12308 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.031060  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.031924 12317 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.032253  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.032806  8757 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:11:05.033730  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.035830  8900 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.037681  8757 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.042409  8905 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:05.000619 12305 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.023762 12114 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.046818  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.034752 12086 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:05.016782 12271 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:05.027197 12311 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.051865  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.058512  8829 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:05.024004 12303 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:05.060509  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.064675  8906 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.014806  8872 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:04.948681 12252 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.061411  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:05.006146 12304 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.062768  8835 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:05.069892  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.070019  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.070302  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.070508  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.070888  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:05.071134  8827 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:05.071364  8834 raft_consensus.cc:1240] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.071666  8829 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 5: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:05.074514 12303 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:05.074914 12303 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.055470 12086 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.026535 11876 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.066680  8831 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.062160  8900 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.064571  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.049005 12317 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.065483  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.068166  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.070912  8832 raft_consensus.cc:2410] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:05.092964  9517 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.063495  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.083455  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.094527  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.070515  8835 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:05.057953 11949 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.086022  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:05.086189  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 71471.6us
I20260709 12:11:05.086220  8826 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.097574  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:05.090798  8757 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:05.098389  8903 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:05.066831 12311 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:05.101670  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.115145  8757 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:05.115625  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.116372  8751 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:11:05.116531  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.117980  8757 raft_consensus.cc:2368] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:05.109797  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.099413  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:05.107199  8831 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:05.126760  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.112969 12255 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:11:05.127780  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:05.108448 12114 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:05.136335 12320 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
I20260709 12:11:05.136425 11949 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.128255 12315 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:05.129307  8904 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.091391 11857 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.162340 12318 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:05.162524 11857 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.162909 12318 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.119609 12302 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.131971  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.075737 12303 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.165710 12304 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:05.165812 12094 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.127780 12106 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:05.166442 12094 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.166675 12106 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:05.166850 12094 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.167114 11924 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.167644 12106 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.146627  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.155138  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.155781 12305 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.158102 11876 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:05.160852  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61488.6us
I20260709 12:11:05.161553 12079 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:05.174472  8872 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.171047 12311 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:05.172278  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64362.4us
I20260709 12:11:05.175545  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.120679 12269 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:05.172317  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62657us
I20260709 12:11:05.098155 12164 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.172885  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.160059 12271 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.099596 12314 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:05.184122  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.185412  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.184093  8832 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:11:05.189560  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:05.192581  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60698us
I20260709 12:11:05.196142  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.194974  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.189356 12097 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.198170 12114 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:05.202737 12313 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:11:05.205940 12162 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.206472 12162 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.207098  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:05.207453 12162 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.208492  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:05.209285  8829 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:05.210736 12139 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.212811  8751 raft_consensus.cc:2393] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:05.177049 12255 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.185220 12089 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.216228  8798 leader_election.cc:400] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:05.217660  8798 leader_election.cc:403] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.183888 12164 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.220347  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.193086 12317 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.222381  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.230970  8829 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:11:05.240466  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.180418 12310 consensus_queue.cc:1059] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:05.215643 12255 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.212922 12271 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:05.276266  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 60216.5us
W20260709 12:11:05.276665  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 54321.6us
W20260709 12:11:05.283973 12326 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:05.277137  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.288506  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.223623 12143 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.289088  8829 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:05.289247 12143 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.289783 12143 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.279042 12290 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.280848 12237 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:05.223178 12314 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.222965 12294 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.291271 12314 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:05.291992  8829 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.292012  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.222743 11857 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.223894 12164 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.292343 12314 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.293565  8904 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:05.293705  8829 pending_rounds.cc:85] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 5
I20260709 12:11:05.294355 12308 raft_consensus.cc:3055] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.294745 12308 raft_consensus.cc:740] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:05.294626 12086 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.282424 12255 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.295950 12308 consensus_queue.cc:260] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.231984 11924 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.296963  8828 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.297137 12308 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.300345  8904 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.179594 12325 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:11:05.294054  8829 pending_rounds.cc:107] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:05.301352  8829 raft_consensus.cc:2889] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.301946  8900 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:05.310956  8833 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.296772 12162 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.318159  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.293824 12314 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.315860  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.299851 12317 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:05.326618  9517 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.299782 12310 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:05.327142  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.298059 12323 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.335563  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:05.336318  9516 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:05.337345 12310 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.336000  8875 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.348425 11509 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:05.355226 12079 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:05.359979 12271 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.368019  8826 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:05.369427 12089 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:05.371205  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.329523 12294 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:05.373032 12294 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.373972  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.374462  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:05.375686 12294 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.377635  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.378342  8757 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.377998 12094 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.375388 12310 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:05.314618 12290 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:05.388355  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:05.385074  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:05.381810  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.332660 12323 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:05.404340  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:05.415211  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.380530 12094 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:05.367472 12097 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.409392 12318 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.409791 12310 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.412298 12329 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:11:05.412977  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.431547  8831 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:05.376420 12249 raft_consensus.cc:3055] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:05.420374  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:05.421322 12143 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:05.444298  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.441658  8757 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:05.448529  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.450840  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.452461  8902 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:05.452704  8757 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:05.454874  8834 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:05.454639  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.456095  8757 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:05.423691 12315 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:05.421543  8906 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:05.458222  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:05.458753  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 110800us
I20260709 12:11:05.464598  8901 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.459278  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.417263 12323 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.433862 12329 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.430770 12139 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.468389  8909 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:05.431341 12310 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.348090 12317 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.453944 12298 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.424589 12252 consensus_queue.cc:1059] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:05.446846 12249 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:05.424163 12269 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:05.423928 12307 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:11:05.499491 12337 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:05.467777  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.446128 12267 consensus_queue.cc:1059] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:05.466554 12290 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.474745 12139 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.498400 12143 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:05.500397  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.506556  8755 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:05.469749 12315 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.477126 12310 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.472466 12329 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:05.530352  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 111045us
I20260709 12:11:05.532183  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.533357  8906 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:05.545773  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.547437  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.549217  8724 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.501212 12298 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:05.505782 12290 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:05.556890  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.565021  8724 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:05.565045  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 90771.2us
I20260709 12:11:05.550212 12318 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.561923 12304 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.574994  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:05.575762  9516 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.575922 12139 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:05.547487 12269 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:05.564436 12290 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.549242 12089 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:11:05.588393  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.588183 12304 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:05.568835 12302 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.582331 12143 raft_consensus.cc:3055] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.563766 12162 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:05.551951 12255 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:05.604128  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 72651us
W20260709 12:11:05.610003  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 45356.7us
I20260709 12:11:05.599609 12315 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.610601 12298 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.612861 12342 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:05.613971 12342 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.614375 12342 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:05.571980 12271 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:05.605826 12304 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:05.608379 12143 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:05.616382  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.597219 12164 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.572430 12343 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:11:05.609264 12089 consensus_queue.cc:1243] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:05.624298 12106 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.639544  8753 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:05.624658 12162 consensus_queue.cc:1243] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:05.640539  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1905) took 1089 ms. Trace:
I20260709 12:11:05.627102 12269 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.644858 12269 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:05.645380 12340 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:11:05.645805 12269 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.647140 12269 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.649598 12301 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:05.650065 12164 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.651212  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.642861  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.590759 12249 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.644047  8753 rpcz_store.cc:276] 0709 12:11:04.551477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.638823 (+1087346us) service_pool.cc:224] Handling call
0709 12:11:05.639142 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.640239 (+  1097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.640479 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.671721  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.629105 12271 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.682178  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.682902  8752 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:05.683014 12304 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.683851  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.655196  9516 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:05.685249  8908 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:11:05.661790 12338 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:05.615383 12342 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.687973  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.688093  8875 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:05.688385  8905 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:05.686997  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.691154  8751 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:05.695598  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.696163  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:05.696447  8753 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:05.698797  8753 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:05.699524  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1924) took 1092 ms. Trace:
I20260709 12:11:05.699891  8753 rpcz_store.cc:276] 0709 12:11:04.607301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.698188 (+1090887us) service_pool.cc:224] Handling call
0709 12:11:05.698480 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.699232 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.699463 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.685139 12249 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.701884  8753 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.710610  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1927) took 1102 ms. Trace:
I20260709 12:11:05.711082  8753 rpcz_store.cc:276] 0709 12:11:04.608064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.701264 (+1093200us) service_pool.cc:224] Handling call
0709 12:11:05.701640 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.710280 (+  8640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.710531 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:05.711990  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.712745  8753 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.713605  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1928) took 1051 ms. Trace:
I20260709 12:11:05.713833  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1926) took 1106 ms. Trace:
I20260709 12:11:05.714010  8753 rpcz_store.cc:276] 0709 12:11:04.662207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.712096 (+1049889us) service_pool.cc:224] Handling call
0709 12:11:05.712492 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.713290 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.713542 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.714565  8751 rpcz_store.cc:276] 0709 12:11:04.607803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.700229 (+1092426us) service_pool.cc:224] Handling call
0709 12:11:05.713221 (+ 12992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.713429 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.713466 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.713518 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:05.713562 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.713629 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.713762 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.691407 12343 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.695636 12255 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:05.704955 12337 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:05.728876 12317 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:05.680167 12290 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.731529  8751 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.735447  8751 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.751470 12290 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:05.757014  8759 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.754026  9487 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:05.759964  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1925) took 1152 ms. Trace:
W20260709 12:11:05.763132  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.762192  8756 rpcz_store.cc:276] 0709 12:11:04.607556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.698542 (+1090986us) service_pool.cc:224] Handling call
0709 12:11:05.722010 (+ 23468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.722202 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:05.736159 (+ 13957us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.759396 (+ 23237us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.759602 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.759656 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.759702 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.759774 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.759897 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19590,"prepare.queue_time_us":34282,"raft.queue_time_us":235,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":14293,"threads_started":2,"wal-append.queue_time_us":988}
I20260709 12:11:05.774595  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.762295  9487 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:05.734480 12310 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:05.761544 11857 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:05.794358  8798 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 2.192s (SENT)
I20260709 12:11:05.796190  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.789469 11857 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:05.811916  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49696.2us
I20260709 12:11:05.812767  9487 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.815181  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:05.815717  8757 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.816215  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:05.805150 12352 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:05.819161  8908 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:05.826588  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.827546  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1922) took 1220 ms. Trace:
I20260709 12:11:05.827878  8760 rpcz_store.cc:276] 0709 12:11:04.606772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.826252 (+1219480us) service_pool.cc:224] Handling call
0709 12:11:05.827482 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.831247  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1921) took 1224 ms. Trace:
I20260709 12:11:05.831647  8754 rpcz_store.cc:276] 0709 12:11:04.606523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.778540 (+172017us) service_pool.cc:224] Handling call
0709 12:11:05.831057 (+1052517us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001cc354. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:05.831190 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537507072}
I20260709 12:11:05.832962  8754 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:05.836270 11666 raft_consensus.cc:3055] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:05.836809 11666 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:05.840922  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:05.849929 12303 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.852263 12054 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:05.826874 12361 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:05.876602  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:05.852545 12310 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:05.856263  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.803383 12298 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:05.860577  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44620.5us
I20260709 12:11:05.878850  9487 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:05.804260 12343 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:05.811517 11857 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.805612 12252 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:05.881616  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.887562  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.889446  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:05.890846  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:05.857451 12248 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:05.856124 11666 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:05.908265  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.897235  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:05.980094  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:05.959316  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 69955.7us
I20260709 12:11:05.895227  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:05.880101 12304 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.877321 12199 raft_consensus.cc:2764] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:05.876390 12253 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.986806  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:05.989081  8754 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:05.892670 12000 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.940038 12314 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.940198 12054 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.003377  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:06.004153  9516 raft_consensus.cc:3055] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:06.004598  9516 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.006785  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1929) took 1316 ms. Trace:
I20260709 12:11:05.979930 12248 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.008083  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:05.892994 12252 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.897044 12317 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.895924 12290 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.996861 12253 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.874598 12329 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:05.941239 12323 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.007445  8753 rpcz_store.cc:276] 0709 12:11:04.690856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.731220 (+1040364us) service_pool.cc:224] Handling call
0709 12:11:05.731551 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.731822 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:05.875819 (+143997us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.006361 (+130542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.006428 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:06.006481 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.006547 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.006703 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16278,"prepare.queue_time_us":43227,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1765,"raft.queue_time_us":1350,"thread_start_us":262651,"threads_started":2}
I20260709 12:11:06.016036  8754 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.000284 12269 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.016135  9516 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.003203 12298 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.004588 12054 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:06.012287 12354 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 12:11:06.027797  9516 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.029996  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1910) took 1426 ms. Trace:
I20260709 12:11:06.030436  8758 rpcz_store.cc:276] 0709 12:11:04.603716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.671473 (+ 67757us) service_pool.cc:224] Handling call
0709 12:11:06.029809 (+1358336us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54001cb454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:06.029937 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659166592}
I20260709 12:11:06.012480 12252 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.997073 12304 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.046393  8752 raft_consensus.cc:2368] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5.
I20260709 12:11:06.021821 12253 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.048382  8827 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:06.086392  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.051146 12170 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.045076  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:06.056380  8872 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.889s (SENT) [suppressed 37 similar messages]
I20260709 12:11:06.026027 12302 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.028234 12269 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.066601 12312 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:06.067214 12304 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.028041 12054 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.069932 12356 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:06.070389 12248 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.019555 12343 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.071993  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.073469 12086 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:06.073709 12329 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.073804 12323 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.074777 11876 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.075390  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:06.110172 11876 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.110519  8834 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:06.028246 12243 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:06.111835  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.111189 11876 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.092980  8832 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:06.008214 12311 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:06.113507 12311 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:06.113862 12311 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:06.114050  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.114753 12311 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.115970 12311 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.095144  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.117911 11876 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.119473  8827 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.121924  8828 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.105783  8906 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:11:06.112432  8834 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.128237  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:06.131242  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.131580  9516 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:06.128512  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:06.105195 12312 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:06.140688  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.143658  8828 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:06.156208  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.107173 12302 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.181197  8828 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
W20260709 12:11:06.182236  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 125881us
I20260709 12:11:06.183107  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:06.188133 12158 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:06.192394  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:06.185313  8828 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 3.
I20260709 12:11:06.190258 11857 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.203907 11857 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:06.214691  8832 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
W20260709 12:11:06.218556  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.221556  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.215919  8834 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:06.165056 12329 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:06.227797  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:06.233628  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 125828us
I20260709 12:11:06.234812  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:06.226541 12086 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:06.253636  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.255780  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:06.262780  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:06.263427  8832 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:11:06.264374  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.264906  8832 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:11:06.268473  9489 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:06.269757 12248 raft_consensus.cc:2804] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.270356 12248 raft_consensus.cc:697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.271454 12248 consensus_queue.cc:237] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.258045 11509 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:11:06.278410  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.228854 12310 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:11:06.282992 12342 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.284363 12298 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.330823  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2151) took 1137 ms. Trace:
I20260709 12:11:06.331266  8833 rpcz_store.cc:276] 0709 12:11:05.193653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.312364 (+118711us) service_pool.cc:224] Handling call
0709 12:11:05.332606 (+ 20242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.339627 (+  7021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.339663 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.340174 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.033108 (+692934us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b1800497aa0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:11:06.186216 (+153108us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:06.186602 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.187023 (+   421us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.330509 (+143486us) raft_consensus.cc:1685] finished
0709 12:11:06.330528 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.330758 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5288,"spinlock_wait_cycles":6221184,"thread_start_us":150895,"threads_started":1,"wal-append.queue_time_us":944977}
I20260709 12:11:06.327877  8832 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:11:06.251437 12164 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.217389 12312 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.362296 12312 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.249598 12365 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:11:06.226406 12079 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:06.381583  8828 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:06.289723 12378 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.252053 12337 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 12:11:06.256476 12255 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:11:06.396301  8757 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:06.277104 12344 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 12:11:06.402529  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.404219  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:06.393311 12330 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:06.389535 12365 consensus_queue.cc:1243] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer 005ae7a1e140481db6cc04faeb268d9c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:06.389784 12317 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:06.411478 12323 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.411970 12373 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.413331  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1956) took 1369 ms. Trace:
I20260709 12:11:06.415716 12253 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.417783  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1960) took 1224 ms. Trace:
I20260709 12:11:06.443032  8759 rpcz_store.cc:276] 0709 12:11:05.193126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.758166 (+565040us) service_pool.cc:224] Handling call
0709 12:11:05.758502 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.776331 (+ 17829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.776366 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.782756 (+  6390us) log.cc:844] Serialized 52 byte log entry
0709 12:11:05.875205 (+ 92449us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.885080 (+  9875us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.062157 (+177077us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b1800434440. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:06.417028 (+354871us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800434440. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3bb3b3c7 00007fce3814d9a7 00007fce3815d0bf 00007fce3815d038
0709 12:11:06.417245 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.417448 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.417518 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.417557 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:06.417568 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.417720 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":543402,"prepare.queue_time_us":545090,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":20228,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":1394,"spinlock_wait_cycles":14199424,"thread_start_us":75005,"threads_started":1,"wal-append.queue_time_us":208932}
I20260709 12:11:06.418937 12346 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:06.445184 12318 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.445423 12346 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.445611 12318 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:06.446449 12318 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.447759 12318 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.368703 12170 consensus_queue.cc:1175] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "005ae7a1e140481db6cc04faeb268d9c" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 12:11:06.393714 12269 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.449442  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1933) took 1163 ms. Trace:
I20260709 12:11:06.449793  8909 rpcz_store.cc:276] 0709 12:11:05.286491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.287720 (+  1229us) service_pool.cc:224] Handling call
0709 12:11:05.288090 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.472085 (+183995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.449193 (+977108us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400425254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:06.449386 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408271232}
I20260709 12:11:06.327253 12349 consensus_queue.cc:1059] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:11:06.450695 12253 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:06.451491  9524 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:06.453526 12348 raft_consensus.cc:3055] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:06.453761 12305 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.453900 12348 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.454185 12305 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:06.454805 12348 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.456162 12348 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.465328  9525 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:06.471683  8826 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:06.387943 12310 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:06.402083 12378 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.474776 12378 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.475415 12373 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.433285 12298 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.477099 12298 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.477773 12373 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.475457  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.438375  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:06.480232  9516 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
I20260709 12:11:06.446386 12346 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.481969  8829 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:06.442914  8752 rpcz_store.cc:276] 0709 12:11:05.045456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.687657 (+642201us) service_pool.cc:224] Handling call
0709 12:11:06.413133 (+725476us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540014d2d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:06.413271 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820687744}
I20260709 12:11:06.451424 12349 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:06.439123  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.495646  8827 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:06.454981 12305 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.433597 11949 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.487509 12303 consensus_meta.cc:287] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:11:06.488998  9516 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:06.419767 12054 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.512490  8829 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:06.497258  8726 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:06.514202  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.514909  8752 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.440810 11840 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.475436 12302 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.484309 12079 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.522578  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 232648us
I20260709 12:11:06.526865  8835 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:06.493505 12349 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.499192 12373 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.534579  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.502503 12317 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.518520 12346 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.483763 12323 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:06.533708  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 254821us
I20260709 12:11:06.562206  8725 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:06.524194 12378 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:06.565889  9518 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:06.518384 11840 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.512699 12337 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:06.536445 12365 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:06.587316  8835 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:06.574826  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:06.578641 11509 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:06.577392  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.532791 12079 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.566550 12317 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.579181  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:06.592033  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.560181 12298 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:06.615904  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.617307  8905 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:11:06.622426  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.612308  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.586858  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:06.638464  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.632833  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 53732.6us
I20260709 12:11:06.645268  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:06.621053  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:06.625872  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 1961) took 1432 ms. Trace:
I20260709 12:11:06.596043 12388 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.629506 11509 consensus_queue.cc:1243] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:06.649716  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:06.647544  8756 rpcz_store.cc:276] 0709 12:11:05.193375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.774971 (+581596us) service_pool.cc:224] Handling call
0709 12:11:05.783543 (+  8572us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.783888 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:05.810928 (+ 27040us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.419822 (+608894us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.420270 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.517699 (+ 97429us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.529061 (+ 11362us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.529275 (+   214us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:06.529314 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.529422 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.625651 (+ 96229us) raft_consensus.cc:1685] finished
0709 12:11:06.625672 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.625799 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413440,"prepare.queue_time_us":520345,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":12550,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":7377,"thread_start_us":245048,"threads_started":2,"wal-append.queue_time_us":176115}
I20260709 12:11:06.560122 12373 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.672178  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.573539  9520 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:06.673661  8759 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.632125 12252 consensus_meta.cc:287] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 12:11:06.588953 12311 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.575222 12314 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.612300 12390 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:06.642680 12343 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.604609 12323 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.512861 11949 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.622193 12317 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.613190 12392 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:06.611474 12378 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.688021 12311 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.689970 12094 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.689875 12314 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.682161 12252 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.617388 11840 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.691121 12343 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.685227 12390 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.665585 12255 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:06.696561  8828 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.698666  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:06.700503  8760 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:06.580621 12258 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:11:06.704201 12054 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:06.711206  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:06.761037  8833 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.716274  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:06.728520  8752 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:06.729566  8759 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:06.767494  9519 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:06.734480  8829 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.602505 12349 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.668115 12298 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:11:06.746856  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 63899.4us
I20260709 12:11:06.736579 12378 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:06.672926 12388 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.712831  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:06.764420  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48241.4us
I20260709 12:11:06.743515 12392 raft_consensus.cc:697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:06.768497  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:06.780135  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 166047us
I20260709 12:11:06.778510  8835 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:11:06.774716  8829 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.731494 12302 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:06.752781 12390 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.777701 11840 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.781399  8828 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:06.775266  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.781612  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.784577  9487 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:06.770015 12248 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:06.761198 12337 consensus_queue.cc:1175] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd116b86a1e4445c994a361f776beba1" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 5 } }
I20260709 12:11:06.746762 12094 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.794935  8798 leader_election.cc:400] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5.
I20260709 12:11:06.795851  8798 leader_election.cc:403] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:06.796468 12323 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5.
I20260709 12:11:06.800503  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 736) took 1809 ms. Trace:
I20260709 12:11:06.801085  8751 rpcz_store.cc:276] 0709 12:11:04.991661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.743809 (+752148us) service_pool.cc:224] Handling call
0709 12:11:05.745847 (+  2038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.746063 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:05.781627 (+ 35564us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.708474 (+926847us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b180037afe0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce323a 00007fce3814da2a
0709 12:11:06.800134 (+ 91660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.800198 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:06.800251 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.800322 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.800440 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22914,"prepare.queue_time_us":35249,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":119,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":2542976,"thread_start_us":110863,"threads_started":2}
W20260709 12:11:06.792299 12342 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.006s
I20260709 12:11:06.790884 12054 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:06.819587 12094 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.794049 12273 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.821051 12169 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.821301 12347 raft_consensus.cc:3055] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.821807 12347 raft_consensus.cc:740] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.819646 12317 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:06.822628 12347 consensus_queue.cc:260] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:06.823388  8831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2147) took 1745 ms (client timeout 1847 ms). Trace:
I20260709 12:11:06.822780 12317 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:06.823973  8831 rpcz_store.cc:269] 0709 12:11:05.078260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.126389 (+ 48129us) service_pool.cc:224] Handling call
0709 12:11:06.823183 (+1696794us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540037bc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:06.823294 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653632896}
I20260709 12:11:06.823542 12273 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.834113  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:06.835173 12273 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.852860  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:06.853711  9516 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:06.856258  8833 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:06.838804 12317 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:06.868263  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.847301 12054 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:06.908056  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.911412  8759 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:06.911933  8833 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:06.913516  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.916919  8751 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.921844  8752 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:06.924999  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.925354  8758 raft_consensus.cc:1275] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:06.928002  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.890121 12393 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.900702 12329 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.901216 12302 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.895167 12323 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:06.830423 12343 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.932648  8903 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.940515  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:06.947535  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.919684 12399 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.953140 12399 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.859439 12392 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:06.955684 12399 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.924993 12373 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.956722 12302 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:06.959002 12318 consensus_meta.cc:287] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.001s
I20260709 12:11:06.959192 12302 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.959817  8756 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:06.960865  8757 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.964300 12403 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:06.977325  8751 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
W20260709 12:11:06.978165  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.978727  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:06.931747 12388 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.942889 12255 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:06.999316  8902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1934) took 1712 ms. Trace:
I20260709 12:11:06.966775 12252 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:06.999841  8902 rpcz_store.cc:276] 0709 12:11:05.286726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.289486 (+  2760us) service_pool.cc:224] Handling call
0709 12:11:05.289738 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.455347 (+165609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.999012 (+1543665us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003e9254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:06.999240 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373815552}
I20260709 12:11:06.976492 12094 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.980566 11949 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:06.977373 12311 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:06.974891 12399 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:06.983282 12389 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.008383  9523 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.949615 12329 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:06.975344 12323 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.038748  8757 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:06.944358 12393 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.008958  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:07.047678 12397 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.359s	user 0.004s	sys 0.000s
I20260709 12:11:07.045519  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:07.046243 12405 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:11:07.102957  8752 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.104203  8902 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:11:07.104730  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.105913  8903 raft_consensus.cc:3060] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.047451 12106 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.055646 12248 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.005280 11840 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:11:07.061380 12403 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.116391  8752 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:07.118978  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:07.126085  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 275370us
I20260709 12:11:07.127606  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.048955 12389 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.018435 12094 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.140586  8758 raft_consensus.cc:1240] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:07.018039 12054 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.049130 12255 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.146273  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:07.149428  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:07.097582 12399 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.125059 12311 consensus_queue.cc:1059] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:07.124286 12248 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.147827 12312 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.162663  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 639) took 2008 ms. Trace:
I20260709 12:11:07.153244 12419 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.127070 12403 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.155336  8831 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:07.121152 12106 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:07.159008 11949 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.208071 12419 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.211261 12419 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.211817 12419 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:07.212275 12419 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.214301 12419 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:07.215246 12413 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:11:07.216886  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 637) took 1108 ms. Trace:
I20260709 12:11:07.217285  8827 rpcz_store.cc:276] 0709 12:11:06.108121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.121742 (+ 13621us) service_pool.cc:224] Handling call
0709 12:11:07.216725 (+1094983us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001eda54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:07.216827 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826678656}
W20260709 12:11:07.196012 12411 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:11:07.163195  8901 rpcz_store.cc:276] 0709 12:11:05.153947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.154127 (+   180us) service_pool.cc:224] Handling call
0709 12:11:05.464364 (+310237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.465166 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.162431 (+1697265us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400282650. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:07.162593 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711631232}
I20260709 12:11:07.223462  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:07.230286  8831 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 5: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:07.206821 12408 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:11:07.163103 12373 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:07.205720 11840 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.254776 12248 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.227546 11876 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.261299  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.284003 11876 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.240221 12344 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.286564 11876 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.243407 12086 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.287565 12344 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.288126 12086 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.290467 12086 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:07.286873 12346 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260709 12:11:07.294415 12399 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.295804 11840 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.278075 12393 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.302042 12094 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.221556 12421 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:11:07.306553 12396 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.616s	user 0.000s	sys 0.001s
W20260709 12:11:07.316049 12390 consensus_meta.cc:287] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:11:07.320979  8903 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:07.289921 12106 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:07.318485 12114 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:07.402441 12411 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:11:07.480651  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.482024  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.482772  8905 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:07.484486  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.486029  8828 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:07.488667  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.491017  8760 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:07.494925  8759 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:07.481146  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:07.496773  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.437722 12323 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.497049  8831 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:07.498345  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.500800  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.501350  8759 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:07.439925 12114 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:07.523257  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.526247  8905 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:07.504374  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.525390  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:07.481384  8903 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:07.496997 12403 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:07.529054  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.529510  8872 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:07.531244  8758 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.531176  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:07.532464  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.533631  8902 raft_consensus.cc:2410] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:07.207702 12312 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.543973  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.544732  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.545800  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:07.529798  8908 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:07.522845 12298 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.495287 12158 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.502068 12349 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.543865 12419 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.551424 12420 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.548812 12298 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.582371  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.583395  8759 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:07.553416  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.553606 12337 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.512012 12311 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.555176 12335 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 2.062s	user 0.006s	sys 0.000s
I20260709 12:11:07.549151 12346 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:11:07.558027  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:07.497779 12329 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.497892 12344 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.556818 12086 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.522938 12106 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:07.575582  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 85170.2us
W20260709 12:11:07.581075  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.581131  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 55822.7us
I20260709 12:11:07.584444  8833 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:07.488981 12390 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.603380  8801 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:07.594700  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:07.579609 12348 consensus_queue.cc:1059] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:11:07.595268  9518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 705) took 1579 ms (client timeout 1895 ms). Trace:
I20260709 12:11:07.576284  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.597298  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:07.606835  9518 rpcz_store.cc:269] 0709 12:11:06.008876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.009910 (+  1034us) service_pool.cc:224] Handling call
0709 12:11:07.588035 (+1578125us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400571054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:07.588181 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015702400}
I20260709 12:11:07.582597 12420 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:07.558645 12403 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:07.612682  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:07.615213  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.619385  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.620055  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.620525  9523 raft_consensus.cc:2410] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:11:07.621148  8902 raft_consensus.cc:2410] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:07.600272 12373 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.553464 12343 consensus_queue.cc:1048] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:07.622851  8801 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:07.624030  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:07.588393 12094 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:11:07.626600 11949 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.627928 12298 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.628319 11666 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:07.629737 12390 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:07.630944  9520 consensus_meta.cc:287] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.002s
I20260709 12:11:07.631346  9520 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:07.593782 12311 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.632781  8801 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:07.633406  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:07.633626 12298 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.634114  8832 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:07.634279 12298 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:07.634503 12311 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.635197  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:07.635381 12298 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.608520 12106 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.640980  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:07.613284 12378 consensus_meta.cc:287] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.006s
I20260709 12:11:07.656760  8832 raft_consensus.cc:1275] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:07.588565 12419 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.616760  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.612442 12399 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.668862  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 159088us
I20260709 12:11:07.673566  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.675071  8902 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:07.675843  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 642) took 1493 ms. Trace:
I20260709 12:11:07.676473  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:07.676769  8902 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:07.677388 12421 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:07.679095  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.618064 12344 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:07.676263  8834 rpcz_store.cc:276] 0709 12:11:06.182461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.684000 (+501539us) service_pool.cc:224] Handling call
0709 12:11:06.687338 (+  3338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.751745 (+ 64407us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:06.769833 (+ 18088us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.927149 (+157316us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.042350 (+115201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.042416 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.042467 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.675577 (+633110us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54000d7fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:07.675639 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.675778 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24605,"prepare.queue_time_us":19159,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":2356,"raft.queue_time_us":90759,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"spinlock_wait_cycles":147538816,"thread_start_us":239297,"threads_started":2,"wal-append.queue_time_us":180038}
I20260709 12:11:07.616165 12433 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.624239 12373 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.608402 11876 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:07.624586 12301 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.687912  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:07.693030  8757 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:07.687633 12433 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:07.687999 12304 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.694187 12433 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.694519 12304 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:07.696238 12427 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:11:07.677783 12421 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.646337 11949 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.596262 12114 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.672955 12106 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.660543 12311 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:07.688895 12373 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:07.751748  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260709 12:11:07.752947  8801 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:07.687942 12390 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.712114 12430 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:07.689394 12344 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.672821 12378 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.697502 12301 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.721302 12420 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:07.764843 12428 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:11:07.765090 12420 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.766026  8901 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:11:07.767028  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.773313 12301 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:07.778192 12419 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.724138 12304 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:07.780969 12436 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:11:07.784667 12312 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.784929  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:07.785815  9525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 710) took 1291 ms (client timeout 1529 ms). Trace:
W20260709 12:11:07.786199  9525 rpcz_store.cc:269] 0709 12:11:06.494593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.494967 (+   374us) service_pool.cc:224] Handling call
0709 12:11:07.784749 (+1289782us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:11:07.785745 (+   996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603264}
I20260709 12:11:07.788757 12378 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.753624 12311 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.791771 12311 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:07.793087  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:07.795625 12423 log.cc:927] Time spent T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.567s	user 0.003s	sys 0.003s
I20260709 12:11:07.796279  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.796540 12344 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.797621 12314 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:07.767606 12399 consensus_queue.cc:1175] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61fbd5afaa194845917d5b1b04571378" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:07.797482  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:07.797631  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:07.808347  8831 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:07.811937 12298 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:07.813136  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 46578.3us
I20260709 12:11:07.814270  8726 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:07.819231  8726 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:07.820123  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2169) took 1204 ms. Trace:
I20260709 12:11:07.822552  8835 rpcz_store.cc:276] 0709 12:11:06.615682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.869692 (+254010us) service_pool.cc:224] Handling call
0709 12:11:06.916017 (+ 46325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.241842 (+325825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.241907 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.250568 (+  8661us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.697944 (+447376us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:07.697998 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.698402 (+   404us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.819909 (+121507us) raft_consensus.cc:1685] finished
0709 12:11:07.819932 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.820071 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3554,"raft.queue_time_us":40094,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":53,"thread_start_us":579324,"threads_started":2,"wal-append.queue_time_us":373816}
I20260709 12:11:07.826581  8831 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:07.714758 12421 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.828621  8831 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.830543  9523 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 5.
W20260709 12:11:07.927009  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.911219  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 701) took 2014 ms (client timeout 1874 ms). Trace:
I20260709 12:11:07.912252  8906 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.938952  8906 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:07.911911  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.713734 12323 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.721443 11729 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:11:07.926276  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:07.947044  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 132970us
I20260709 12:11:07.778208 12079 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:07.821931 12314 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:07.954576  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 135432us
W20260709 12:11:07.938288  9524 rpcz_store.cc:269] 0709 12:11:05.896684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.896867 (+   183us) service_pool.cc:224] Handling call
0709 12:11:07.878744 (+1981877us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400600ed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:07.911143 (+ 32399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075371264}
W20260709 12:11:07.950305  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.951448  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2154) took 2626 ms. Trace:
I20260709 12:11:07.719362 12143 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.831537 12312 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.828799 12311 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:07.955348  8726 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:07.834846 12388 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.949755  8875 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:07.958827  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 140559us
I20260709 12:11:07.813462 12390 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.939924  8906 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.982656  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 649) took 1125 ms. Trace:
I20260709 12:11:08.112658  9517 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 3.
I20260709 12:11:08.039700  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:08.201924  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 1970) took 1557 ms (client timeout 1803 ms). Trace:
I20260709 12:11:08.039345  9524 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:08.139150  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 108635us
I20260709 12:11:08.014371  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:08.219374  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 205122us
W20260709 12:11:07.994125  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.225386  8756 rpcz_store.cc:269] 0709 12:11:06.660294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.676289 (+ 15995us) service_pool.cc:224] Handling call
0709 12:11:08.201659 (+1525370us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002c24d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:08.201813 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474490112}
W20260709 12:11:08.035212  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 78231.2us
I20260709 12:11:08.228075  8726 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:08.038295  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:08.220664  8907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40132 (request call id 643) took 2377 ms (client timeout 2129 ms). Trace:
I20260709 12:11:08.221024 12410 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:08.221297  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.216657 12446 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.216842 12417 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.221966 12303 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:07.959728 12314 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:07.948133 12343 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:07.959159 12310 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.202286 12419 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.189534 12315 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.224452  8906 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.034921  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50954.2us
I20260709 12:11:08.037915  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:08.230873  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 281218us
I20260709 12:11:08.034857 12094 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.280762  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:08.282034  8875 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:08.231096  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.283949  8832 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:08.285131  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.286092  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.231810 11509 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:08.231454  8907 rpcz_store.cc:269] 0709 12:11:05.839043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.840504 (+  1461us) service_pool.cc:224] Handling call
0709 12:11:08.202514 (+2362010us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b5400426654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:08.216481 (+ 13967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752705920}
I20260709 12:11:08.038408  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.073860  8909 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:08.194753  8831 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:08.001106 12054 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.273s
I20260709 12:11:08.230093 12271 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:08.279203 12343 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.293740 12271 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:08.294780 12271 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.290375 12348 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.295835 12343 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.222407 11840 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:08.228289  9489 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:08.228680  8827 rpcz_store.cc:276] 0709 12:11:06.857139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.218061 (+360922us) service_pool.cc:224] Handling call
0709 12:11:07.218437 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.218761 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.218794 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.221439 (+  2645us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.516108 (+294669us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.671474 (+155366us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.982261 (+310787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.982359 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.982405 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:07.982419 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.982585 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288110,"prepare.queue_time_us":69618,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":23741,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":237,"thread_start_us":662638,"threads_started":3,"wal-append.queue_time_us":365793}
I20260709 12:11:08.310557  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:08.003321 12311 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.955842  8830 rpcz_store.cc:276] 0709 12:11:05.325026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.364734 (+ 39708us) service_pool.cc:224] Handling call
0709 12:11:05.365074 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.191266 (+826192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.191299 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.207257 (+ 15958us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.503908 (+296651us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.503974 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.879846 (+1375872us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54000d89d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:07.911615 (+ 31769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.911677 (+    62us) raft_consensus.cc:1685] finished
0709 12:11:07.911690 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.951383 (+ 39693us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":692,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":22443,"spinlock_wait_cycles":1899137792,"thread_start_us":252831,"threads_started":1,"wal-append.queue_time_us":373375,"wal-append.run_cpu_time_us":3626,"wal-append.run_wall_time_us":1103573}
I20260709 12:11:08.241343  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:08.273299 12388 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.180174 12412 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.131s	user 0.000s	sys 0.004s
W20260709 12:11:08.123183 12158 consensus_meta.cc:287] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.538s	user 0.003s	sys 0.007s
I20260709 12:11:07.983799 12170 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.060890 12143 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.129731 12079 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.138099 12304 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.980516 11876 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.001209 12139 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.981376 12344 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.037701 12391 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.117622 11949 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.236992 12269 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.277205  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.354148  8833 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:07.952678 12273 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.285s
I20260709 12:11:08.037554 12379 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.288061  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.358095  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.271842 12417 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.167963 12389 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:08.292465 12094 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.293380 12315 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.368815 12315 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.295271 12199 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.221545  8753 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:08.297091  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.950927 12298 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.286s
I20260709 12:11:08.268591 12448 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.308548  8906 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:08.372906 12298 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.373409  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 1945) took 1798 ms. Trace:
I20260709 12:11:08.373545 12298 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.373821  8906 rpcz_store.cc:276] 0709 12:11:06.575628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.575819 (+   191us) service_pool.cc:224] Handling call
0709 12:11:06.584732 (+  8913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.880618 (+1295886us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b54001de0a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380badc0 00007fce381451c0 00007fce38146231 00007fce38142d8f 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c
0709 12:11:08.373097 (+492479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.373343 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165562112}
I20260709 12:11:08.035084 12252 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.246s
W20260709 12:11:08.376093 12080 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:08.067535 12433 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:07.984915 12312 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.377744 12314 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.377988  8751 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:08.378305 12314 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.378356 12312 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:08.074700 12255 consensus_queue.cc:1175] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd116b86a1e4445c994a361f776beba1" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 6 } }
I20260709 12:11:08.378888 12314 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:08.311734  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 83545.8us
I20260709 12:11:08.380476 12311 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.380738  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:08.315586  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74325.4us
W20260709 12:11:08.384150 12373 consensus_meta.cc:287] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.002s
I20260709 12:11:08.385298  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:08.346041 11876 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.386514 12433 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.353737 12305 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.387266 11876 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.387699 12418 consensus_queue.cc:1048] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:08.389297 12450 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:11:08.389144 12418 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:08.288523 12419 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.360479 12391 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.392395 12419 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.355525 12344 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.393110 12432 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.393631 12432 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.393991 12432 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.394184  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2183) took 1189 ms. Trace:
I20260709 12:11:08.340811 12079 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.394600  8834 rpcz_store.cc:276] 0709 12:11:07.204971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.684840 (+479869us) service_pool.cc:224] Handling call
0709 12:11:07.714206 (+ 29366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.714504 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.714532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.722875 (+  8343us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.099364 (+376489us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:08.099422 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.099522 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.393975 (+294453us) raft_consensus.cc:1685] finished
0709 12:11:08.393993 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.394127 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11388,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13225,"thread_start_us":325733,"threads_started":1,"wal-append.queue_time_us":415130}
I20260709 12:11:08.396329 12079 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:08.327018 12390 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.331108  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.331760  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.272862 12446 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.273013 12303 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.338037  8755 raft_consensus.cc:2410] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:11:08.320093 12420 consensus_meta.cc:287] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.001s
I20260709 12:11:08.315279 12267 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.282224 12310 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.330288 11840 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.356216  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.359197  8831 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:11:08.235270  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.238026 12410 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:08.362797 12449 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:11:08.369419 12199 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.326049  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.400049  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:08.400249  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.496126  8724 connection.cc:256] RPC call timeout handler was delayed by -1.0279300919999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:11:08.497067  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.400593 12298 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.401469  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.402879  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:08.403486 12094 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:08.404589  9524 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:08.324815 12388 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:08.416771  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.362042 12158 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.441578  8830 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:08.507130  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.442868  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.507836  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.385303 11666 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.452482  8906 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:08.406303 12373 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:08.455986  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 171629us
I20260709 12:11:08.456522  8833 raft_consensus.cc:2410] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:08.457059  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.454733 12410 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.520474  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:08.372948 12448 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.498605 12199 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.419011 12391 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.498564  8760 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:08.510453  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.530397  8831 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:08.403609 12421 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.449582 11840 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.565923  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.360500 12269 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.513010  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.513829  8903 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:08.572386  8903 pending_rounds.cc:85] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
I20260709 12:11:08.572682  8903 pending_rounds.cc:107] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:08.572933  8903 raft_consensus.cc:2889] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.507867  8907 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:11:08.574018  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.414108 12252 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:11:08.458458  8905 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:08.517298  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 130090us
I20260709 12:11:08.362480 12379 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.516605  8902 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:11:08.454365 12415 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.455681 12392 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.590696  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.519654  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.360605 11949 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.526140  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.501354 12271 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.533599  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:08.599099  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 65583.2us
I20260709 12:11:08.566725  8904 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:08.570720  8827 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:08.575460  8906 raft_consensus.cc:2468] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:08.577005  8832 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.579695 12139 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.580045 12094 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.580410 12079 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:08.523084 12315 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.592033  8833 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:08.526321 12314 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.599004  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.618705  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.619915  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:08.532464  8831 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:08.569620 11840 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.646552  8830 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:11:08.603451  8906 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:08.615311  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.652043  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.653239  8833 raft_consensus.cc:2410] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:11:08.519897 12158 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.620821  8908 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.621693  8900 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.617782  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:08.661823  8907 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:08.646602  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:08.662955  8831 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:08.656281 12470 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:08.604409 12271 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.665346 12454 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:08.668973  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:08.670220  8906 raft_consensus.cc:2410] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:08.602319 12269 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.604324 12461 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:08.585052 12415 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.675575  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:08.615649 12317 raft_consensus.cc:3055] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.656122  8724 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:08.614595 12414 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:08.679483  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.645843 12390 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:08.618402 12139 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.683319 12373 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.696424  8832 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:08.666114 12470 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:08.697230 12414 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.699590 12416 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.704998 12310 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:08.604843 12392 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:08.642401 12410 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.647511 12079 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:08.725350  8826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2159) took 2623 ms (client timeout 1705 ms). Trace:
W20260709 12:11:08.725898  8826 rpcz_store.cc:269] 0709 12:11:06.087201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.093707 (+  6506us) service_pool.cc:224] Handling call
0709 12:11:08.710291 (+2616584us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000d93d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:08.710409 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797519744}
I20260709 12:11:08.649453 12315 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.684959 12317 raft_consensus.cc:740] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:08.665926 12454 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.734624  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:08.645504 12094 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.711812 12414 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.711187 12325 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:08.767758  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.799119  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.742920 12452 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 12:11:08.689815 12269 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:08.690181 12461 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.833441 12303 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:08.724964 12416 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.862703 12303 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:08.863446 12303 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:08.864835 12416 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:08.706645 12390 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:08.906708  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.949972 12460 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:08.868185 12458 log.cc:927] Time spent T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:08.738145 12432 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:08.952355  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38804 (request call id 769) took 1136 ms. Trace:
I20260709 12:11:08.741817  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:08.950832 12399 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.959251  8757 rpcz_store.cc:276] 0709 12:11:07.815800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.817111 (+  1311us) service_pool.cc:224] Handling call
0709 12:11:07.817373 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.935255 (+117882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.935289 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.935780 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.136519 (+200739us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:08.136562 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.136655 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.395786 (+259131us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b480027ffd8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3d06caa1 00007fce3d063b37 00007fce3d0639ca 00007fce3d15b26f 00007fce3d15af37 00007fce3d16f55c 00007fce3d16f508 00007fce3d16f488 00007fce3d16f443 00007fce3d16e6ec 00007fce3c098a96
0709 12:11:08.741818 (+346032us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:08.952097 (+210279us) raft_consensus.cc:1685] finished
0709 12:11:08.952123 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.952280 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57715,"raft.queue_time_us":132973,"raft.run_cpu_time_us":2189,"raft.run_wall_time_us":442660,"spinlock_wait_cycles":13678848,"thread_start_us":200434,"threads_started":1,"wal-append.queue_time_us":329744}
I20260709 12:11:08.953289  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:09.066964  8900 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
W20260709 12:11:09.067413  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 90286.2us
W20260709 12:11:09.068595  9519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 700) took 3176 ms (client timeout 1755 ms). Trace:
I20260709 12:11:09.069387  8902 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 12: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:08.957078 12446 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:09.084501  9519 rpcz_store.cc:269] 0709 12:11:05.892266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.892676 (+   410us) service_pool.cc:224] Handling call
0709 12:11:09.068346 (+3175670us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540074e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:09.068512 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800712064}
W20260709 12:11:09.072844  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 416790us
I20260709 12:11:08.910079 12325 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.075786  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 653) took 1762 ms. Trace:
I20260709 12:11:09.089499  8829 rpcz_store.cc:276] 0709 12:11:07.312939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.790849 (+477910us) service_pool.cc:224] Handling call
0709 12:11:07.791210 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.911228 (+120018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.911261 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.911306 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.911334 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.075494 (+1164160us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54001ed7d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:09.075548 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.075715 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104870784}
I20260709 12:11:08.832885 12054 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:09.078915 12468 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:09.092257  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.100522  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:09.082399  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:08.739910 12457 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.083122  8834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.006s	sys 0.005s
W20260709 12:11:09.080343 12305 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
I20260709 12:11:09.086853  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:08.950923 12460 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:09.103609  8834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.005s
I20260709 12:11:09.011832 12448 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.065096 12454 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.107625  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.109189  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:09.112231  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:09.114897  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.012377 12399 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.120064  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.121088  8758 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:09.116986  8757 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:09.109007 12388 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.124125 12454 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.124240 12388 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.124822 12388 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.124734 12454 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.125309 12388 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.127012 12454 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.127638 12454 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:09.122401 12378 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.129108 12378 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.130095  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.129611 12350 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:09.131310 12143 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.131793  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.132126 12378 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.132648 12143 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.133229  8754 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:11:09.133477 12469 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:11:09.115818 12457 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.134178  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:09.134526 12466 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:11:09.134788 12323 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:09.135281 12323 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.135588  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.135737 12457 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.135932  9516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 711) took 2276 ms. Trace:
I20260709 12:11:09.136235  8835 raft_consensus.cc:2376] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9. Re-sending same reply.
I20260709 12:11:09.136561  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.137691  8757 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:09.138548  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.139634  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.141217  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:09.141738  9517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 704) took 3140 ms (client timeout 2211 ms). Trace:
W20260709 12:11:09.142373  9517 rpcz_store.cc:269] 0709 12:11:06.001406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.001523 (+   117us) service_pool.cc:224] Handling call
0709 12:11:09.141480 (+3139957us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400515754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:09.141647 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4754934528}
I20260709 12:11:09.141907  8835 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:09.142976  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.145255  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.145812  8758 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:09.147274  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.147801  8758 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:09.148527  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.149268  9517 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.149120  8758 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:08.951776 12317 consensus_queue.cc:260] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.095389 12421 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.120898 12158 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.104193 12459 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:11:09.109766 12054 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.097353 12470 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.110937 12468 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.136375  9516 rpcz_store.cc:276] 0709 12:11:06.859279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.860368 (+  1089us) service_pool.cc:224] Handling call
0709 12:11:06.909001 (+ 48633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.058837 (+149836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.058869 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.509581 (+1450712us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b2c00012878. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:11:08.510006 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.677298 (+167292us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:08.677346 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.677455 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.135588 (+458133us) raft_consensus.cc:1685] finished
0709 12:11:09.135609 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.135848 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1404,"raft.queue_time_us":68234,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4675,"spinlock_wait_cycles":2911488,"thread_start_us":256933,"threads_started":2,"wal-append.queue_time_us":207969}
W20260709 12:11:09.175536  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 81571.2us
I20260709 12:11:09.177898 12461 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.164693 11857 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:09.182739 12271 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.174825  9520 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:11:09.184942  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:09.188196  8908 consensus_meta.cc:287] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.000s
I20260709 12:11:09.168578 12317 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.158330 12402 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:11:09.216792  9516 raft_consensus.cc:1240] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.152786  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.202271  8908 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:09.214640  8757 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:09.220718  8758 raft_consensus.cc:2393] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:09.185735 12303 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.225953  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.226770  8756 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:09.191747 12470 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.230726  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:09.234025  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.199304 12410 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.242488  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.243337  8756 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:09.204274 12079 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:09.214516 12315 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.248822  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.254264  8756 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:09.239264 12470 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.201284 11857 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.239223 12421 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.239359 12390 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.340790 12399 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.332616 12325 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:09.348847 11840 consensus_meta.cc:287] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.682s	user 0.000s	sys 0.012s
W20260709 12:11:09.327978  8831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.007s	sys 0.006s
I20260709 12:11:09.301600 12432 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:09.331863  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 191985us
I20260709 12:11:09.284126 12417 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:11:09.257511  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.300004  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:09.356609 12414 consensus_meta.cc:287] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.525s	user 0.000s	sys 0.009s
W20260709 12:11:09.355799  8831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.006s
I20260709 12:11:09.359896 12414 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.355772 11840 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:09.363967  8904 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 7. Current term is 9. Ops: [7.7-7.7]
I20260709 12:11:09.364770 11857 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.365311 11840 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:09.306756  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 185025us
I20260709 12:11:09.305514  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1948) took 2398 ms. Trace:
I20260709 12:11:09.366737  8754 rpcz_store.cc:276] 0709 12:11:06.906731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.906858 (+   127us) service_pool.cc:224] Handling call
0709 12:11:06.929000 (+ 22142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.133647 (+2204647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.305179 (+171532us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b540014d7d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:09.305430 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5068157184}
I20260709 12:11:09.307713  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2188) took 1377 ms. Trace:
I20260709 12:11:09.369637  8827 rpcz_store.cc:276] 0709 12:11:07.930696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.311064 (+380368us) service_pool.cc:224] Handling call
0709 12:11:09.307442 (+996378us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003bcc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:09.307630 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377620352}
I20260709 12:11:09.322695 12054 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.374346  8754 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.358029  8874 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.375196 12421 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.359191 12432 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:09.358507  8756 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:09.379019  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2186) took 1450 ms. Trace:
I20260709 12:11:09.381881  8834 rpcz_store.cc:276] 0709 12:11:07.928666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.396136 (+467470us) service_pool.cc:224] Handling call
0709 12:11:08.396516 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.405734 (+  9218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:09.110992 (+705258us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.321408 (+210416us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.322239 (+   831us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.322431 (+   192us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.322479 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.322575 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.377917 (+ 55342us) raft_consensus.cc:1685] finished
0709 12:11:09.377959 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.378122 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":796545,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":9452,"raft.queue_time_us":559,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":34902,"thread_start_us":914692,"threads_started":2,"wal-append.queue_time_us":248008}
I20260709 12:11:09.380087  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:09.378435 12486 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.409058 12486 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.411588 12486 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.412997 12468 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.387362 12489 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.417956 12489 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.418455 12489 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:09.423785 12199 consensus_meta.cc:287] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.000s
I20260709 12:11:09.393178  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.395056 12323 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.423388 12388 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.398720  8754 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:09.455662  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.471053  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:09.669551  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 277457us
I20260709 12:11:09.673637  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.674329  8831 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:09.472404  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.675442  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.676201  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.676878  8831 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:09.677009  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.476831  8834 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:09.472021  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91980.7us
I20260709 12:11:09.680855  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.683020  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:09.690215  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.624788 12325 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.443161 12199 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.680593 12170 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:09.612743 12143 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.649876 12459 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.623929 12054 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.678112 12399 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.680425 12481 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.680848 12315 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.688064 12255 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.719446  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.720436  8831 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.726581  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.727440  8834 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.724048  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.725745 12255 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.723959 12468 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.722142 12143 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:09.712404 12170 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.752422 12486 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.722527 12054 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.755003 12481 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:09.786144 12347 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.770644  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.725200 12399 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.720805 12459 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.757781 12255 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.791076 12399 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.793576  8833 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:09.794521  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.795356  8835 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:09.795469  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.797017  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.797699  8833 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:09.798179 12170 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.788914 12489 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.799501 12143 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.796418  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.802206 12489 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:09.757563 12315 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:11:09.804845 12317 consensus_meta.cc:287] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.008s
I20260709 12:11:09.805490  8827 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:09.807530 12392 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.808092 12323 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.807866 12170 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:09.809166 12388 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.772305 12486 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:09.825930  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:09.828248  8834 raft_consensus.cc:2468] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:09.816089  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:09.829737  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:09.831040  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.831903  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:09.835163 12255 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:09.837498 12453 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.563s	user 0.005s	sys 0.003s
I20260709 12:11:09.799793  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.772022 12421 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.872431  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1972) took 2057 ms. Trace:
I20260709 12:11:09.863919  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.806571 12481 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.881501  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.880144  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.882754  8834 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:09.883152  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.883535 12481 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.878283 12304 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:09.862075  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 138319us
W20260709 12:11:09.847110 12496 log.cc:927] Time spent T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:09.879343  8759 rpcz_store.cc:276] 0709 12:11:07.814844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.815752 (+   908us) service_pool.cc:224] Handling call
0709 12:11:07.824669 (+  8917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.936758 (+112089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.936790 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.937212 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.274443 (+337231us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:08.274486 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.274564 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.836810 (+1562246us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:09.872042 (+ 35232us) raft_consensus.cc:1685] finished
0709 12:11:09.872074 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.872350 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111606,"raft.queue_time_us":131920,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":26338,"spinlock_wait_cycles":4634368,"thread_start_us":161304,"threads_started":1,"wal-append.queue_time_us":317238}
I20260709 12:11:09.830082 12486 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.884110  8833 raft_consensus.cc:2368] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 11. Current term is 12.
I20260709 12:11:09.878026 12054 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:09.846556 12414 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:09.885402  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.903003  8834 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:09.903472  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.904316  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.862046  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.887311  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:09.830392 12494 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:11:09.908110 12481 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:09.909231 12054 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.815150  8831 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:09.909749 12054 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.909658 12481 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.910346 12054 raft_consensus.cc:3060] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.897337  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2196) took 1309 ms. Trace:
I20260709 12:11:09.910900  8826 rpcz_store.cc:276] 0709 12:11:08.587766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.728492 (+140726us) service_pool.cc:224] Handling call
0709 12:11:08.953704 (+225212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.953946 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:09.362286 (+408340us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.896858 (+534572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.896938 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:09.897011 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.897104 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.897256 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270948,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":111496,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":826438,"threads_started":3,"wal-append.queue_time_us":402869}
I20260709 12:11:09.912775 12481 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:09.912878  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.915126  8835 raft_consensus.cc:2410] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:11:09.899286 12499 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:11:09.910555  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.920603  8831 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.922209  8874 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.923923  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.924440  8874 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.904347  8833 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:09.925630  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:09.926156  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.927155  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.919757  8834 raft_consensus.cc:2410] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:09.929414  8833 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:09.930744  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.929452  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:09.931257  8833 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.932494  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.933138  8834 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.935173  8725 leader_election.cc:400] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 11. Current term is 12.
I20260709 12:11:09.935567  8725 leader_election.cc:403] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:09.936944  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.902618 12304 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.932163 12481 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.919425 12414 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:09.918251 12506 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:09.934489 12489 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.932691 12258 raft_consensus.cc:2804] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:09.954128 12258 raft_consensus.cc:697] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:09.955134 12258 consensus_queue.cc:237] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.938817 12392 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.940927 12315 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.958523 12315 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:09.958978 12315 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:09.961020  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.963780  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:09.965128  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.964178  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.969611  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.974968  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.975615  8754 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:09.975785  8828 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.976886  8833 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:09.938400  8831 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:09.934654 12346 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.981187 12346 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:09.978116 12421 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.981261  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:09.981957 12421 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:09.982363 12346 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:09.934350 12388 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.934512 12393 raft_consensus.cc:2764] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:09.985088  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:09.947103  8834 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:09.945708 12481 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:09.970712  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.974136  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2178) took 1945 ms. Trace:
I20260709 12:11:09.986650  8832 rpcz_store.cc:276] 0709 12:11:08.028951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.310263 (+281312us) service_pool.cc:224] Handling call
0709 12:11:09.973941 (+1663678us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54003aacd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:09.974072 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611066112}
I20260709 12:11:09.988340  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:09.989125  8874 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.948740 12255 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:09.976763  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.977810 12317 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.976258 12170 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:09.980115  8725 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:09.985271 12505 log.cc:927] Time spent T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:09.973955  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:09.995311 12485 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.962437 12489 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:09.996465 12485 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:09.996971 12489 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.997706 12485 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.989851  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.001137  8754 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:09.962913 12506 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:09.991597  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.991767  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:09.992730  8759 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:09.993206  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.002660  8758 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:09.994891  8725 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:09.984392 12421 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.011757 12323 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.013957 12506 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.003446  9518 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 5.
I20260709 12:11:10.015275 12388 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:10.019891 12388 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:10.020877 12388 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.008587  8828 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:10.023310 12094 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:09.996526  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.024710 12199 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.025583  8798 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:09.987697 12481 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.027570  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:10.029239 12421 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.029628 12421 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.029999 12421 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.031819 12497 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:11:10.028421 12301 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:10.033324 12301 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:10.034247 12301 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.036125  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2322) took 1575 ms. Trace:
I20260709 12:11:10.037106 12323 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.037552 12323 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.037938 12323 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.978092 12143 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.036580  8904 rpcz_store.cc:276] 0709 12:11:08.460781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.600307 (+139526us) service_pool.cc:224] Handling call
0709 12:11:08.649167 (+ 48860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.364373 (+715206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.035832 (+671459us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540009ced4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:10.036055 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643318528}
I20260709 12:11:10.046442  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:10.045221  8874 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.048061  8801 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.058557 12506 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.059432 11949 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.059744 12410 raft_consensus.cc:2804] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.080076  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.081248  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:10.084254 12421 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.060392 12114 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.001511 12393 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.100313  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.060418 12410 raft_consensus.cc:697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:10.101303  9521 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 3.
I20260709 12:11:10.002573 12170 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.003695 12317 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:10.122622  8901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1961) took 2449 ms (client timeout 1538 ms). Trace:
W20260709 12:11:10.125415  8901 rpcz_store.cc:269] 0709 12:11:07.673478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.674039 (+   561us) service_pool.cc:224] Handling call
0709 12:11:10.122387 (+2448348us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400282154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.122535 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177807104}
I20260709 12:11:10.092868 12399 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.101753 12393 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:10.104051 12501 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.071326 12143 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.130568 12399 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.103175 12503 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.108907 12506 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.142709  8833 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.153555  8828 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.157122 12399 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.157904 12305 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:10.158902 12305 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.159261 12305 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:10.160074 12305 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.161580 12305 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.162371  8828 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:10.164578 12303 consensus_queue.cc:1059] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:10.165686  8828 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:10.166041 12303 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.166612 12303 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:10.167579 12303 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.167930 12475 consensus_queue.cc:1059] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:10.168735 12303 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.168814 12164 raft_consensus.cc:3055] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:10.183063  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.184299 12393 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.185253 12315 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.187511 12315 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.139482 12388 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:10.202118 12388 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.204814 12410 consensus_queue.cc:237] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.210009 12170 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.212080 12143 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:10.213593 12421 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.218398 12317 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.222546 12388 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.223807 12399 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.239466  8833 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:10.142957 12501 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:10.243337  8872 connection.cc:256] RPC call timeout handler was delayed by -1.8984646579999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:11:10.154174 12503 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:10.274261  8872 connection.cc:256] RPC call timeout handler was delayed by -1.433164657999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 12:11:10.261036  8724 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.667s (SENT)
I20260709 12:11:10.277959  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:10.278249  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:10.172329 12164 raft_consensus.cc:740] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:10.171010 12304 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:10.180789 12470 consensus_meta.cc:287] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.010s
I20260709 12:11:10.280877  8872 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:10.226893 12399 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.284956  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:10.244280 12255 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.244259 12485 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:10.287813 12164 consensus_queue.cc:260] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.288192 12255 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.280968 12094 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.289346 12094 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:10.289448 12164 raft_consensus.cc:3060] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.289783 12094 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.290619 12255 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.285653 12432 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.291658 12255 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.288488 12459 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.282974 12388 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.295310  8903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 665) took 1673 ms. Trace:
I20260709 12:11:10.295872  8903 rpcz_store.cc:276] 0709 12:11:08.622122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.124892 (+502770us) service_pool.cc:224] Handling call
0709 12:11:09.125183 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.293943 (+1168760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.293973 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.294015 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.294045 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.295059 (+  1014us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003d2054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:10.295108 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.295243 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687394688}
I20260709 12:11:10.288290 12485 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.299050 12485 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.300931  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:10.301301  8753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1950) took 3394 ms. Trace:
I20260709 12:11:10.301617  8834 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:10.301820  8753 rpcz_store.cc:276] 0709 12:11:06.907306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.907439 (+   133us) service_pool.cc:224] Handling call
0709 12:11:08.201850 (+1294411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.369524 (+167674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.301036 (+1931512us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002c24d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.301211 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975921536}
W20260709 12:11:10.303373  8909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 1944) took 3734 ms (client timeout 1570 ms). Trace:
W20260709 12:11:10.303809  8909 rpcz_store.cc:269] 0709 12:11:06.569345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.573616 (+  4271us) service_pool.cc:224] Handling call
0709 12:11:10.303162 (+3729546us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000b3954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.303290 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739090688}
W20260709 12:11:10.304443  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.274828 12501 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.308580  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.308972  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:10.309109  8755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1963) took 2816 ms (client timeout 3062 ms). Trace:
I20260709 12:11:10.280249 12503 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:10.309600  8755 rpcz_store.cc:269] 0709 12:11:07.492388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.492505 (+   117us) service_pool.cc:224] Handling call
0709 12:11:10.308906 (+2816401us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54000f69d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.309048 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818389248}
I20260709 12:11:10.310591  9516 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:10.311667 12348 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.312057  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.312309  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2174) took 2370 ms. Trace:
I20260709 12:11:10.312744  8830 rpcz_store.cc:276] 0709 12:11:07.942344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.507899 (+565555us) service_pool.cc:224] Handling call
0709 12:11:08.523954 (+ 16055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.647341 (+123387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.312042 (+1664701us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000e4f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:10.312229 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280746752}
I20260709 12:11:10.314038  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:10.311730  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:10.314924  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.315311  9525 raft_consensus.cc:2393] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:10.316036  9517 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:10.277349 12054 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.317342  8830 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:10.317546  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.318272  8757 raft_consensus.cc:2410] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:10.311590 12139 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.282996 12315 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:10.320264 12315 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.321593  8828 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.322578 12315 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.309160  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.328202  8757 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:10.329219  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:10.329453  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:10.332440  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.332813  8757 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:10.243000 12143 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.331100  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.333876  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.335390  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.323509  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.342836  8828 raft_consensus.cc:2393] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:10.339561  8757 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:10.242607 12347 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:10.349746  8759 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:10.353363  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.354879  8726 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:10.356833  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:10.358907  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.363368  8756 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.360137  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.312295 12348 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.330305 12392 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 11. Current term is 12.
I20260709 12:11:10.365846  8757 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.374122  9521 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:10.342437 12139 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:10.329610 12470 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.336472 12474 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:10.346223 12502 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:11:10.388896  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 307598us
W20260709 12:11:10.482213  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.567062  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.448743  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.572602  8757 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
W20260709 12:11:10.560523 12486 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.654s	user 0.015s	sys 0.002s
I20260709 12:11:10.596974 12486 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.365329 12475 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.578212  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.364467 12162 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.227s
I20260709 12:11:10.600657 12399 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.601090 12399 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.601490 12399 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.601655 12517 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:11:10.606281  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:10.607363 12486 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.593961 12470 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.346514 12143 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.595280 12503 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.610996 12503 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.611905  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:10.612833 12503 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.614378  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.616328 12143 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.620071  8757 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.610672 12399 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.630095 12399 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:10.565058 12520 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:10.634539  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:10.379513 12348 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.379007 12315 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.400096 12054 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.426890 12489 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:10.464946 12519 log.cc:927] Time spent T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:10.656095  8751 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:10.357604 12347 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.652408  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:10.392562 12255 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.257s
I20260709 12:11:10.586374 12522 raft_consensus.cc:2764] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:10.660068  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:10.676081  8831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.034s
W20260709 12:11:10.685467  8831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.034s
W20260709 12:11:10.676779  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 320036us
I20260709 12:11:10.652002 12399 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.687248  8726 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:10.690718  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2204) took 1002 ms. Trace:
I20260709 12:11:10.678654  8757 raft_consensus.cc:2410] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:10.691247  8826 rpcz_store.cc:276] 0709 12:11:09.688417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.913981 (+225564us) service_pool.cc:224] Handling call
0709 12:11:09.928664 (+ 14683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.928879 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.928905 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.928948 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.928979 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.929036 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.690557 (+761521us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54002170d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.690656 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32766336}
I20260709 12:11:10.694303  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 667) took 2397 ms. Trace:
W20260709 12:11:10.678907  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 393994us
I20260709 12:11:10.695446  9524 rpcz_store.cc:276] 0709 12:11:08.296734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.296982 (+   248us) service_pool.cc:224] Handling call
0709 12:11:08.315058 (+ 18076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.503505 (+188447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.693949 (+2190444us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b540005bc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:10.694219 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205076352}
I20260709 12:11:10.649611 12315 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.584803 12139 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.697268  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:10.709091  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.718128  8757 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.663268 12317 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:10.729593  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 396122us
I20260709 12:11:10.724798 12315 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.705582 12421 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:10.735023  8799 connection.cc:256] RPC call timeout handler was delayed by -1.6665113469998687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 12:11:10.741523  8799 connection.cc:256] RPC call timeout handler was delayed by -1.6565600540000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:11:10.688897 12399 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.740280  8757 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:10.658147 12503 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 12:11:10.728870 12481 consensus_meta.cc:287] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.004s
W20260709 12:11:10.745065  8799 connection.cc:256] RPC call timeout handler was delayed by -1.5788766329999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:11:10.747834  8799 connection.cc:256] RPC call timeout handler was delayed by -1.4775295039999037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:11:10.755072  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 338017us
I20260709 12:11:10.731979 12392 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.733482 12482 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.748224  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.735620 12346 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.767407 12534 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:10.763319 12501 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.774009 12534 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:10.751274 12481 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.774765  8832 raft_consensus.cc:1240] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:10.762015  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 66704.4us
W20260709 12:11:10.762684 12323 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.000s
W20260709 12:11:10.772157  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52048.6us
I20260709 12:11:10.777686 12323 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.781000 12323 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.749864 12317 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.744855 12522 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.748482 12399 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.748129 12525 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.816776 12522 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.817658 12525 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.819504 12522 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.819986 12525 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.792522 12432 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:10.799957 12521 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:10.762573 12482 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.797173 12317 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.823884 12317 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.823837 12481 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.797137 12344 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:10.802837 12164 consensus_meta.cc:287] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.003s
W20260709 12:11:10.803738 12114 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.004s
I20260709 12:11:10.805399 12347 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:10.790920 12303 consensus_meta.cc:287] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 12:11:10.815541 12139 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.815985 12475 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.816870 12489 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:10.744022 12421 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:10.799003 12323 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.819648 12348 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:10.837694  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 66108.7us
I20260709 12:11:10.838163 12421 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.835368 12258 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.841194 12258 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.845139 12482 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:10.845428 12094 consensus_meta.cc:287] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.007s
I20260709 12:11:10.850783 12348 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:10.851747 12094 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.854220 12094 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:10.839700 12323 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.855319 12315 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.856374 12379 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.857141 12323 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.846628 12501 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.837507 12543 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:10.857842 12315 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.864367  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 712) took 3259 ms. Trace:
I20260709 12:11:10.864851  9520 rpcz_store.cc:276] 0709 12:11:07.605427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.632257 (+ 26830us) service_pool.cc:224] Handling call
0709 12:11:09.152110 (+1519853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.203963 (+ 51853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.864114 (+1660151us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400515750. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:10.864293 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486282112}
I20260709 12:11:10.859794 12460 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:10.858541 12399 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.871106 12399 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.873732  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.874992  9516 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:10.863030 12258 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:10.874334 12421 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:10.880259 12415 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.879313  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:10.881700  9520 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:11:10.883350 12509 log.cc:927] Time spent T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.952s	user 0.004s	sys 0.010s
I20260709 12:11:10.884591 11876 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.885156 11876 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:10.885968 12421 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:10.886029 11876 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:10.887405 11876 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.880048  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:10.803637  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.813696  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:10.948505  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 115717us
I20260709 12:11:10.949766  8756 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:10.954277  8759 raft_consensus.cc:2410] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:10.955468  8757 raft_consensus.cc:2393] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:10.947641  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.814879  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.813791  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 1971) took 2999 ms. Trace:
I20260709 12:11:10.957988  8755 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.957747  8752 rpcz_store.cc:276] 0709 12:11:07.814557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.814955 (+   398us) service_pool.cc:224] Handling call
0709 12:11:07.815338 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.825093 (+  9755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.825146 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.830929 (+  5783us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.774323 (+1943394us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b480027ffd8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3d06caa1 00007fce3d063b37 00007fce3d0639ca 00007fce3d15b26f 00007fce3d15af37 00007fce3d16f55c 00007fce3d16f508 00007fce3d16f488 00007fce3d16f443 00007fce3d16e6ec 00007fce3c098a96
0709 12:11:10.461990 (+687667us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b18003ed640. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:11:10.732546 (+270556us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:10.732597 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.733385 (+   788us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.813464 (+ 80079us) raft_consensus.cc:1685] finished
0709 12:11:10.813489 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.813693 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21731,"raft.run_cpu_time_us":4040,"raft.run_wall_time_us":1827925,"spinlock_wait_cycles":11572352,"thread_start_us":270338,"threads_started":1,"wal-append.queue_time_us":2950790}
I20260709 12:11:10.960304  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:10.961853  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 672) took 1532 ms. Trace:
I20260709 12:11:10.962410  8829 rpcz_store.cc:276] 0709 12:11:09.428869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.429312 (+   443us) service_pool.cc:224] Handling call
0709 12:11:09.429558 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.429866 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.429890 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.670461 (+240571us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.889856 (+219395us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.889903 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.889981 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.882635 (+992654us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:10.960965 (+ 78330us) raft_consensus.cc:1685] finished
0709 12:11:10.961000 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.961394 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6523,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":5120,"spinlock_wait_cycles":11166976,"thread_start_us":218992,"threads_started":1,"wal-append.queue_time_us":219369}
I20260709 12:11:10.965953  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.973704  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.975911  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:10.969861  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 200271us
I20260709 12:11:10.977380  8752 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.952023  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.981683  8756 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:10.984122  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.985788  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:10.980607  8872 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:10.967458  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.951956  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.032110  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.009527  8751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 2001) took 1046 ms. Trace:
I20260709 12:11:11.025214  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.011224  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.036229  8831 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:11.011157  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 681) took 1083 ms. Trace:
W20260709 12:11:11.036664  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 56317.8us
W20260709 12:11:11.020854  8875 connection.cc:256] RPC call timeout handler was delayed by -1.2690414159999364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:11:11.015265  8829 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:11.010236  8827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35550 (request call id 669) took 1582 ms (client timeout 1786 ms). Trace:
I20260709 12:11:11.034271  8751 rpcz_store.cc:276] 0709 12:11:09.963363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.963503 (+   140us) service_pool.cc:224] Handling call
0709 12:11:11.009184 (+1045681us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001a18d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:11.009346 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110482688}
W20260709 12:11:11.038236  8827 rpcz_store.cc:269] 0709 12:11:09.428010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.429028 (+  1018us) service_pool.cc:224] Handling call
0709 12:11:11.009729 (+1580701us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000e6354. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:11.009985 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307062144}
I20260709 12:11:11.013724  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2184) took 1259 ms. Trace:
I20260709 12:11:11.037411  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:10.988468  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.046546  8829 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.053627  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.044791  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.039333  8832 rpcz_store.cc:276] 0709 12:11:09.754069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.153022 (+398953us) service_pool.cc:224] Handling call
0709 12:11:10.153627 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.775494 (+621867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.012962 (+237468us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400324e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:11.013475 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427990656}
W20260709 12:11:11.055306  8656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 236) took 29945 ms (client timeout 15000 ms). Trace:
I20260709 12:11:11.066282  8832 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:11.041360  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:10.988781  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.972151  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.046589  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.041849  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.051414  8755 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:11.072304  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.072605 12350 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:11.074198  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.038968  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.075971  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.078176  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.079456 12416 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.080498  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.081760  8759 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.082185  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.083256  9517 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:11.084131  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.085407  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:11.086299 12501 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:11.086714  9522 raft_consensus.cc:2393] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:11.087268 12501 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.089337  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:11.090224  9518 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.090297  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48965.5us
I20260709 12:11:11.091369  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.092883 12323 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.093202 12543 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.093519 12323 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:11.093931 12543 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.094322 12323 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.094538 12543 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.076454  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.030109  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.033476  8760 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.039109  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:11.037210  8833 rpcz_store.cc:276] 0709 12:11:09.927090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.984810 (+ 57720us) service_pool.cc:224] Handling call
0709 12:11:11.010724 (+1025914us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540037d054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:11.010935 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355418368}
I20260709 12:11:10.990151  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.073781 12350 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.034782  8756 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:11.058775  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.055377  8758 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:11.102216  8757 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:11.112150  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.112810  8905 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.114040  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.114574  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.115244  8903 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:11.115883  8909 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.116392  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.093428  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.117259  8756 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:11.117952  8901 raft_consensus.cc:1240] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:11.118285  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.119093  8756 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.119764  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.120981  8904 raft_consensus.cc:2410] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:11.121207 12474 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.122228 12432 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.122009 12474 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.123045 12432 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.126312 12094 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.127352 12094 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.129138 12344 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.130496 12094 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.080659 12416 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.078212 12460 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:11.142228  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.142639 12143 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:11.142216 12114 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.143775  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 51154.8us
I20260709 12:11:11.147437  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.150498  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.150745  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:10.958133  8799 leader_election.cc:336] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.570s (SENT)
I20260709 12:11:11.151805  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.124492 12391 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.158406  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.161626  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.114135 12346 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:11.155426  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.158371 12315 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:11.159049  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.156574 12460 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.159464 12388 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:11.160321  8754 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:11.166038  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 127124us
I20260709 12:11:11.165302  8799 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:11.178857 12114 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.182960 12416 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.183120  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:11.172675 12460 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:11.184764  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.188772  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:11.189771  8832 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:11.065241  8656 rpcz_store.cc:269] 0709 12:10:41.146743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.166891 (+ 20148us) service_pool.cc:224] Handling call
0709 12:11:11.054943 (+29888052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:58.835787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:59.060784 (+224997us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:59.060827 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:10:59.060857 (+    30us) tablet.cc:662] Decoding operations
0709 12:10:59.062120 (+  1263us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:59.062208 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:59.062239 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:10:59.156013 (+ 93774us) tablet.cc:701] Row locks acquired
0709 12:10:59.156031 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:59.156210 (+   179us) write_op.cc:270] Start()
0709 12:10:59.156339 (+   129us) write_op.cc:276] Timestamp: P: 1783599059156150 usec, L: 0
0709 12:10:59.156357 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:10:59.270728 (+114371us) log.cc:844] Serialized 4834 byte log entry
0709 12:11:00.022940 (+752212us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:00.950213 (+927273us) op_driver.cc:464] REPLICATION: finished
0709 12:11:01.132584 (+182371us) write_op.cc:301] APPLY: starting
0709 12:11:01.170758 (+ 38174us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:01.179440 (+  8682us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:01.179476 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:01.217645 (+ 38169us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:01.218090 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:11:01.218134 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:01.218671 (+   537us) log.cc:844] Serialized 89 byte log entry
0709 12:11:01.218941 (+   270us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.219371 (+   430us) write_op.cc:454] Released schema lock
0709 12:11:01.219466 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:01.237351 (+ 17885us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.237402 (+    51us) write_op.cc:454] Released schema lock
0709 12:11:01.290855 (+ 53453us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3814032a 00007fce380c5f14 00007fce380c5ec3 00007fce380c5e38 00007fce380c5df3 00007fce380c50dc 00007fce380eee16 00007fce380d6cbb 00007fce380c139d 00007fce380c4d75
Metrics: {"mutex_wait_us":1575636,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":128056,"apply.run_cpu_time_us":5976,"apply.run_wall_time_us":125991,"num_ops":12,"prepare.queue_time_us":316923,"prepare.run_cpu_time_us":41889,"prepare.run_wall_time_us":701913,"raft.queue_time_us":563420,"raft.run_cpu_time_us":25851,"raft.run_wall_time_us":357896,"replication_time_us":1793530,"spinlock_wait_cycles":309445888,"thread_start_us":856432,"threads_started":4,"wal-append.queue_time_us":402665,"wal-append.run_cpu_time_us":44036,"wal-append.run_wall_time_us":2731395}]]}
W20260709 12:11:11.190817  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 132479us
W20260709 12:11:11.193603  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46592.1us
I20260709 12:11:11.194350 12485 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.188827 12143 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.194834 12485 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:11.195379 12485 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.195924  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.197134  8907 raft_consensus.cc:1240] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:11.198585  9517 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:11:11.199343  8902 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.198835  8828 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.203341  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.204267  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:11.205363  8757 raft_consensus.cc:2410] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:11.212968  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.209385  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:11.216254  9489 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.786s (SENT) [suppressed 24 similar messages]
I20260709 12:11:11.216761  8753 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:11.218111  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.221771 12350 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.223687  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.224677  8903 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 5: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.225934  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.227130  8908 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:11:11.227246  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.226080  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.228324  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.228864  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.229705  8907 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.228888 12416 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:11.233754 12416 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.234122 12416 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:11.234526 12416 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.234870 12432 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:11.216225  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.179831  8657 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 7, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 7 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.224327  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.246397  8827 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:11:11.248010 12474 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.251538  8875 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.261950  8751 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:11.193672 12501 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.244298  8657 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:11.278961  8903 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:11.312379  8759 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:11.315069  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.285717  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:11.300725  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 86523.9us
I20260709 12:11:11.338276  8827 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.339637  8752 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:11.315338  8657 catalog_manager.cc:5697] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 5, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.343025  8657 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 7, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 7 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.344820 12379 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.345261  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.345378  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:11.345849  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 234647us
W20260709 12:11:11.353161  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 395173us
I20260709 12:11:11.357416  8835 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.358640  8905 raft_consensus.cc:2368] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7.
I20260709 12:11:11.358855  8828 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.360363  8905 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:11.360759  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.345381 12379 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:11.362353  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.367180  9518 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:11.365092  8875 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:11.386322  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50473.4us
W20260709 12:11:11.390192  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 194409us
I20260709 12:11:11.393925  9516 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.366727 12543 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.418393  9487 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:11.424788  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.431262  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.434689  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:11.434587  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.437917  8829 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:11.408262 12143 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.434021  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:11.438782  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:11.438028  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 173707us
I20260709 12:11:11.439833  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:11.443686  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.446229  8760 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:11.445150  8904 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:11.450147  8833 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:11.450294  8835 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.449398 11729 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.451975 11729 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.466135  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:11.466200  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 72008.3us
I20260709 12:11:11.469506 12258 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.436762 12460 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.470609 12501 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.471246 12501 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:11.475749  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.438038 12523 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.215s
I20260709 12:11:11.477747 12489 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.449836 12534 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.480768 12432 consensus_queue.cc:1059] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:11.481793 12432 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:11.483940 12143 raft_consensus.cc:3055] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.484333 12143 raft_consensus.cc:740] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:11.486289 12344 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:11.485344 12143 consensus_queue.cc:260] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.488405 12143 raft_consensus.cc:3060] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.485322 12460 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.490075  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.486528  8830 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:11:11.487783 12344 raft_consensus.cc:3055] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:11.503679  8905 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.452369 11729 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.516788  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 168326us
I20260709 12:11:11.517325  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.517890  8875 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:11.519078  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.519775  8907 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:11.521602  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.472468 12501 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.500463  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:11.528745  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 75814.9us
I20260709 12:11:11.486287  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.503526 12344 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:11.534119 12344 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.535890 12344 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.444823  8657 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 8, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:11.539160 12523 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:11.539980 12079 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:11.540467 12079 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.540843 12079 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.507833  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.513441  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.518159  8902 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.505321  8756 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:11.543653  8872 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:11.523590 12460 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:11.549707  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.551606  8832 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
W20260709 12:11:11.552306  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.544016  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 1988) took 1214 ms. Trace:
I20260709 12:11:11.554032  8828 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:11.524003  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:11.553982  8756 rpcz_store.cc:276] 0709 12:11:10.329232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.117935 (+788703us) service_pool.cc:224] Handling call
0709 12:11:11.543905 (+425970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.539196  8657 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:11.558012  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71798.6us
I20260709 12:11:11.543047  8908 raft_consensus.cc:2376] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6. Re-sending same reply.
I20260709 12:11:11.539242 12391 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:11.560396  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:11.560688  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.561214  9516 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:11.504105 12543 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.564157  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.561940  9487 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:11.570523  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.571218  9518 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:11.567355 12523 consensus_queue.cc:1059] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:11:11.574558 12305 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:11.575750 12503 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.577148  9517 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:11.577518  9524 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:11.578547  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.580030  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.580525  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:11.584610  8724 leader_election.cc:336] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Timed out: RequestConsensusVote RPC to 127.7.102.131:39537 timed out after 1.987s (SENT)
I20260709 12:11:11.585650 11876 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:11.585562  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.587929 12462 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.588413 12462 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.588814 12462 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.589442 12114 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:11.590173 12379 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.591948  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.564689 12346 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.593739 12346 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.594149 12346 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.586452 11876 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:11.595346  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.597154  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.593771  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:11.607141  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 45333.4us
I20260709 12:11:11.607764  8902 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:11.608062  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.569242 12460 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:11.603188  8657 catalog_manager.cc:5697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:11.610419  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.613379  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:11.614295  8832 raft_consensus.cc:2410] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:11.618021  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.621639 11876 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.625664 12399 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.625921  8832 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:11.626889  8833 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:11.549214 12323 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.630638  8827 raft_consensus.cc:2393] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:11.625846 12460 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.628465  8831 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:11.600569 12391 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:11.638120 12462 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:11.641031  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 104429us
I20260709 12:11:11.576524 12416 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.644892  8835 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:11.627758  8657 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 8, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:11.649719  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 125941us
I20260709 12:11:11.652117  8834 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:11.657071  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.657750 12169 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:11.658380 12169 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:11.659219  9519 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.659426 12169 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.673161  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.643245 12489 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.689587 12416 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:11.675751 12323 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.691841  8906 raft_consensus.cc:2410] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:11.693450  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.695197  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.696552 12432 consensus_queue.cc:1059] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:11.670742 12350 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:11.698204 12350 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.699064 12114 raft_consensus.cc:3055] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.687103  8798 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:11.703665  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.699522 12114 raft_consensus.cc:740] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:11.714629  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.701323 12474 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.714308  8657 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 7 to 8, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 8 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.689670 12485 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.721203 12323 raft_consensus.cc:2804] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.721801 12323 raft_consensus.cc:697] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:11.722941 12485 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.722752 12323 consensus_queue.cc:237] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.723095 11729 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.723742  8900 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.669262 12547 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:11.703786 12388 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.733732  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.729785  8657 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 5, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.745095  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.754791  8902 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:11.714397 12315 consensus_queue.cc:1059] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:11.716056 12079 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.769305  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:11.775077  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:11.780342 12258 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.783614 12534 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.784245 12534 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:11.802353  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.801800  8830 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:11.805027  8901 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:11.785583 12534 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:11.810192  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 49622.1us
I20260709 12:11:11.761813 12482 consensus_queue.cc:1059] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:11.820322 12079 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:11.825788 12305 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.826730 12305 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.827554 12350 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.815513  8657 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 5 to 6, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 6 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.848031 12315 raft_consensus.cc:3055] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:11.848583 12315 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:11.849632 12315 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.851012  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:11.853317  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 197583us
W20260709 12:11:11.860666  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 136101us
W20260709 12:11:11.864157  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.864940  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.864511  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:11.839740 12114 consensus_queue.cc:260] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.885476  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.852846 12501 consensus_queue.cc:1059] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:11.899121  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:11.901634  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:11.909179  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.912928  8657 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:11.898038 12114 raft_consensus.cc:3060] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.891918 12379 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.922605  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:11.930518 12558 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:11.911311 11729 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:11.915220 12534 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.935070  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.924610 12474 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.943848  8875 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:11.944921  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 66662.7us
I20260709 12:11:11.945516  8833 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.948822  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:11.949630  8756 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.932430 12379 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:11.934374 12501 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.955850  8831 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:11.955549  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.957732  8826 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:11.956377 12347 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:11.956467  8827 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:11.959740 12347 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:11.960870  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.956530 12379 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:11.962342 12347 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.964818 12474 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.965785 12485 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.966192 12485 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:11.967263 12474 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:11.967119 12485 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.968032 12474 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.969053  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.960948  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:11.983440  9516 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 4.
W20260709 12:11:11.984979  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 228082us
I20260709 12:11:11.988566  9518 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:11:11.993083  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.993939  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:11.995880  8908 raft_consensus.cc:1240] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.998878  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.999064  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:12.001061  8798 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.002002 12421 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.002038  8798 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.002501 12421 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:12.002905 12421 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.002945 12399 raft_consensus.cc:2804] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.003212 12501 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.003778 12399 raft_consensus.cc:697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:12.003863 12501 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:12.005090 12399 consensus_queue.cc:237] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.005120 12501 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:11.947052 12344 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:11.968536 12485 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.969323 12415 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.021188  8657 catalog_manager.cc:5697] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 5, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:12.028070  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.029454  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:11.975351 12305 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:12.062041  8657 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 5 to 6, leader changed from <none> to fd116b86a1e4445c994a361f776beba1 (127.7.102.130), now has a pending config: VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129), VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130), VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131), VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 6 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:12.062093 12564 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:11:12.066190  8657 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:12.069847 12564 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.070187  9518 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.070272 12564 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.071486 12564 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.074162 12525 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:11:12.024199 12079 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.068500  8657 catalog_manager.cc:5697] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.968561 12474 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.081143  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:12.077510  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.033319 12543 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.101886 12094 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.102406 12094 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.103233 12421 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.103458 12094 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.023964 12347 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:11:12.104911 12094 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.105800  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:12.109282  9518 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.112293 12543 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:12.114827 12543 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:12.120601  9524 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEARNER]: Advancing to term 9
I20260709 12:11:12.124887 12567 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.131451 12344 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.132189 12344 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.134151  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.134686 12344 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:12.135690  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.098060 12564 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.140549  9524 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:12.142179  9524 pending_rounds.cc:85] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting all ops after (but not including) 6
I20260709 12:11:12.142103 12569 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:12.162348  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 96207.9us
W20260709 12:11:12.129755 12346 consensus_meta.cc:287] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.535s	user 0.003s	sys 0.010s
I20260709 12:11:12.163302  9524 pending_rounds.cc:107] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:11:12.163228 12346 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.164983  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.165367  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.165693  8904 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:12.165030  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.166620  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.167701  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.167754  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:12.168938  9518 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 7: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
W20260709 12:11:12.143257 12554 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:11:12.179776 12379 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.180408 12379 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.180856  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2339) took 1032 ms. Trace:
I20260709 12:11:12.182436 12379 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:12.181457  8909 rpcz_store.cc:276] 0709 12:11:11.148456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.152437 (+  3981us) service_pool.cc:224] Handling call
0709 12:11:11.177572 (+ 25135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.204004 (+ 26432us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:11.204038 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.204567 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.385443 (+180876us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:11.385502 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.385588 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.180500 (+794912us) raft_consensus.cc:1685] finished
0709 12:11:12.180533 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.180751 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1317,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":173651,"threads_started":1,"wal-append.queue_time_us":555702}
I20260709 12:11:12.188899 12547 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.189375 12547 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.190243 12547 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.191680 12547 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.184175 12346 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:12.193463  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50575.1us
I20260709 12:11:12.197310  8900 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:12.197089 12571 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.134450  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2016) took 1195 ms. Trace:
I20260709 12:11:12.199368 12571 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.200181 12571 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:12.208272  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:12.208884  8828 raft_consensus.cc:3060] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.209103 12571 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.211054 12571 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.196197  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.215049  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:12.149850  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 127102us
I20260709 12:11:12.150856 12460 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.149114 12421 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:12.220181 12460 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:12.156991 12488 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.220784  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.221283 12460 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.222569 12460 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.161418 12388 raft_consensus.cc:3055] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.163792  9524 raft_consensus.cc:2889] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.223835 12388 raft_consensus.cc:740] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:12.224833 12388 consensus_queue.cc:260] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.141367 12415 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.226029 12388 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.170027  9488 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:12.175359  8756 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:12.147681 12474 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:12.206214  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.207561  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:12.236382  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 57926.3us
I20260709 12:11:12.237042  8830 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.148255  8657 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:12.215930 12379 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.217555 12258 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:12.220947 12488 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.252617  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.253625  8902 raft_consensus.cc:2410] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:12.159364 12315 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:12.155989 12462 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:12.241885  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.244755 12305 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:12.244762 12350 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.199216  8758 rpcz_store.cc:276] 0709 12:11:10.939156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.207462 (+268306us) service_pool.cc:224] Handling call
0709 12:11:11.207870 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.208273 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.208303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.262006 (+ 53703us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.564829 (+302823us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.601159 (+ 36330us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.601411 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.601483 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.848985 (+247502us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b180031fa80. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:12.130027 (+281042us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b180031fa80. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:12.134242 (+  4215us) raft_consensus.cc:1685] finished
0709 12:11:12.134262 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.134378 (+   116us) inbound_call.cc:177] Queueing success response
0709 12:11:12.186490 (+ 52112us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b180031fa80. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
Metrics: {"prepare.queue_time_us":36212,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2578,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":244,"spinlock_wait_cycles":30748160,"thread_start_us":298222,"threads_started":1,"wal-append.queue_time_us":341693}
I20260709 12:11:12.277577  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.245464  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.239627 12567 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.235919 12143 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.286562  8832 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:12.249771  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 97102.1us
I20260709 12:11:12.254954  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.098875 12525 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:12.279234  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.279810  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:12.274127  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.280854  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.281004  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.281579  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.290532  8907 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:12.278266  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.277702  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.283083  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.247339 12094 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:12.253383 12258 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.293877  8904 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:12.295011  8903 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:12.301653  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.302189  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74491.9us
I20260709 12:11:12.302876  8902 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:12.303208  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.304369  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.312995  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.313910  8906 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:12.313381 12525 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.325538  8902 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.326186  8902 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.327144  8902 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.328692  8902 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.329733 12258 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.332360 12258 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:12.333911  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:12.334403 12488 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.340618  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.341142  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.359174  9518 raft_consensus.cc:1275] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:12.341732  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.278254 12474 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.294318 11729 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:12.345459  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 57375.8us
I20260709 12:11:12.369525  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.370872  9488 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:12.371388  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.349203  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 53426.7us
W20260709 12:11:12.351578  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48492.4us
I20260709 12:11:12.373782  8904 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.284689 12565 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:12.379026  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.361172  8828 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:12.359318  8906 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.239430 12432 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:11:12.382406  9489 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.383019  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.376307  8907 raft_consensus.cc:2410] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:12.348726  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.271276 12564 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:11:12.401024  9488 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:12.396832  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.357795 12143 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:12.419358  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.297027 12114 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:11:12.421105  8833 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.358444 12482 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.377662  8830 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:12.404800 12379 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.415859  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.433858  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:12.376610 12462 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:12.444952  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44032.5us
I20260709 12:11:12.395357  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.417568  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:12.369486 12474 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:12.446225  8906 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.406734  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.405397  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.439431  8904 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:12.449241  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.454753  8902 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:12.456527  8902 pending_rounds.cc:85] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 5
I20260709 12:11:12.391587 12350 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.456641  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.402614 12416 raft_consensus.cc:2804] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.391404 12488 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.394503 12565 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.465914  8900 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.457377  8902 pending_rounds.cc:107] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:12.485201  8909 raft_consensus.cc:2368] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:12.489833  8902 raft_consensus.cc:2889] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:12.490010  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.485791  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 95618.3us
I20260709 12:11:12.485991  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:12.491146  8757 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.418956 11876 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.397392 12079 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:11:12.499243  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.500028  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.499959  8908 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
W20260709 12:11:12.501989  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.505268  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.505415  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.505824  8751 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.457110 12474 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.502880  8905 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:12.506798  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:12.508183  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.509012  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62753.7us
I20260709 12:11:12.516237  8830 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:12.519094  8909 raft_consensus.cc:2468] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:12.519259  8757 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:12.485246 12482 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:12.519599  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:12.489403 12565 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:12.524463  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.525506  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 212145us
I20260709 12:11:12.504050 12416 raft_consensus.cc:697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:12.500612 12350 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:12.526388  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.466388 12534 consensus_queue.cc:1048] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:11:12.503552 12346 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.538918  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.539718  8752 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:12.540138  8757 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:12.529174  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.530450  8755 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:12.523269  8904 raft_consensus.cc:2468] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.532230  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.533612  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:12.542330  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.499027 12379 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.538064  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.546134  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.546242  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 331302us
I20260709 12:11:12.548450  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.549304  8828 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 11: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:12.550798  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.553408  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.583842  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.604153  8831 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:12.617849  8909 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:12.553365  8753 raft_consensus.cc:2410] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:11:12.608700  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61531.8us
W20260709 12:11:12.604661  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 48967us
I20260709 12:11:12.551257 12169 consensus_queue.cc:1059] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:11:12.527884 12570 consensus_queue.cc:1059] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:11:12.619740  8725 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.626183 12350 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.626645 12323 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.627722 12323 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.634137 12567 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.634765 12567 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.635205 12567 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.637216 12482 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.640131 12379 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:12.621430 12388 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.642585  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.644002  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:12.658108  8906 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:12.657547  8902 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.667418  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.659504  8833 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:12.661309  8760 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:12.660768  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 135557us
I20260709 12:11:12.665616  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.669390  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.669780  8906 raft_consensus.cc:2376] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8. Re-sending same reply.
I20260709 12:11:12.543485 12534 consensus_queue.cc:1243] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer eaa6fbd6102948888c362ff1ea0b32e8 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:12.674580  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.670091  8908 raft_consensus.cc:2376] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10. Re-sending same reply.
W20260709 12:11:12.682394  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 63342.1us
I20260709 12:11:12.693305  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:12.703008  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.709892  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.716168  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.717149  8909 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:12.719422  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.710456 12543 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:12.694551 12388 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:12.749668  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 70227us
I20260709 12:11:12.699549 12379 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:12.711316 12501 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:12.762589  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.751215  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.712301 12399 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:12.756301 12543 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:12.767445 12571 consensus_meta.cc:287] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.004s
I20260709 12:11:12.775774  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:12.724107 12416 consensus_queue.cc:237] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:12.768061 11729 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:12.789348  8801 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:12.791379 12582 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.787043  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.787951  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:12.794891  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.797019  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.800194  9519 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:12.801728 12582 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:12.804170  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.808902  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:12.711582 12565 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.815812  8756 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 5.
I20260709 12:11:12.816246 12305 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.816823 12305 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:12.817204 12305 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.818706  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.818849 12590 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:11:12.821308 12589 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:12.821848 12054 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:11:12.823151 12581 log.cc:927] Time spent T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:11:12.824553  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.827893  8907 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.829221  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.830216  8907 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:12.820478 12590 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:12.848064  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.857491  8829 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:12.858770  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.860502  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.861764  8907 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 6: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:12.862294  8900 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.814725 11729 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:12.854956 12595 raft_consensus.cc:3055] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.881719  8909 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.882383  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:12.883500  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 132353us
I20260709 12:11:12.886209  8751 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.873204 12565 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.873479 11729 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:12.873529 12591 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:11:12.875252 12584 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:11:12.879962 12547 consensus_meta.cc:287] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 12:11:12.855363 12590 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.886956  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.897097  8751 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:12.863924  8799 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.013s
I20260709 12:11:12.885877  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.901023  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:12.904925  8799 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.013s
W20260709 12:11:12.905627  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 619673us
I20260709 12:11:12.905879  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.906629  8903 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:12.881845 12595 raft_consensus.cc:740] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:12.910404  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:12.920017  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:12.920935  8760 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:12.895160 12258 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:12.925983  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:12.905278 12590 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.934362 12599 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:12.935025 12599 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:12.923134 12460 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.942157 12474 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:12.933944 12586 log.cc:927] Time spent T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:11:12.891276 12485 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:11:12.950040 12592 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:11:12.959676  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 280614us
I20260709 12:11:12.960580  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:12.944545 12474 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:12.974119  8909 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:12.975955  8900 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.949010 12388 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:12.912842 12525 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:12.892374 12543 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:13.011281  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.927997 12582 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:11:13.036931  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 111048us
W20260709 12:11:13.054771  8905 consensus_meta.cc:287] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.513s	user 0.020s	sys 0.016s
I20260709 12:11:13.055341  8905 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:12.950843 12258 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.033416 12501 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:13.074961  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 114474us
W20260709 12:11:13.077538  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.078050  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.078367  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.079501  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.080305  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.085043  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:13.086221  8905 raft_consensus.cc:2410] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:13.087404  8901 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:13.088389  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:12.982865 12305 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.127833  8905 raft_consensus.cc:1240] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.074939 12388 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.149847  8760 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:13.150143  8905 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:12.977787 12595 consensus_queue.cc:260] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.135432 12460 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:13.157707 12488 consensus_meta.cc:287] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.657s	user 0.004s	sys 0.008s
W20260709 12:11:13.193691  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 59433.9us
I20260709 12:11:13.146826 12567 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.197058 12567 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.152840 12485 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.169850 12610 log.cc:927] Time spent T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:11:13.186594 12462 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.189726 12460 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.229931 12593 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.162658 12599 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.191031 12258 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.185926 12305 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.200093  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.210665  8904 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:13.130879 12054 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:13.244656 12593 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.277136 12590 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:13.278918  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.279862  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.280480  8760 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.282038  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:13.282714  9524 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
I20260709 12:11:13.283998  8875 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:13.284348  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.284878 12258 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.285322 12258 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:13.285678 12258 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.285851  8757 raft_consensus.cc:1240] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:13.286969  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.287696  8757 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:13.284727  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.289074  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.289366  8755 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:13.290969  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.291440  8755 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:11:13.289237  8758 raft_consensus.cc:1240] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.288609  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.293583  8751 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:13.292419  8759 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:13.294188  8758 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:13.294384  8757 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:13.294685  8758 pending_rounds.cc:85] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 6
I20260709 12:11:13.294989  8758 pending_rounds.cc:107] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:11:13.295210  8758 raft_consensus.cc:2889] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.284381  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.297685  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.229032 12462 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:13.303965  8756 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:13.307294 12315 consensus_meta.cc:287] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 1.010s	user 0.012s	sys 0.002s
I20260709 12:11:13.314199 12590 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.281384 12593 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.317322  8754 raft_consensus.cc:2410] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:11:13.321652 12597 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.531s	user 0.002s	sys 0.002s
I20260709 12:11:13.323400 12462 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.230525 12485 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.331208  8760 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:13.336012 12547 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:13.326066 12567 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.357492 12567 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:13.357970 12567 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.358875  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 211142us
W20260709 12:11:13.353799 12547 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:13.355685 12485 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:13.373680  8906 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:13.361837 12399 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.374910 12399 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.375990  8907 raft_consensus.cc:1275] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:13.377195 12399 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.377693  8903 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:13.402767  8872 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.395169  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.386133  9518 pending_rounds.cc:85] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting all ops after (but not including) 5
I20260709 12:11:13.405670  9518 pending_rounds.cc:107] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:11:13.405961  9518 raft_consensus.cc:2889] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.405788  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.404593  8908 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:13.406764  8755 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:11:13.410041  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 112450us
I20260709 12:11:13.408854 12614 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:13.378785 12323 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.419525  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:13.423072  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:13.418638 12565 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.441500 12114 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
W20260709 12:11:13.442049 12114 raft_consensus.cc:1068] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Unable to promote non-voter eaa6fbd6102948888c362ff1ea0b32e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:13.443503 12488 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.444021 12488 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.446218  8753 raft_consensus.cc:1240] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.447616  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:13.448854  8756 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.446274  8900 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:11:13.457051  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.426766 12323 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.409005 12567 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:13.459573  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.429725 12582 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.467200  8872 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.469125  8872 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.472365  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.446274 12488 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.428447 12258 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.485948  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:13.471056 12603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.017s	sys 0.013s
I20260709 12:11:13.490270  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.464759 12582 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.478150 12565 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.477648 12346 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.498270  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:13.491717 12603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.017s	sys 0.013s
I20260709 12:11:13.500605  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:13.497455  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 46819.6us
I20260709 12:11:13.512766 12432 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.513000  8724 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.513424 12432 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.514351  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.515632 12432 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.517669  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:13.518967 12607 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.519475 12258 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.519735 12607 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.520115  8724 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.521005 12305 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.502049  9520 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:13.494764 12114 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.505669 11876 consensus_queue.cc:1059] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:13.497429 12534 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:13.507166  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 43580.3us
W20260709 12:11:13.507736  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.497273 12079 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.492903 12488 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.526687  8872 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.529773  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:13.528756 12609 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 12:11:13.528903  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.499684 12565 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.506891 12567 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.536255  8724 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.536685  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:13.498036 12582 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.526988 12501 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:13.538373 12590 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.529707 12114 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.534078 12534 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.525837 12258 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.508392 12415 consensus_queue.cc:1059] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:13.540802 12565 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.543887 12598 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.758s	user 0.003s	sys 0.000s
I20260709 12:11:13.541842 12603 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:13.544267 12346 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.544193  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:13.544785 12323 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.544209 12602 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.533378 12547 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.549685  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:13.540560 12622 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:13.537171 12432 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.552815 12305 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.556314  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.567911  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.552963 12501 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.553982 12079 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:13.578830  8724 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.591607  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:13.606001  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61873.6us
I20260709 12:11:13.582365 12399 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.573729 12564 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:13.573688 12258 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:13.605285 12624 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.098s	user 0.005s	sys 0.000s
I20260709 12:11:13.617017  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.621835  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.620260 12346 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:13.625033 12590 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.627748  8752 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.628512 12346 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.629104  8751 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:13.611342 12602 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.612056 12547 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.620710  8799 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:13.601091 12305 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.607882 12432 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.645015  8799 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:13.641287 12460 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.662884  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:13.673633 12534 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:13.681659 12638 log.cc:927] Time spent T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:13.660688 12525 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:13.686111  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44360.8us
I20260709 12:11:13.660032 12114 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.660382 12567 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.689467  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44544.5us
I20260709 12:11:13.706828 12525 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.707556 12525 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.710183 12525 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.730006  8799 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:13.735136  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43816 (request call id 2027) took 1312 ms. Trace:
I20260709 12:11:13.735749  8754 rpcz_store.cc:276] 0709 12:11:12.412415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.412791 (+   376us) service_pool.cc:224] Handling call
0709 12:11:13.724534 (+1311743us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000f50d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:13.724777 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028865792}
I20260709 12:11:13.739192  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.705687 12567 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:13.733623 12630 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 12:11:13.750164  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 118535us
I20260709 12:11:13.752192  8872 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:13.753011  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 46656.3us
I20260709 12:11:13.752117  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.754076  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.755440  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.743175 12460 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.759186 12094 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.764308  8724 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.765297 12315 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.766471  8724 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.767933  8724 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.751019 12603 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.776467  8724 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.761595 12114 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.769589 12590 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.785741  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.788465 12603 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.773437 12315 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.771639 12607 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.769166 12258 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.793431  8755 raft_consensus.cc:1275] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:13.807269  8755 pending_rounds.cc:85] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 5
I20260709 12:11:13.807703  8755 pending_rounds.cc:107] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:13.808034  8755 raft_consensus.cc:2889] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.769317 12534 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:11:13.816151  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.819785  8758 raft_consensus.cc:2393] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:13.796039  8724 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.817571  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.784508 12543 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.793208 12432 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:13.821514  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 69514.9us
I20260709 12:11:13.822867  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.842412  8760 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:13.818198 12485 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:13.845284  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.817448 12114 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.838066 12543 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:13.889257  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61582.7us
I20260709 12:11:13.890749  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:13.891630  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 101533us
I20260709 12:11:13.892694  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:13.880489 12432 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:13.899458 12647 log.cc:927] Time spent T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:13.901105 12653 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:13.902493 12462 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.910574 12346 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.911303 12346 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.911790 12258 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.914525 12346 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.914827 12315 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.915827 12258 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:13.916921 12582 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.919564 12582 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:13.921351 12652 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:13.921640  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:13.922880 12654 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.918710 12258 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.928592  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:13.880153 12547 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.856391 12607 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.851315 12460 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:13.945421  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:13.946848  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:13.948009  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:13.951273  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:13.849515 12565 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.856058 12485 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:13.993870  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:13.992909  8907 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:13.857154 12114 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.002287 12114 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:13.954089 12547 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:14.004997  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 110548us
I20260709 12:11:14.005304 12547 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.005936  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:14.009012 12656 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.009553 12656 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.010684 12590 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.011722 12656 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.011833  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:14.012413 12654 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.013029  8903 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:14.013155 12654 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:14.013612  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.013780 12654 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.014178 12582 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.014814 12582 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:14.015239 12582 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.015630  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.015974 12654 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.016817  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.017985  8799 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.015923  8756 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:13.954227 12315 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:11:13.999919 12567 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.014091  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:13.996861  8905 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:13.998605  8901 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:14.030565  8900 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:14.031060  8900 pending_rounds.cc:85] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 9
I20260709 12:11:14.031323  8900 pending_rounds.cc:107] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:14.031571  8900 raft_consensus.cc:2889] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:14.016510 12654 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.030491  8904 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:14.033954  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.034812  8901 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.041540  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.052922  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.053184  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:13.955561 12652 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.013037 12543 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.081949  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.085502  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.060103  8905 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:11:14.075225  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.090157  8759 raft_consensus.cc:2368] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:14.076278  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.091523  8758 raft_consensus.cc:2393] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:14.077522  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.130491  8901 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:14.132583  8833 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.145813  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.151739 12595 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.069413 12485 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.063084 12569 raft_consensus.cc:3055] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.067070 12654 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.076932 12615 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.057389 12659 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.148391 12258 consensus_queue.cc:1048] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:14.081352 12054 raft_consensus.cc:3055] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.167600  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.067260 12460 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.170181  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.171008  8903 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.181739  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.131922 12114 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:14.188584  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 111180us
I20260709 12:11:14.205423  8833 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:14.189924  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.197090  8872 leader_election.cc:400] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:14.206303  8872 leader_election.cc:403] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.067848 12305 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.209592  8905 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:14.067652 12399 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.168787 12346 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.066032 12652 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.228097  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:14.227880  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 73894.6us
I20260709 12:11:14.232302  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.191334 12569 raft_consensus.cc:740] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:14.239310  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:14.235944  8833 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:14.235797  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.191776 12462 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:14.237342  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.238915  8903 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:14.201561 12054 raft_consensus.cc:740] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:14.252002  8724 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.253363  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.254552  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.074643 12501 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.220716 12525 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.259001  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.260193  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.221087 12664 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.269573 12315 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:14.270231 12659 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:14.270709 12590 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.233091 12094 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.271158 12666 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.270247 12662 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:14.277870  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:14.319612  8759 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.279028 12652 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.242534 12654 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:14.279618  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:14.280814 12399 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:14.285683 12501 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.286703 12651 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.288728 12567 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.288969 12323 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:14.292784 12616 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.257299 12565 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.236826 12346 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.328188  8833 raft_consensus.cc:2410] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:14.258045 12462 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.335613 12667 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.339880  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.333958  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.361786  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:14.360276  8828 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:14.368098  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.370893  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.373567  8760 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:11:14.374037  8760 pending_rounds.cc:85] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 5
I20260709 12:11:14.374351  8760 pending_rounds.cc:107] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:11:14.374657  8760 raft_consensus.cc:2889] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:14.367129  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 103937us
I20260709 12:11:14.318642 12593 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:14.379587  8724 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.333214 12567 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:14.414093  8759 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:14.340529 12079 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.422056  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.364424 12667 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:14.427083  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47627.7us
I20260709 12:11:14.432926  8724 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.309827 12659 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.325601 12525 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.330118 12654 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.418368 12567 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.358341 12258 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:11:14.340802 12323 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:14.452574  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 154669us
W20260709 12:11:14.438573  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 161943us
I20260709 12:11:14.425182 12590 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.319486  9519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:14.458971  9519 raft_consensus.cc:606] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.326303 12666 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.331453 12569 consensus_queue.cc:260] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.458987  8872 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:14.461081  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:14.438138 12599 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.435902  8724 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:14.498425  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62739.1us
I20260709 12:11:14.449698 12462 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.466320  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.337112 12651 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.436784 12379 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.341239 12616 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.497445  8835 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:14.450417 12488 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.450012 12655 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.429122 12079 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.440315 12607 consensus_queue.cc:1059] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:11:14.521111  8829 raft_consensus.cc:2393] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:14.450726 12594 consensus_queue.cc:1059] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.209s
I20260709 12:11:14.439225 12582 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.524151  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:14.530356  8829 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:14.522136 12677 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.519917 12488 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.532665 12642 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:14.533349 12642 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.534586 12488 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.535776 12642 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.537585 12672 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.538208 12672 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:14.539702 12681 raft_consensus.cc:2804] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.539331 12672 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.540274 12681 raft_consensus.cc:697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:14.541456 12670 log.cc:927] Time spent T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:14.541481 12677 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:14.543805 12665 log.cc:927] Time spent T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:14.545179  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.558013  8829 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.506105 12543 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.566047  8834 raft_consensus.cc:3060] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.551687 12569 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.548970  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 282624us
I20260709 12:11:14.517516 12564 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.468727 12590 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.526304 12599 consensus_queue.cc:1059] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:11:14.597615  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 98082.4us
W20260709 12:11:14.599727  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 140827us
W20260709 12:11:14.607679  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 146762us
I20260709 12:11:14.610986  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.617048  8830 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:14.619977  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.623947  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:14.619334  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:14.607304 12534 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.653738  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:14.623595 12543 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:14.661871  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:14.668771  8751 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:14.672123  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.525610 12667 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.673307  8760 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:14.674710  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.607697 12607 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 12:11:14.680648  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47151.3us
I20260709 12:11:14.621222 12603 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:11:14.677742  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 66965.4us
I20260709 12:11:14.607981 12564 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.691820  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:14.700043  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:14.700917  8830 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.706759  8904 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:14.676863 12614 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.636492 12534 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.722679 12685 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.723320 12685 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.670166 12346 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:14.725700 12683 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:14.725847 12685 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.727169 12462 raft_consensus.cc:3055] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.727669 12462 raft_consensus.cc:740] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:11:14.730348 12678 log.cc:927] Time spent T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:14.731222 12680 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.732704  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.733486  8831 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:14.734120  8907 raft_consensus.cc:1275] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:14.713640  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.735852  8902 raft_consensus.cc:2376] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12. Re-sending same reply.
I20260709 12:11:14.716823  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:14.721990  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 746) took 1083 ms. Trace:
W20260709 12:11:14.722672  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.737269  8760 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:11:14.744771  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 125493us
I20260709 12:11:14.661516 12675 consensus_queue.cc:1048] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:11:14.710675 12525 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.731818 12680 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.728675 12462 consensus_queue.cc:260] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.781373 12462 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.786968 12679 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.748963 12652 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.694809 12421 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:11:14.788345 12652 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.740983 12659 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.733721 12654 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.764979 11666 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.739708  9520 rpcz_store.cc:276] 0709 12:11:13.639012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.639709 (+   697us) service_pool.cc:224] Handling call
0709 12:11:13.660348 (+ 20639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.119843 (+459495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.119918 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.251957 (+132039us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.517113 (+265156us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:14.523417 (+  6304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.527355 (+  3938us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.721664 (+194309us) raft_consensus.cc:1685] finished
0709 12:11:14.721699 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.721884 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439352,"raft.queue_time_us":451500,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15644,"thread_start_us":167178,"threads_started":1,"wal-append.queue_time_us":280874}
I20260709 12:11:14.790345 11666 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.790741 12652 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.790865 11666 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:14.794569 12676 log.cc:927] Time spent T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 12:11:14.774919 12616 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.771180 12666 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.752007 12323 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:14.653718 12681 consensus_queue.cc:237] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.795755 12054 consensus_queue.cc:260] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.772560 12564 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.787611 12679 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:14.690668 12642 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:14.799923 12590 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.804286  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:14.881321  8906 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:11:14.815568  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 55881.5us
I20260709 12:11:14.820430  8828 raft_consensus.cc:1275] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:14.820313  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.768522 12599 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:11:14.825193  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61606.2us
I20260709 12:11:14.752619 12614 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:14.896013  8830 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:14.897894  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.901842  8831 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:11:14.902693  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 169324us
I20260709 12:11:14.903616  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.771127 12684 consensus_queue.cc:1059] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 12:11:14.827493 12415 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:14.715162 12677 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.881134 12079 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.913152  8725 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.937870  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.936008 12567 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.941277 12567 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:14.942111  8754 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.944711  8725 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:14.921691  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.917876 12054 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.913869 12570 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.921154 12094 consensus_meta.cc:287] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
W20260709 12:11:14.913779 12595 consensus_meta.cc:287] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.001s
I20260709 12:11:14.952332  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.971552  8875 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:14.973470  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.968083  8829 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:14.968505  9523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:14.973654  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.949098 12607 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.878665 12543 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:14.981761  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:14.973672 12114 consensus_meta.cc:287] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.007s
I20260709 12:11:15.041254 12114 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.949469  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:14.966377 12590 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.973837 12094 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:14.937440 12685 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:14.970793 12567 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:14.977676 12588 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.000784  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:14.985661 12693 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.014228  8830 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:15.019665 12680 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:14.988449 12564 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.023496 12698 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:14.969947 12570 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.023902 12346 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.997876 12614 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.089588 12667 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.028355 11666 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.034091  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:15.092466  8903 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.093660 11666 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.070636  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:15.096447  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:15.035027  8905 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:11:15.097182  8830 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:15.098127  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:15.098532  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:14.955145  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:14.966549 12686 consensus_queue.cc:1048] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:15.046813  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:15.054395  8834 raft_consensus.cc:2468] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:15.047809 12114 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:15.057749  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2047) took 1508 ms. Trace:
I20260709 12:11:15.051934  9523 raft_consensus.cc:606] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
W20260709 12:11:15.068147  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 456773us
I20260709 12:11:15.073961  8831 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:15.077540 12679 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.103325  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:15.079174  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.086704 12570 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.047740 12305 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:15.100570  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:15.109133  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62413.9us
I20260709 12:11:15.113998  9521 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:15.109913  9489 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:15.118348  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:15.122251  8905 raft_consensus.cc:2368] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
W20260709 12:11:15.125550 12569 consensus_meta.cc:287] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.003s
I20260709 12:11:15.111721  8757 rpcz_store.cc:276] 0709 12:11:13.549786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.611792 (+ 62006us) service_pool.cc:224] Handling call
0709 12:11:13.612253 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.612517 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:13.654967 (+ 42450us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.655377 (+   410us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.057043 (+1401666us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800389c20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce37cf9d70 00007fce37ced293 00007fce37ce2cea 00007fce37ce323a 00007fce3814da2a 00007fce3815d0bf 00007fce3815d038
0709 12:11:15.057309 (+   266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.057364 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:15.057415 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.057500 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.057651 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9791,"prepare.queue_time_us":101532,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":5176,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":935,"spinlock_wait_cycles":4873472,"thread_start_us":26055,"threads_started":1}
I20260709 12:11:15.127312 12698 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:15.122088  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 167069us
I20260709 12:11:15.128672  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.142004  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.075719 12346 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:15.109519 12564 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.145421  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:15.109390 12699 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.103155 11729 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.129418 12094 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.159350  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:15.129777 12590 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.160298  8909 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.126814 12655 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:15.126377 11666 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.168951  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.110986 12114 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.147233 12693 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.146667 12485 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.172170 12693 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.172326 12485 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.113076 12567 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.154265 12699 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.153888 11729 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.073045 12588 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.159986 12094 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.179832  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:15.178400  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:15.127846 12305 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.153491 12688 consensus_queue.cc:1059] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:15.208343  9524 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:15.208900  9523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:15.198029 12346 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.219067  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.211480  8903 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:15.170905 11666 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:15.210628  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 54451.7us
I20260709 12:11:15.182816 11729 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.221472  8724 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:15.223039  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:15.228214  8909 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:15.245597  9488 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:15.221951  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.158638 12564 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.219318  9523 raft_consensus.cc:606] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:15.232187 12614 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.249013  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.226823 11666 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.180261 12485 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.233857 12567 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.250608  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.178637 12699 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.177611 12701 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.207585 12094 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:15.263095  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.265739  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 120440us
I20260709 12:11:15.266475  8874 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.217729 12590 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:15.268149  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.268752  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:15.269595  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 67140.7us
I20260709 12:11:15.269838  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.253362 12346 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.224164 12543 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:15.303967  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.410130  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:15.383533 12706 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:11:15.287917 12567 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.373227  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68444.6us
W20260709 12:11:15.369495 12700 log.cc:927] Time spent T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:11:15.303872  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:15.434930  8760 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:15.330216  8757 raft_consensus.cc:1240] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.411535  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:15.415756  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 149335us
W20260709 12:11:15.283664 12707 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:11:15.178012 12655 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.259831 12569 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:15.426008  8751 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:15.386453 12716 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.345507 12079 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.356189 12315 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:15.315321 12595 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:15.387835  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.351042 12607 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.367713 12114 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.416913 12698 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.437026  8759 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:15.437170  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:15.367877 12693 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.442552  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:15.443104  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:15.484333  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47298.8us
I20260709 12:11:15.451133  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:15.485106  8760 raft_consensus.cc:2410] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:15.439358 12567 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.485369  8752 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:15.479785  8799 leader_election.cc:400] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:15.484858  9487 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:15.487011  8799 leader_election.cc:403] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.487619  8751 raft_consensus.cc:2410] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:15.388172 12590 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.491205  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.491585  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.456472 12079 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:15.495360  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:15.472747 12569 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:15.494475 12614 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 6. Current term is 7.
I20260709 12:11:15.468431 12716 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:15.517050  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 295660us
I20260709 12:11:15.522569  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.487902 12114 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.529764  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:15.530011  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 286334us
I20260709 12:11:15.497825 12611 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:15.500087 12079 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.478678 12315 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.535923  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.481472 12595 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:15.536435  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 65567.3us
I20260709 12:11:15.539454  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:15.542590  8799 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:15.548766 12655 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.549984  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.538570 12693 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:11:15.532876 12611 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:15.526778 12305 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.589716  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.544577  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.593051 12079 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.572661 12716 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.570149 12569 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:15.599339  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68675.9us
W20260709 12:11:15.600500  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 61136.2us
I20260709 12:11:15.617451 12680 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.618187 12680 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.544837 12567 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.626276  8900 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.629952  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.607138 12611 raft_consensus.cc:3060] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.598349 12595 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.620386 12680 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.609251 12615 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:15.637332  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 94830.7us
I20260709 12:11:15.629144  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:15.653384  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:15.630384 12488 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.596616 12094 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.652419 12681 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.670418 12615 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:15.671422  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2274) took 1329 ms (client timeout 1757 ms). Trace:
W20260709 12:11:15.692772  8835 rpcz_store.cc:269] 0709 12:11:14.342302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.342510 (+   208us) service_pool.cc:224] Handling call
0709 12:11:15.671195 (+1328685us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400216bd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:15.671337 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289276672}
I20260709 12:11:15.697147  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.703405 11666 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.705765 11666 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.706285 12614 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:15.706773 12614 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.707924 11729 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.709067  9520 raft_consensus.cc:2393] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:15.709654 12614 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.710026 11729 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.714942  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.724498  8903 raft_consensus.cc:2410] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:15.691876  8909 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 12: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:15.690040 12681 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.737613  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.745992  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:15.736577 12658 log.cc:927] Time spent T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 1.505s	user 0.006s	sys 0.000s
I20260709 12:11:15.731725 12079 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.742003 12681 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.757905  9518 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.751772 12315 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:15.781178 12725 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:15.781679 12667 consensus_meta.cc:287] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.005s
I20260709 12:11:15.817103 12094 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.832111  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2055) took 1640 ms. Trace:
I20260709 12:11:15.834823  8754 rpcz_store.cc:276] 0709 12:11:14.192009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.274546 (+ 82537us) service_pool.cc:224] Handling call
0709 12:11:14.274901 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.942628 (+667727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.831785 (+889157us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540014c8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:15.832026 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533940992}
I20260709 12:11:15.835655 12564 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.807297 11729 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:15.841727 11729 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:15.842825 12699 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.004s
I20260709 12:11:15.843338 12699 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.843904 12681 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.845629 12699 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.846997 12681 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.844267 11729 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
W20260709 12:11:15.849018  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.854292 12582 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.859954 12616 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.860237 12611 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.860742 12616 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.861608  9521 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:15.862829 12611 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:15.863884 12616 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.867725  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.919344  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.920346  8908 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:15.922550  8908 raft_consensus.cc:1240] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:15.922693  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 293603us
I20260709 12:11:15.922632 12701 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:15.923739  8908 raft_consensus.cc:1240] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.924238 12726 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.924778 12726 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.925058  8908 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:15.925165 12726 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.926585  8908 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:15.930028  8875 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.930286 12114 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.931063 12432 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.931622 12432 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.934059 12432 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.938333 12681 raft_consensus.cc:1064] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:15.945031 12681 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.949067 12718 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.955456 12379 raft_consensus.cc:3055] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:15.956041 12379 raft_consensus.cc:740] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:15.957068 12379 consensus_queue.cc:260] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.960728  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:15.961732  8908 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:15.963301 12565 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:15.963644  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:15.963891 12565 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:15.965389 12616 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.965121 12565 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:15.965833 12616 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.966248 12616 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.966338 12565 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:15.971946  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 322943us
I20260709 12:11:15.976419  8908 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:15.979975  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.981980 12616 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.982570 12582 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.983099  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:15.930864 12114 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:15.986491 12114 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:15.978569 12534 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:15.987896 12705 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.728s	user 0.001s	sys 0.003s
I20260709 12:11:15.989830  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:15.990711  9519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35686 (request call id 701) took 1075 ms. Trace:
I20260709 12:11:15.991066  9519 rpcz_store.cc:276] 0709 12:11:14.915504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.915655 (+   151us) service_pool.cc:224] Handling call
0709 12:11:15.989610 (+1073955us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b58001b0998. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:11:15.990623 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14653184}
I20260709 12:11:15.991873 12616 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:15.993455  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 2045) took 1184 ms. Trace:
I20260709 12:11:15.994239  8756 rpcz_store.cc:276] 0709 12:11:14.809388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.809539 (+   151us) service_pool.cc:224] Handling call
0709 12:11:14.870483 (+ 60944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.871050 (+   567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.871097 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.877447 (+  6350us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.117520 (+240073us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:15.117562 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.117643 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.987011 (+869368us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:15.992925 (+  5914us) raft_consensus.cc:1685] finished
0709 12:11:15.993007 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.993355 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1460,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7536,"spinlock_wait_cycles":12519168,"thread_start_us":181975,"threads_started":1,"wal-append.queue_time_us":262603}
I20260709 12:11:16.003163  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:16.004544  8906 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.006345  8875 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:16.008060 12667 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.008687 12114 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.016355  8906 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:16.016418  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:16.017333  9522 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.017982  9488 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:16.020499  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.020498  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.021601  9516 raft_consensus.cc:2410] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:16.024698  8900 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:16.027138  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 96736.5us
I20260709 12:11:16.027551  8900 raft_consensus.cc:1240] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:11:16.028436  8906 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:16.031076  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:16.032330  9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.032935  9519 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:16.035485  8875 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:16.035758  9519 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:16.008134 12582 consensus_queue.cc:1059] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:16.022099 11729 raft_consensus.cc:2804] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:16.038976  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.039422  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.016904 12667 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:11:16.019371 12611 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:11:16.044950 12690 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:16.022262 12543 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:11:16.024302 12614 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:16.037514 11666 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:16.039314  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:16.050074 12681 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.050714 11729 raft_consensus.cc:697] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:16.078670  8904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 710) took 1034 ms. Trace:
I20260709 12:11:16.078500 11729 consensus_queue.cc:237] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.079129  8904 rpcz_store.cc:276] 0709 12:11:15.044689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.552275 (+507586us) service_pool.cc:224] Handling call
0709 12:11:15.552596 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.772465 (+219869us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:15.787153 (+ 14688us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.935784 (+148631us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.936315 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.936475 (+   160us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:15.936740 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.936913 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.937002 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.078433 (+141431us) raft_consensus.cc:1685] finished
0709 12:11:16.078458 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.078612 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151348,"prepare.queue_time_us":16429,"prepare.run_cpu_time_us":356,"prepare.run_wall_time_us":2096,"raft.queue_time_us":158425,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":313,"spinlock_wait_cycles":168320,"thread_start_us":198807,"threads_started":2,"wal-append.queue_time_us":55899}
W20260709 12:11:16.082899 12743 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:11:16.086566 12614 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.087440 12614 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.090579  9522 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:16.093909  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:16.097332  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40132 (request call id 713) took 1051 ms. Trace:
I20260709 12:11:16.069212 12681 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.097995  8905 rpcz_store.cc:276] 0709 12:11:15.045505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.656330 (+610825us) service_pool.cc:224] Handling call
0709 12:11:15.667997 (+ 11667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.928587 (+260590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.928618 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.929136 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.026212 (+ 97076us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:16.096550 (+ 70338us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.096927 (+   377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.097036 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.097092 (+    56us) raft_consensus.cc:1685] finished
0709 12:11:16.097109 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.097264 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260176,"prepare.queue_time_us":15033,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":260733,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":47,"thread_start_us":151278,"threads_started":2,"wal-append.queue_time_us":115218}
I20260709 12:11:16.095840 12565 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.092435 12726 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.101965 12681 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.116472 12745 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.109884 12565 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:16.121572  8908 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.126518 12565 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.134398 12726 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:16.118582 12745 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.153044 12745 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:16.155305  8833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2233) took 1562 ms (client timeout 1573 ms). Trace:
W20260709 12:11:16.155792  8833 rpcz_store.cc:269] 0709 12:11:14.593293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.599350 (+  6057us) service_pool.cc:224] Handling call
0709 12:11:16.155062 (+1555712us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003bcc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:16.155220 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277824384}
I20260709 12:11:16.138010 12614 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.140517  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.159166 12651 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:16.159895  8875 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:16.161190 12651 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:16.141156  8758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.020s
I20260709 12:11:16.141258  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:16.143577 12379 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.137106 12749 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.146785 12593 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.147099 12602 raft_consensus.cc:3055] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:16.148008  8906 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:16.189514  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:16.122560 12667 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:16.171518  8758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.009s	sys 0.020s
I20260709 12:11:16.169754 12054 raft_consensus.cc:3055] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.187283 12679 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.188282 12602 raft_consensus.cc:740] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:16.260061  8904 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:16.204018  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:16.254397 12054 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:16.261969 12602 consensus_queue.cc:260] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.263513 12602 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.263451 12054 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.265144 12054 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.204409 11729 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:16.287909  8907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 2016) took 1595 ms. Trace:
I20260709 12:11:16.200794 12749 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.257332 12748 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:16.242142 12667 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.289932  8907 rpcz_store.cc:276] 0709 12:11:14.691959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.692132 (+   173us) service_pool.cc:224] Handling call
0709 12:11:14.692465 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.734564 (+ 42099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.287481 (+1552917us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400117954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:16.287782 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94965120}
W20260709 12:11:16.299937  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.204221 12593 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.257045 12679 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.290997  9520 raft_consensus.cc:606] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
W20260709 12:11:16.307354  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.284029 12614 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:16.307544  9520 raft_consensus.cc:614] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.304140 12745 consensus_queue.cc:1048] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:11:16.320109 12750 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:16.301489 12748 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.351541  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:16.359308 12748 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.361050  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:16.361485 12749 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.359689  9520 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:16.362743  9520 raft_consensus.cc:614] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.359841  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:16.371233 12681 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.372339 12679 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:16.374893  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.375150  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:16.354465 12651 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.382671  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2402) took 2141 ms. Trace:
W20260709 12:11:16.383423  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.383196  8901 rpcz_store.cc:276] 0709 12:11:14.241492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.241600 (+   108us) service_pool.cc:224] Handling call
0709 12:11:14.241874 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.419578 (+177704us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:14.445775 (+ 26197us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.602344 (+156569us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.602531 (+   187us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.603671 (+  1140us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.603809 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:14.603978 (+   169us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.604148 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.732055 (+127907us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b18003a7a40. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350242a6 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419
0709 12:11:15.025834 (+293779us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18003a7a40. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:16.382197 (+1356363us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540001aed4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:16.382268 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.382334 (+    66us) raft_consensus.cc:1685] finished
0709 12:11:16.382352 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.382553 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25070,"prepare.queue_time_us":69026,"prepare.run_cpu_time_us":168,"prepare.run_wall_time_us":5869,"raft.queue_time_us":163202,"raft.run_cpu_time_us":711,"raft.run_wall_time_us":61535,"spinlock_wait_cycles":398770176,"thread_start_us":105131,"threads_started":1,"wal-append.queue_time_us":283119,"wal-append.run_cpu_time_us":3226,"wal-append.run_wall_time_us":1027614}
I20260709 12:11:16.391498 12698 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:16.392541 12698 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.394100  9517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.394950  9517 raft_consensus.cc:2368] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10.
I20260709 12:11:16.395246 12698 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.395810 12698 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.396406 12698 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:16.404754  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.377473  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:16.380393 12681 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.400007 12593 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.400262 12749 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.425323 12379 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.426218 12379 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.432192 12698 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.433280 12698 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:16.439821  9524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35686 (request call id 702) took 1504 ms (client timeout 1799 ms). Trace:
I20260709 12:11:16.410704  9520 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.447247 12599 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.448419 12599 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.451764 12588 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.451239 12599 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.452731 12749 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.455482 12749 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:16.459472  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.434041 12698 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:16.440359  9524 rpcz_store.cc:269] 0709 12:11:14.935894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.937517 (+  1623us) service_pool.cc:224] Handling call
0709 12:11:16.439521 (+1502004us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400485654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:16.439730 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620291840}
I20260709 12:11:16.485219  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.494073  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.494095 12379 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.502774 12698 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.468608 12599 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.505497 12599 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.507746 12599 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:16.536055  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.542321  8725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.467039 12602 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.547173 12763 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.547879 12763 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.550582 12763 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.568761  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:16.573200  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.582118  8904 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:16.582383  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:16.583179  8902 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
W20260709 12:11:16.588251  8726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.132:32899 timed out after 1.978s (SENT) [suppressed 35 similar messages]
I20260709 12:11:16.581111 12763 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.584419 12599 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.546571 12602 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:16.601498  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.599463  9488 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:16.606850  9524 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:16.546798  9520 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:16.610353  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.611256  8756 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:16.592865 12763 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.595451 12599 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.603034 12114 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.627244  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.628274  8755 raft_consensus.cc:2393] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
W20260709 12:11:16.630852  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.636027  8756 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:16.619086 12763 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.626338 12602 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.657640  8754 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:16.657496  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.661767  8753 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
W20260709 12:11:16.663030  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 74860.6us
I20260709 12:11:16.665151  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.665719  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.665980  8756 raft_consensus.cc:2368] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9.
I20260709 12:11:16.667171  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.670483  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.636549 12698 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.634562 12718 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:16.636032 12459 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.674172 12582 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.674578  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.680886  8754 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:16.674644 12748 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.682662  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.685806  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.634065 12114 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.694128  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.676891 12745 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.694870  8757 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:16.679045 12459 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.679909 12718 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.686517 12582 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.702889 12459 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.677794 12698 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.687002  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.720804 12698 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.721256  9520 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:16.706658  8905 raft_consensus.cc:1240] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.685262 12614 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.714676  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:16.726526  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 74043.3us
I20260709 12:11:16.715670  8757 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:16.711858 12718 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.730633 12756 consensus_queue.cc:1059] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:16.731093 12679 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:16.735185  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.737004  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.737774  8757 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.738519  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:16.739818 12681 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:16.740016 12690 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.742375  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 735) took 1921 ms. Trace:
I20260709 12:11:16.743571  8827 rpcz_store.cc:276] 0709 12:11:14.821274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.878641 (+ 57367us) service_pool.cc:224] Handling call
0709 12:11:15.672037 (+793396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.672222 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.672249 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.672312 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.672342 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.672395 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.742201 (+1069806us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400216bd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:16.742312 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823823104}
I20260709 12:11:16.687731 12748 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.717855 12582 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.751051 12748 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.759943 12459 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.761549  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.762310 12459 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.762871  8751 raft_consensus.cc:2410] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:16.764222  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:16.764554  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.765043  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.765710  8758 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:16.745312 12690 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:16.767912 12690 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.731875 12614 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:16.769078  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:16.769750  8905 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.770119 12614 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.771934  8751 raft_consensus.cc:3060] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.774926 12114 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:16.775151  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40132 (request call id 708) took 1740 ms. Trace:
I20260709 12:11:16.775599  8909 rpcz_store.cc:276] 0709 12:11:15.034209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.281898 (+247689us) service_pool.cc:224] Handling call
0709 12:11:16.774930 (+1493032us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001635d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:16.775062 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608881024}
I20260709 12:11:16.703140 12745 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:16.782250 12745 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.797791  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.798714  8758 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:16.813218  8751 raft_consensus.cc:2468] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:16.814006  8757 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:16.810045  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:16.816431  8726 leader_election.cc:400] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10.
I20260709 12:11:16.817058  8726 leader_election.cc:403] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:16.818681  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.819700  8758 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:16.821084  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.822654  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.823459  8751 raft_consensus.cc:3060] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.821897  8758 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:16.829614  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.830603  8757 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.848317  8751 raft_consensus.cc:2468] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:16.852795  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.853991 12763 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.857788  8757 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:16.855557  8751 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 4.
I20260709 12:11:16.870169  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.870708  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.870870  8757 raft_consensus.cc:2376] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8. Re-sending same reply.
I20260709 12:11:16.833930  8726 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:16.872174  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.856349 12771 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:16.876139 12771 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.878288 12771 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.881963  8757 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:16.883167  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.884052  8757 raft_consensus.cc:2393] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:16.895179 12763 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10.
I20260709 12:11:16.901630 12763 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.906483 12763 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.906917 12763 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.905905  8751 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
W20260709 12:11:16.915359  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.938961 12763 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:16.942523 12763 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:16.942567  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:16.943497  8758 raft_consensus.cc:3060] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.957758  8758 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:16.964984 12599 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:16.975016  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 2040) took 1798 ms. Trace:
I20260709 12:11:16.975461  8908 rpcz_store.cc:276] 0709 12:11:15.176908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.981263 (+804355us) service_pool.cc:224] Handling call
0709 12:11:15.981610 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.124606 (+142996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.974740 (+850134us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400282b54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:16.974946 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321344896}
I20260709 12:11:16.984624  8908 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.985689  8752 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.992705  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:16.993422  8760 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:16.994498 12763 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:16.995102 12763 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:11:16.996805  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 268472us
I20260709 12:11:16.997920 12763 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.004300 12667 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.007913 12488 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:16.804036 12690 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.026759 12690 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.034451 12690 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.035130 12690 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.038767  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.037801 12690 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.032930  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.041463  8758 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:17.045197  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:17.046554  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:17.050129  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.048367 12690 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.051532 12690 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.060021  8905 raft_consensus.cc:2468] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:17.065047  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.066877  8908 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:17.082262  8905 raft_consensus.cc:1240] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.089079 12690 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:17.089443  8725 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.573s (SENT)
I20260709 12:11:17.093699  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.095278  9487 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.096078  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:17.096321  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.096741  9525 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.097852  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.095454  8753 raft_consensus.cc:1275] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:17.099864  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.101297  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.103565  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2270) took 2797 ms. Trace:
I20260709 12:11:17.102084 12690 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.104242 12690 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.103997  8832 rpcz_store.cc:276] 0709 12:11:14.306248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.306470 (+   222us) service_pool.cc:224] Handling call
0709 12:11:14.327577 (+ 21107us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:14.459351 (+131774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.459387 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:14.508136 (+ 48749us) log.cc:844] Serialized 52 byte log entry
0709 12:11:15.007179 (+499043us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:15.007224 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.100681 (+2093457us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000d75d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:17.100733 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.100777 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:17.100789 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.103466 (+  2677us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":35446,"spinlock_wait_cycles":301908352,"thread_start_us":460657,"threads_started":1,"wal-append.queue_time_us":622311,"wal-append.run_cpu_time_us":8794,"wal-append.run_wall_time_us":1436446}
W20260709 12:11:17.106817  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.106868 12690 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.110078  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:17.115000  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.117445  9525 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:17.119289 12569 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.120028 12569 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.121179 12054 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:17.121623 12054 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.122006 12054 raft_consensus.cc:3060] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.123710 12569 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.123538  9487 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.124801  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.124861 12763 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:17.126426  8908 raft_consensus.cc:2393] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:17.119966  8872 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.116283 12588 raft_consensus.cc:2764] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:17.130440  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.132514  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.132949 12755 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.135433 12593 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:17.136015 12593 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:17.125835 12763 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.136046 12755 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.140304  9487 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.139762  8872 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.141191 12569 raft_consensus.cc:2804] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:17.141628 12773 raft_consensus.cc:2804] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.141767 12569 raft_consensus.cc:697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.142187 12773 raft_consensus.cc:697] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:17.143056 12569 consensus_queue.cc:237] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.143388 12773 consensus_queue.cc:237] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:17.148940  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.149855  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.150782  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.151163  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.152132 12588 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.153296  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.157452 12488 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.157912 12488 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.158267 12488 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.133369 12718 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.138547 12684 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.161942 12684 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.156498 12726 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.163275 12726 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:17.161962  9487 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.165488 12588 raft_consensus.cc:2804] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.165362 12755 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.166338 12588 raft_consensus.cc:697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.162365 12684 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.168007 12588 consensus_queue.cc:237] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.164284 12726 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.136484 12593 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:17.185793  8903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38210 (request call id 2022) took 2121 ms (client timeout 2451 ms). Trace:
W20260709 12:11:17.186237  8903 rpcz_store.cc:269] 0709 12:11:15.064136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.269574 (+205438us) service_pool.cc:224] Handling call
0709 12:11:17.185551 (+1915977us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000b3954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:17.185725 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709369216}
I20260709 12:11:17.177969  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.162542 12616 raft_consensus.cc:3055] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.203472 12565 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.204644 12616 raft_consensus.cc:740] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.201889 12756 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:17.241297 12763 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.233757 12677 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.243357 12677 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.235558 12565 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.245528 12593 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.246302 12565 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.247095 12616 consensus_queue.cc:260] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.247964 12593 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:11:17.248360 12616 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.238765  8726 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.250222  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.250886  8756 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:17.251502 12762 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.252127 12762 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:17.254554 12488 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.254292 12762 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:17.256938 12776 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:11:17.257840  9487 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.259663 12569 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:17.260182 12569 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.260926 12569 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.262167  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:17.264557  9521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 748) took 1773 ms (client timeout 1978 ms). Trace:
I20260709 12:11:17.265492  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:17.265093  9521 rpcz_store.cc:269] 0709 12:11:15.491082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.491289 (+   207us) service_pool.cc:224] Handling call
0709 12:11:17.264414 (+1773125us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540074e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:17.264505 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848472960}
I20260709 12:11:17.266434 12488 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:17.245602 12677 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.269380 12054 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.282477 12054 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.272116 12615 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.274417  8752 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:17.283143 12773 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:17.284157  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.286957  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.318994  8759 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:17.319142  8756 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:17.295887  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.270632 12684 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.304350  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:17.295001  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:17.295924  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.322321  8909 raft_consensus.cc:2393] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:17.330658 12787 consensus_queue.cc:1048] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:17.331156 12785 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:17.294950 12615 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:17.343086  8759 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:17.345108  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.360781 12726 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.361424 12726 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.363921 12726 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.365438 12755 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:17.366140 12755 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.367079 12755 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.375607  9487 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:17.324419 12569 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.380446  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.384507  8756 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:17.389884  8872 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.353909 12615 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.394381 12615 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.400715 12726 raft_consensus.cc:2804] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:17.401657 12726 raft_consensus.cc:697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:17.402935 12726 consensus_queue.cc:237] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.382436 12054 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.440802 12054 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.457508  8647 maintenance_manager.cc:419] P 11a02b83f2af4df69b08a1f984747bcd: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033343
I20260709 12:11:17.461954 12565 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.465935  8754 raft_consensus.cc:2468] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
W20260709 12:11:17.468199  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 438153us
I20260709 12:11:17.470647  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.472784  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.474301  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:17.468165  9487 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.479557  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.480435  8829 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:17.482666  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:17.487058  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.487998  8827 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:17.491312  8826 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.491401  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.496311  8833 raft_consensus.cc:2410] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:17.492288  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.498028  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.498482  8834 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:17.493181  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.499425  8832 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:17.489639 11666 raft_consensus.cc:2804] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:17.501573  8827 raft_consensus.cc:3055] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.505805  8827 raft_consensus.cc:740] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:17.510324  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.511067  8760 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.513797  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.514523  8826 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:17.514660  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.515513  8754 raft_consensus.cc:2368] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8.
I20260709 12:11:17.517617  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:17.518518  8754 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.522984  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.523689  8833 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:17.527598 12114 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:17.528285 12114 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.531710 12114 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.533969 12565 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.540723 12684 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.542754 12054 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.543480 12543 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.544142 12543 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:17.544798 12762 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:17.545300 12677 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.545395 12762 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.545943 12677 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.547276 12569 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.547956 12762 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.548058 12677 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.549618  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.550355  8900 raft_consensus.cc:2368] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:17.551208  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:17.551384  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.552178  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.552336  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.553126  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.553355  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:17.553901  8902 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.554060  8906 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.554863  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.554143  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.555305  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.559537  9487 leader_election.cc:400] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8.
I20260709 12:11:17.560120  9487 leader_election.cc:403] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.569200  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.570001  8907 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.570701  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.571137  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.571897  8907 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:17.572311  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:17.575171  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53368.7us
I20260709 12:11:17.581679  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.582423  8900 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 13.
I20260709 12:11:17.588683  8760 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:17.593113  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.515661 11666 raft_consensus.cc:697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:17.611100  8875 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.614960  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:17.616899  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.585577 12755 raft_consensus.cc:3060] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.582269 12684 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:17.620786  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:17.622956  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.624749  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.627053  8902 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:17.627948  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.642637  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:17.645248  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.646064  8826 raft_consensus.cc:2468] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:11:17.647404  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.605259 12565 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:17.648397 12684 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.652041 12502 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:17.652603 12502 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.653854 12684 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:17.655709 12502 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:17.656059  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.664585  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:17.668855 12763 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:17.673197  8756 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:17.645254 12681 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.674226 12565 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.621107 12564 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 12:11:17.705498  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 89311.6us
I20260709 12:11:17.676608 12565 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:17.713629 12749 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:17.714336 12749 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.634183 12543 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.715799  8760 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:17.514945  8827 consensus_queue.cc:260] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.720453  8827 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.709748  8724 leader_election.cc:400] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:17.710381  8756 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:17.696732 12459 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:17.736542 12616 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:17.712204  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 902198us
I20260709 12:11:17.627948  8872 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.725765  8724 leader_election.cc:403] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.729436  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:17.716260 12543 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.732942  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.748342  8826 raft_consensus.cc:2468] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
W20260709 12:11:17.752668  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.753806  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 125953us
W20260709 12:11:17.760079  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 52437.9us
I20260709 12:11:17.761159  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:17.761876  8756 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:17.767210  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.790472  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.750702 12667 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.756002 12615 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.761301 12690 raft_consensus.cc:2804] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.749996 12745 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:17.804127  8754 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:17.815765  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:17.816159  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.756054 12459 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:17.824178  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.828544  8826 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 13: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:17.825001  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:17.805482  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800342240 after lost signal to thread 7581
W20260709 12:11:17.830698  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800242f00 after lost signal to thread 8692
I20260709 12:11:17.830554  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:17.831117  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800168ea0 after lost signal to thread 8712
W20260709 12:11:17.832214  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800352880 after lost signal to thread 8784
I20260709 12:11:17.809358 12747 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:11:17.832485  8856 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1700 after lost signal to thread 8785
I20260709 12:11:17.828887  8832 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 7.
I20260709 12:11:17.829500  8833 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
W20260709 12:11:17.835428  8856 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebac0 after lost signal to thread 8859
I20260709 12:11:17.836273  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.836982  8831 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:17.831245  8828 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:17.839880  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:17.844030  8856 debug-util.cc:398] Leaking SignalData structure 0x7b08002811e0 after lost signal to thread 8933
W20260709 12:11:17.844437  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800274f80 after lost signal to thread 8934
W20260709 12:11:17.845739  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800380ce0 after lost signal to thread 9549
W20260709 12:11:17.846095  8856 debug-util.cc:398] Leaking SignalData structure 0x7b080038db80 after lost signal to thread 9550
W20260709 12:11:17.847187  8856 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7e20 after lost signal to thread 12682
I20260709 12:11:17.848665  8827 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:17.804220 12804 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:17.854794  8826 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.850665  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.852473  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.853356  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.852404  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.721776 11666 consensus_queue.cc:237] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:17.858589  8833 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:11:17.866457  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 396813us
I20260709 12:11:17.855867  8831 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:17.794232 12805 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:11:17.830045 12690 raft_consensus.cc:697] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:17.875277  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.842849 12749 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:17.878014 12799 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 12:11:17.873066 12582 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.828358 12599 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:17.882431  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.887596  8754 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:17.887782  8833 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:17.809559 12615 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:17.889662  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 123084us
I20260709 12:11:17.891988  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:17.888093  8874 leader_election.cc:336] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.757s (SENT)
I20260709 12:11:17.894245  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:17.893972 12114 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:17.900030  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.900017  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:17.904314  8832 raft_consensus.cc:2468] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
W20260709 12:11:17.904806  8856 debug-util.cc:398] Leaking SignalData structure 0x7b0800379740 after lost signal to thread 12716
W20260709 12:11:17.905172  8856 debug-util.cc:398] Leaking SignalData structure 0x7b080038bf20 after lost signal to thread 12720
I20260709 12:11:17.905719  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.906214  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.907863  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.914466  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.927150 12809 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.928059 12809 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:17.930843  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.931955  8831 raft_consensus.cc:2410] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:17.939952  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.890244 12582 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.940678  8827 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:17.944012  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:17.946434  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73862.7us
I20260709 12:11:17.915431 12749 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.952102  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.952911  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:17.947958  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 180843us
I20260709 12:11:17.954109  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:17.955061  8724 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:17.953964 12805 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:17.955849 12804 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.956226 12804 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:17.955157  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:17.956588 12804 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.958012  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:17.958636  8831 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
W20260709 12:11:17.934389 12688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.492s	user 0.021s	sys 0.014s
W20260709 12:11:17.950151  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61906.2us
I20260709 12:11:17.933867 12755 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 7. Current term is 8.
W20260709 12:11:17.962601 12688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.576s	user 0.022s	sys 0.014s
I20260709 12:11:17.964805  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
W20260709 12:11:17.971310  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 55358.2us
I20260709 12:11:17.957664 12689 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.969257  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:17.947789 12810 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.976145  8798 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.969201  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.966982  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
W20260709 12:11:17.983541  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.988533  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 104203us
I20260709 12:11:17.989487  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.990093  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:17.940338 12690 consensus_queue.cc:237] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:17.984378 12689 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.013818  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:18.016279 12689 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:18.020591  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:17.973117 12502 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:17.998342 12698 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.964537 12811 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:18.052224 12698 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:18.052762 12698 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.053195 12747 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.054212 12747 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.054924 12747 consensus_queue.cc:1059] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:18.057677 12772 raft_consensus.cc:3055] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.029879 12820 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.030414 12543 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.039675  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.058773  8830 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:18.041069  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.059401  8826 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.041988  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.044091  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.061029  8835 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.045178 12800 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:11:18.047575  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.049788 12582 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.050083  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.078497  8833 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:18.050810  9488 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.050720 12819 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:18.053287 12811 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.025738  8828 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:18.086382  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.090407  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.093895  8829 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:18.094563  8829 pending_rounds.cc:85] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 8
I20260709 12:11:18.094911  8829 pending_rounds.cc:107] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:18.095273  8829 raft_consensus.cc:2889] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.100039  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.106516  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.106920  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.109992  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:18.108907  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.108134  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.112342  8832 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:18.116034  8832 raft_consensus.cc:1275] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:18.134387  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.135416  8902 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:18.137359  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.138327  8900 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:18.119228  8832 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:18.026634 12821 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.027431 12822 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:18.142367  9521 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:18.142266  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 128545us
I20260709 12:11:18.092151 12748 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:18.144556  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 124046us
I20260709 12:11:18.149703  8798 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:18.149879  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49926.1us
I20260709 12:11:18.076869 12772 raft_consensus.cc:740] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:18.150661  8872 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.153622  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.107898 12755 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.156018  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.164505  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.167268  8835 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:18.142829 12615 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:18.150134 12748 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:18.175736  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.193444  9516 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:18.194694 12651 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:18.175338 12800 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:11:18.219609  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:18.156347 12825 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.172485 12830 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.221813 12602 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.227470 12602 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.227952 12602 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.230512 12819 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.156898 12822 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:18.227866  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 78260.3us
I20260709 12:11:18.234186  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:18.241009 12822 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:18.242107  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.247794 12748 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.252653  8832 raft_consensus.cc:1275] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.152879 12821 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:18.284179  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.191185 12690 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:11:18.280578  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 124647us
I20260709 12:11:18.288422  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:18.220897 12651 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:18.294726  8798 leader_election.cc:400] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9.
I20260709 12:11:18.292716  8724 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.297663  8798 leader_election.cc:403] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:11:18.299338  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 95690.1us
I20260709 12:11:18.302112  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.304185  8798 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.225211 12830 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:18.305562 12828 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.306118 12826 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.301291 12747 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.334883 12747 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:18.334932  8874 leader_election.cc:336] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.539s (SENT)
I20260709 12:11:18.335430 12747 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.338117  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.338785  8835 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.342298  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.347869  9523 raft_consensus.cc:2468] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:18.357409  8826 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:18.306983  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:18.358917  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52012.2us
I20260709 12:11:18.312302  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.316960  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:18.361904  8832 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.362013  9525 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:11:18.362228  8874 leader_election.cc:336] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.607s (SENT)
I20260709 12:11:18.319216 12698 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.324451 12602 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.304718 12599 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.369617 12599 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:18.370083 12599 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.370390 12602 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.233685 12677 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:18.373073 12828 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.373016 12677 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.325956 12804 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.303902 12615 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9.
I20260709 12:11:18.261237 12827 raft_consensus.cc:2764] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:18.317198 12651 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.387111 12804 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.373725 12828 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:18.387799 12828 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.331094 12821 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.380417  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.392529  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.368292 12698 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.359674  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.411861  8903 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:18.413065  8835 raft_consensus.cc:2410] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:18.413411  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:18.413888  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 54300.4us
I20260709 12:11:18.414517  8907 raft_consensus.cc:2393] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:18.376533  8828 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:18.414958  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:18.413062  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:18.378705 12677 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:18.381614  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.409857  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.413543  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:18.418726  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.419145  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.419441  8827 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:18.420289  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.418910  8902 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.375037  8801 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:18.423134  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 48190.8us
W20260709 12:11:18.417265  8874 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.643s (SENT)
I20260709 12:11:18.423851  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:18.415421  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:18.416505  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 242242us
I20260709 12:11:18.426100  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.440770  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.432227  8903 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:18.427132  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.452224  8759 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:18.426716  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.454285  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.356755 12830 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.455866  8902 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:18.459367  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.457218  8903 raft_consensus.cc:1275] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:18.459546  8909 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 13.
I20260709 12:11:18.450268  8724 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.417692 12827 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.426656 12809 raft_consensus.cc:2764] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:18.465385  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.478477  8724 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.467566  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.493840 12805 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.494482 12805 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:18.495524 12805 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.486739 12804 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:18.500301 12804 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:18.501322 12804 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.225111 12772 consensus_queue.cc:260] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.449039 12114 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.514947  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.515403  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.487514 12771 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:18.527667  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.473116 12745 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:18.440398  8829 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
W20260709 12:11:18.481359  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.439697 12614 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.439983 12763 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:18.462592  8832 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:18.530395 11666 consensus_queue.cc:1048] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:18.540172  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.541327  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.542539  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.542899  8903 raft_consensus.cc:1240] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:18.489951  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:18.474458  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.425755 12615 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:11:18.545338  8827 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:18.543720  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.534152  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.536206  8754 raft_consensus.cc:1217] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 12:11:18.546746  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.734476  8658 catalog_manager.cc:5697] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.566401  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.737253  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.737617  8902 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:18.737793  8754 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:11:18.680133  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.576560  8909 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.581769  9525 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:18.650243  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.716879  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:18.651041  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 161183us
I20260709 12:11:18.531260 12748 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.750736  8826 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:18.526319 12771 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:18.739341  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:18.752718  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.757762  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.741950  8832 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:18.743595  8907 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 8: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:18.758625  8827 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:18.749751  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 180051us
I20260709 12:11:18.807754  8832 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:18.764225  8753 raft_consensus.cc:1275] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:18.764518  8756 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:18.881042  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71836.7us
I20260709 12:11:18.875633  8755 raft_consensus.cc:1240] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.650815 12684 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:18.845250  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:18.888532  8760 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:11:18.892899  9516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.028s	sys 0.050s
I20260709 12:11:18.714995 12726 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:18.894032  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.897590  9516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.028s	sys 0.051s
I20260709 12:11:18.899708  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.739125 12841 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.900411  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.539261 12745 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.929343  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:18.934870 12599 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.003s
W20260709 12:11:18.895880 12616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.026s	sys 0.041s
I20260709 12:11:18.941046  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.941871  8832 raft_consensus.cc:2376] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12. Re-sending same reply.
I20260709 12:11:18.942440  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.943718  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.945928  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:18.949069  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.927086  8827 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:18.951164  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.946702 12599 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:18.961840  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 492706us
I20260709 12:11:18.955405 12809 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.893465 12839 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.940223 12616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.028s	sys 0.042s
W20260709 12:11:18.962654  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.961889  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.969535  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:18.971282  9487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.021s
I20260709 12:11:18.948518 12821 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.946033 12841 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:18.973218  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:18.956265 12827 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.974781  8832 raft_consensus.cc:2410] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:18.975350  9487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.021s
I20260709 12:11:18.977734  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:18.956612 12749 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:18.978735  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 520832us
I20260709 12:11:18.979962  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:18.916837 12726 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:18.997939  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:19.004837  8760 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:19.016619  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.906903 12684 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.021129  9521 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:18.956943 12614 consensus_queue.cc:1059] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:18.970932 12615 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:19.024076 12749 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:18.977711 12827 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:19.036490 12827 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.037070  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2250) took 1539 ms. Trace:
I20260709 12:11:19.037472  8834 rpcz_store.cc:276] 0709 12:11:17.499386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.499650 (+   264us) service_pool.cc:224] Handling call
0709 12:11:17.505054 (+  5404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.101737 (+596683us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:18.102102 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.433346 (+331244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.452595 (+ 19249us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.452756 (+   161us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:18.453673 (+   917us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.464723 (+ 11050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.464820 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.036834 (+572014us) raft_consensus.cc:1685] finished
0709 12:11:19.036855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.037007 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264301,"prepare.queue_time_us":6679,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":8889,"raft.queue_time_us":274284,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":27264,"spinlock_wait_cycles":12874624,"thread_start_us":629328,"threads_started":2,"wal-append.queue_time_us":573651}
W20260709 12:11:19.039494 12747 consensus_meta.cc:287] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
W20260709 12:11:19.021588 12651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.029s
I20260709 12:11:19.039995 12747 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:19.041121 12651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.006s	sys 0.029s
I20260709 12:11:18.980787 12824 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.042117 12726 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:19.042356 12824 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.042881 12824 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:19.043749 12841 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.014346 12821 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.022430 12819 consensus_queue.cc:1059] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:19.046331 12819 raft_consensus.cc:3055] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:19.046748 12819 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:19.047614 12819 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.035914  8903 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:19.049978 12819 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:19.051668  8657 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 232) took 22507 ms (client timeout 15000 ms). Trace:
I20260709 12:11:19.044091 12824 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.021319 12811 consensus_queue.cc:1059] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:19.053676 12811 raft_consensus.cc:3055] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.054138 12811 raft_consensus.cc:740] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:19.053567  8658 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.054949 12811 consensus_queue.cc:260] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.056304 12811 raft_consensus.cc:3060] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.974844 12839 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.035683 12771 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.058085 12726 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:19.052112  8657 rpcz_store.cc:269] 0709 12:10:56.544346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.544593 (+   247us) service_pool.cc:224] Handling call
0709 12:11:19.051573 (+22506980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:12.548516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:12.549222 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:12.549276 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:11:12.549295 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:12.954107 (+404812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:12.971944 (+ 17837us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:12.975449 (+  3505us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:13.334692 (+359243us) tablet.cc:701] Row locks acquired
0709 12:11:13.334746 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:11:13.334957 (+   211us) write_op.cc:270] Start()
0709 12:11:13.335150 (+   193us) write_op.cc:276] Timestamp: P: 1783599073334882 usec, L: 0
0709 12:11:13.335173 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:13.361154 (+ 25981us) log.cc:844] Serialized 7034 byte log entry
0709 12:11:13.768846 (+407692us) op_driver.cc:464] REPLICATION: finished
0709 12:11:14.197583 (+428737us) write_op.cc:301] APPLY: starting
0709 12:11:14.221472 (+ 23889us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:14.344024 (+122552us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:14.437078 (+ 93054us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:14.535521 (+ 98443us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b54002fc1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813ee28 00007fce3bb79581 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901 00007fce3bb7cb2d 0000000000388634 0000000000388479
0709 12:11:14.797432 (+261911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:14.797852 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:11:14.797902 (+    50us) write_op.cc:312] APPLY: finished
0709 12:11:14.798405 (+   503us) log.cc:844] Serialized 119 byte log entry
0709 12:11:14.973394 (+174989us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.991624 (+ 18230us) write_op.cc:454] Released schema lock
0709 12:11:15.005673 (+ 14049us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:15.017686 (+ 12013us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:15.017725 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21610,"reported_tablets":50,"spinlock_wait_cycles":30464,"child_traces":[["op",{"apply.queue_time_us":367329,"apply.run_cpu_time_us":42337,"apply.run_wall_time_us":863277,"num_ops":17,"prepare.queue_time_us":203322,"prepare.run_cpu_time_us":27605,"prepare.run_wall_time_us":2006548,"raft.queue_time_us":237090,"raft.run_cpu_time_us":21409,"raft.run_wall_time_us":306498,"replication_time_us":425486,"spinlock_wait_cycles":13864704,"thread_start_us":778513,"threads_started":5,"wal-append.queue_time_us":374243,"wal-append.run_cpu_time_us":20840,"wal-append.run_wall_time_us":2283730}]]}
I20260709 12:11:19.055904  8658 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.158706  8658 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.159684  8758 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.063261  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:19.042959 12747 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.161029 12839 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:19.067239  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.018543 12809 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.018698 12762 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:19.070919  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.070647 12827 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.076252 12822 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.068681 12817 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:11:19.088374 12582 raft_consensus.cc:3055] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.033984 12615 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.089403  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:19.150498 12745 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.109961 12599 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:19.110502  8874 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.662s (SENT)
W20260709 12:11:19.197849  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 87390.4us
I20260709 12:11:19.200949  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.201833  8826 raft_consensus.cc:2376] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11. Re-sending same reply.
I20260709 12:11:19.029052  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:19.170101  8725 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.575s (SENT)
I20260709 12:11:19.160508  8658 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 8, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:19.203473  8725 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.621s (SENT)
W20260709 12:11:19.185470  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.203917  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.167624 12726 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.205452  8725 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.832s (SENT)
I20260709 12:11:19.205909  8725 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:19.207353  8725 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.922s (SENT)
W20260709 12:11:19.208217  8725 leader_election.cc:336] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.978s (SENT)
I20260709 12:11:19.208602  8725 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.212108  9516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 730) took 1090 ms. Trace:
I20260709 12:11:19.216163  8760 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.212977  9516 rpcz_store.cc:276] 0709 12:11:18.122114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.122485 (+   371us) service_pool.cc:224] Handling call
0709 12:11:18.122864 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.193296 (+ 70432us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:18.270060 (+ 76764us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.904178 (+634118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.904253 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:18.904314 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.211899 (+307585us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54009e5554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:19.211944 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.212053 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14808,"spinlock_wait_cycles":161366784,"thread_start_us":633627,"threads_started":1,"wal-append.queue_time_us":765403}
W20260709 12:11:19.229651  8905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.035s	sys 0.024s
W20260709 12:11:19.230203  8905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.035s	sys 0.024s
I20260709 12:11:19.237360  8903 raft_consensus.cc:1275] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:19.238572  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2437) took 1169 ms. Trace:
W20260709 12:11:19.204583 12810 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.014s	sys 0.045s
I20260709 12:11:19.228866  8658 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 4, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 4 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.180290 12582 raft_consensus.cc:740] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:19.240850  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:19.258421  8906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.007s	sys 0.009s
I20260709 12:11:19.239089  8905 rpcz_store.cc:276] 0709 12:11:18.069245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.069994 (+   749us) service_pool.cc:224] Handling call
0709 12:11:18.119570 (+ 49576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.119794 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:18.455674 (+335880us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.238072 (+782398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.238153 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:19.238220 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.238329 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.238494 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4804,"prepare.queue_time_us":405376,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":7467,"thread_start_us":1081283,"threads_started":2}
I20260709 12:11:19.171169 12762 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.230192 12839 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:19.316264  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:19.255133 12810 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.020s	sys 0.047s
W20260709 12:11:19.316605  8799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.335777  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:19.336978  8834 raft_consensus.cc:2410] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:19.180397 12602 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:19.206856 12813 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:19.320505  8874 leader_election.cc:336] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 2.057s (SENT)
I20260709 12:11:19.178381 12822 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.241212 12599 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.326701  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:19.326840  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 66811.6us
W20260709 12:11:19.324963 12800 log.cc:927] Time spent T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:19.339373 11729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.013s
I20260709 12:11:19.348681  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.221328 12726 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:19.348996 11729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.001s	sys 0.013s
W20260709 12:11:19.340622  8906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.007s	sys 0.009s
I20260709 12:11:19.361723  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:19.366887  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:19.385906  8725 leader_election.cc:336] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 2.069s (SENT)
I20260709 12:11:19.347114  8658 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129), no longer has a pending config: VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129), VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130), VOTER 61fbd5afaa194845917d5b1b04571378 (127.7.102.131), VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 7 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:19.395730  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:19.397814  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 77359.3us
I20260709 12:11:19.409282  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.409327  8658 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:19.413806  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.385152 12773 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.416919 11729 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:19.422078  8872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.017s
W20260709 12:11:19.422400  8872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.010s	sys 0.017s
W20260709 12:11:19.422864  8874 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.583s (SENT)
I20260709 12:11:19.423593  8874 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:19.424506  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 523320us
W20260709 12:11:19.442945  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.404691 12755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.021s	sys 0.071s
I20260709 12:11:19.454418 12564 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.455178 12684 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:19.362510 12582 consensus_queue.cc:260] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.457813 12582 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.459899 12830 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.979s	user 0.013s	sys 0.000s
I20260709 12:11:19.460415 12830 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.461628  8908 raft_consensus.cc:1240] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:19.462953 12830 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:19.452396 12755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.021s	sys 0.072s
I20260709 12:11:19.455574  8658 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:19.481316  8759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.026s
W20260709 12:11:19.481870  8759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.026s
W20260709 12:11:19.418481 12804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.012s
W20260709 12:11:19.450393 12828 consensus_meta.cc:287] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 1.062s	user 0.005s	sys 0.010s
I20260709 12:11:19.495959  8658 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:19.501477 12862 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:11:19.500818  8658 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:19.505331 12856 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:19.505244  8658 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.507920  8658 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.448405 12611 consensus_queue.cc:1048] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:11:19.509928  8658 catalog_manager.cc:5697] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.512096  8658 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:19.514758  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 305832us
W20260709 12:11:19.515856  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.517885  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 501662us
W20260709 12:11:19.489143 12804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.014s	sys 0.012s
W20260709 12:11:19.489259 12748 consensus_meta.cc:287] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.697s	user 0.013s	sys 0.004s
I20260709 12:11:19.448881 12763 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:19.551994  8831 raft_consensus.cc:2410] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:19.496073 12825 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.552750 12825 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.554963 12825 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.555846 12804 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.556361 12804 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.516553 12602 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.559643  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:19.555958  8658 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 8, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.499780 12828 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:19.578748  8874 leader_election.cc:336] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.793s (SENT)
W20260709 12:11:19.583086  9524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.015s
W20260709 12:11:19.583534  9524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.015s
I20260709 12:11:19.544468 12615 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.562561 12763 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.611502  8826 raft_consensus.cc:2410] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:19.621706  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.551908 12651 consensus_queue.cc:1048] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:11:19.618227  8874 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 2.183s (SENT)
I20260709 12:11:19.626865  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.628954  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:19.591572 12841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.014s
W20260709 12:11:19.599642 12459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.015s	sys 0.015s
W20260709 12:11:19.630000  9489 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.013s	sys 0.016s
W20260709 12:11:19.615370 12805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.031s
I20260709 12:11:19.582834 12602 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.610289 12748 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.612646 12745 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.633529 12841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.011s	sys 0.014s
W20260709 12:11:19.637038 12805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.032s
I20260709 12:11:19.624229 12615 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:19.625241 12502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.014s	sys 0.038s
W20260709 12:11:19.636372  9489 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.013s	sys 0.016s
W20260709 12:11:19.676424  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 999801us
I20260709 12:11:19.642163  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:19.642915 12830 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.635434 12771 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.635591 12819 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.622865 12667 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.590946 12825 consensus_queue.cc:1059] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:11:19.639070 12459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.015s	sys 0.016s
I20260709 12:11:19.633203 12681 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.635782 12811 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.681977  8874 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.682535 12690 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:19.639657  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.696597  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 291935us
W20260709 12:11:19.697513  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 142547us
W20260709 12:11:19.699194  8754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.017s	sys 0.041s
W20260709 12:11:19.745740  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 63849.2us
I20260709 12:11:19.746814  8874 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.621462 12763 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.647281 12726 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:19.676126 12502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.039s
I20260709 12:11:19.669325 12809 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.745754  8754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.018s	sys 0.041s
I20260709 12:11:19.717561 12804 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.758211  9523 raft_consensus.cc:1240] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:19.761121  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.670379 12748 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.674508 12745 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.777212  8832 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
W20260709 12:11:19.777396  9525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.002s	sys 0.021s
I20260709 12:11:19.700194 12488 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:11:19.784232  9525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.003s	sys 0.022s
I20260709 12:11:19.744850 12690 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:19.785425  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 333432us
I20260709 12:11:19.694026 12615 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.750262 12866 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.724699 12819 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.724972 12667 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.728322 12771 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.777981 12726 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:19.861403  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 113703us
I20260709 12:11:19.745987 12811 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.787251 12582 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.810758 12690 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.791040 12773 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.768606 12809 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:19.890774  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 144609us
I20260709 12:11:19.843510 12684 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:19.882378 12588 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.904500  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:19.905619  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.902074  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.907922  8828 raft_consensus.cc:2393] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 7: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:11:19.893314 12865 log.cc:927] Time spent T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:11:19.907076  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 111367us
I20260709 12:11:19.909135  8829 raft_consensus.cc:2393] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 13: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:19.912405  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:19.913244  8828 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:19.913463  8874 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.871348 12805 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:19.915529  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.916375  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.914007  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.915539 12588 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.959789  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:19.961087  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:19.887908 12582 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:19.965205 12805 consensus_queue.cc:1243] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer fd116b86a1e4445c994a361f776beba1 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:11:19.977479 12854 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 1.007s	user 0.002s	sys 0.008s
W20260709 12:11:19.969633 12868 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:11:19.971827 12870 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.003s
I20260709 12:11:19.978834 12582 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.980149 12667 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:19.973701  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60302.8us
I20260709 12:11:19.974004 12811 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.989933  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.975802 12748 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.903038 12616 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:19.979449 12819 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:19.973207 12869 log.cc:927] Time spent T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:19.980808 12805 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:19.883392 12866 consensus_queue.cc:1048] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:11:19.981540  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 75998.7us
I20260709 12:11:20.084046  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.085435  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.982162 12588 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.972991 12763 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.984938  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2298) took 1646 ms. Trace:
I20260709 12:11:19.990187  8834 raft_consensus.cc:2368] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:19.974659 12771 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.992327  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:19.903131 12828 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:20.002938  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 84511.3us
W20260709 12:11:20.003737  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.995368  8906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2441) took 1921 ms. Trace:
I20260709 12:11:20.005275  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:20.004410 12875 log.cc:927] Time spent T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:11:20.014773 12827 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:20.017187 12864 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:11:20.042819 12805 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.107376 12805 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.109210 12824 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.109828  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35686 (request call id 734) took 1660 ms. Trace:
I20260709 12:11:20.110212  9524 rpcz_store.cc:276] 0709 12:11:18.449643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.450602 (+   959us) service_pool.cc:224] Handling call
0709 12:11:18.481497 (+ 30895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.512536 (+ 31039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.512577 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.513111 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.048644 (+535533us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b1800440e60. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:11:19.583982 (+535338us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:19.584026 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.584114 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.109529 (+525415us) raft_consensus.cc:1685] finished
0709 12:11:20.109548 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.109770 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4704,"raft.queue_time_us":64492,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":97680,"spinlock_wait_cycles":52679936,"thread_start_us":535137,"threads_started":1,"wal-append.queue_time_us":1190685}
I20260709 12:11:20.112293  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.113308 12772 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.100898 12825 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.114248 12825 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.116842  8833 raft_consensus.cc:2376] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9. Re-sending same reply.
I20260709 12:11:20.116902 12902 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.986454 12726 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.118320 12726 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:19.996464 12681 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:20.018045 12885 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:11:20.018841 12874 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:11:20.123726  8908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 2072) took 1561 ms. Trace:
I20260709 12:11:20.019115 12615 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.020988 12616 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:20.023717 12861 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:11:20.124138  8908 rpcz_store.cc:276] 0709 12:11:18.562120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.760530 (+198410us) service_pool.cc:224] Handling call
0709 12:11:18.760941 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.462134 (+701193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.123475 (+661341us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400116554. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:20.123662 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610896768}
I20260709 12:11:20.126986 12616 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.973016 12684 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.028856 12745 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:19.988850 12899 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.127879  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.128417 12899 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.129082 12879 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:20.129513 12879 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.129884 12879 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.130724 12899 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:19.912583 12773 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 12:11:20.057364 12873 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:11:20.058274 12867 log.cc:927] Time spent T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:11:20.059311 12876 log.cc:927] Time spent T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:19.989807 12813 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:11:20.065968 12809 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.050958 12859 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:20.042275 12877 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:11:20.078121  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.042972 12688 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.156670  8901 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.156567  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:20.022925  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 228835us
I20260709 12:11:20.087664  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:20.159653  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 72037.4us
I20260709 12:11:20.161207  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.091285  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.163553  8753 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:20.088864  8830 rpcz_store.cc:276] 0709 12:11:18.338053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.344726 (+  6673us) service_pool.cc:224] Handling call
0709 12:11:18.345027 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.345400 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.345428 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.345865 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.514677 (+168812us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.514718 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.514784 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.898848 (+1384064us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:19.984576 (+ 85728us) raft_consensus.cc:1685] finished
0709 12:11:19.984601 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.984855 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1142,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8654,"spinlock_wait_cycles":10736512,"thread_start_us":168417,"threads_started":1,"wal-append.queue_time_us":610444}
I20260709 12:11:20.164800  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.165537  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.166694  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.167275  8830 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:20.167989  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:20.101835  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 109582us
I20260709 12:11:20.095108  8906 rpcz_store.cc:276] 0709 12:11:18.073692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.080841 (+  7149us) service_pool.cc:224] Handling call
0709 12:11:18.136646 (+ 55805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.178991 (+ 42345us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:18.557784 (+378793us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b18003af360. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3bb3b3c7 00007fce3814d9a7 00007fce3815d0bf 00007fce3815d038
0709 12:11:19.358092 (+800308us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.647200 (+289108us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.678733 (+ 31533us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.679392 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.679554 (+   162us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:19.679603 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.679711 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.995028 (+315317us) raft_consensus.cc:1685] finished
0709 12:11:19.995069 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.995281 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74134,"prepare.queue_time_us":346473,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":80,"raft.queue_time_us":79611,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":66109,"spinlock_wait_cycles":37890048,"thread_start_us":1076319,"threads_started":2,"wal-append.queue_time_us":617843}
I20260709 12:11:20.130441 12871 raft_consensus.cc:3055] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:20.169271  8757 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:20.169480 12871 raft_consensus.cc:740] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:20.169740  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:20.170526  8758 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 13: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:20.170413 12871 consensus_queue.cc:260] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.171730 12871 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.172411  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.173224  8756 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:20.163573  8834 raft_consensus.cc:2393] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:20.174998  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.175555  8834 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:20.128561  8826 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:20.177001  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.177389  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.177870  8751 raft_consensus.cc:2410] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:20.178191  8826 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:20.179086  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.178989  8760 raft_consensus.cc:1275] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:20.179895  8826 raft_consensus.cc:2376] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10. Re-sending same reply.
I20260709 12:11:20.144273  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.040377 12602 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.148916 12745 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.149323 12844 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:20.149950 12786 consensus_queue.cc:1048] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:20.155051 12859 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.186285 12827 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.186874 12827 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.189069 12827 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.189251  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.190646  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.192574  8754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2084) took 1435 ms. Trace:
I20260709 12:11:20.169245  8874 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.181380  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.139772 12763 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.198200  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.181478  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.162806  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:20.201184  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.154484 12615 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.182924  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.206776  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.183679 12745 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.168623  8830 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:20.176334  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.217932  8834 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 5.
I20260709 12:11:20.193001  8754 rpcz_store.cc:276] 0709 12:11:18.757136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.143729 (+386593us) service_pool.cc:224] Handling call
0709 12:11:19.144196 (+   467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.144717 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.144758 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.145423 (+   665us) log.cc:844] Serialized 52 byte log entry
0709 12:11:19.753711 (+608288us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:20.041190 (+287479us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.041679 (+   489us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.041866 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.041981 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.192337 (+150356us) raft_consensus.cc:1685] finished
0709 12:11:20.192362 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.192512 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47,"prepare.queue_time_us":33600,"prepare.run_wall_time_us":62,"raft.queue_time_us":30748,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":319,"spinlock_wait_cycles":16189696,"thread_start_us":856778,"threads_started":2,"wal-append.queue_time_us":726940}
I20260709 12:11:20.201872  8826 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:20.207629  8835 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:20.207825  8828 raft_consensus.cc:2393] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 6: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:20.203236 12565 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.221839  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:20.192800 12839 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:20.241993  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60717.1us
I20260709 12:11:20.244171  8725 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.205996 12599 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.244306 12899 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:20.214857 12827 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.245363 12852 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.248921 12852 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.249289 12852 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.219606 12615 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.249356  8874 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.250032 12565 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.250449 12565 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.250767 12886 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.250872 12565 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.251338 12886 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:20.251739 12615 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.224007 12114 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.252800 12114 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.255403 12114 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:20.247298 12599 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.257131 12599 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.257439 12906 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.256343 12866 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.259649 12565 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.259898 12866 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.260424 12762 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.261386  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.261968 12565 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:20.251775 12886 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.263238  8834 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:20.241720 12898 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.265103 12898 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.266747  8834 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:20.270452  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.273190  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.274675  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.279057  8834 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:20.262061 12866 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.285329  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.290414  8834 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.203083 12883 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:20.238416 12839 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.245405 12825 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:20.291466  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47380.7us
I20260709 12:11:20.308035  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.300880 12726 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:20.301532 12839 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.246130 12690 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.320899 12690 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:20.323225  9489 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Timed out: RequestConsensusVote RPC to 127.7.102.130:34317 timed out after 1.709s (SENT)
I20260709 12:11:20.309501 12899 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.328389  8834 raft_consensus.cc:2468] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:20.329617  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.330570  8834 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:20.331485  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.332021  8900 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.332496  8834 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:20.302572 12859 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.303880 12745 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.333370  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.334100  8834 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.334582 12883 consensus_queue.cc:1059] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:20.337122 12883 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.347932  8833 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:20.349555  8834 raft_consensus.cc:2468] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
W20260709 12:11:20.356657  8831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2313) took 1975 ms (client timeout 1539 ms). Trace:
I20260709 12:11:20.357089  8827 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:20.357842  8827 pending_rounds.cc:85] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:11:20.356479  8834 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:20.358405  8827 pending_rounds.cc:107] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:20.358780  8827 raft_consensus.cc:2889] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.359225 12822 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.359586  8834 raft_consensus.cc:1275] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:20.359939  8834 pending_rounds.cc:85] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:11:20.360142  8834 pending_rounds.cc:107] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:11:20.360378  8834 raft_consensus.cc:2889] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.360776  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2337) took 1125 ms. Trace:
I20260709 12:11:20.361241  8827 rpcz_store.cc:276] 0709 12:11:19.235180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.235476 (+   296us) service_pool.cc:224] Handling call
0709 12:11:20.356597 (+1121121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.359229 (+  2632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.360429 (+  1200us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002170d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:20.360593 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577264512}
W20260709 12:11:20.374521 12888 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.403s	user 0.003s	sys 0.001s
I20260709 12:11:20.293968 12852 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.382258 12852 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.386565  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.387792  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.368302  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2341) took 1042 ms. Trace:
I20260709 12:11:20.393613  8832 rpcz_store.cc:276] 0709 12:11:19.326153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.326322 (+   169us) service_pool.cc:224] Handling call
0709 12:11:20.368042 (+1041720us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54003bbd54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:20.368205 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986270592}
I20260709 12:11:20.394968 12859 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.395591 12859 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:20.403834 12910 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 12:11:20.404004  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.404947  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.405992  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.406759  9516 raft_consensus.cc:2368] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:20.408463  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.410059 12859 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.411196  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.413035  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.413254  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.414947  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.420940  8801 leader_election.cc:400] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:20.421267  8801 leader_election.cc:403] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.421967 12898 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.424700  8826 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:20.414659  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:20.406647  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2317) took 2024 ms (client timeout 1866 ms). Trace:
W20260709 12:11:20.426010  8835 rpcz_store.cc:269] 0709 12:11:18.382839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.418933 (+ 36094us) service_pool.cc:224] Handling call
0709 12:11:20.406450 (+1987517us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001ff4d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:20.406550 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982172544}
I20260709 12:11:20.422024 12745 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.433092  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:20.434687  8826 raft_consensus.cc:1240] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.437513  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:20.357276  8831 rpcz_store.cc:269] 0709 12:11:18.380864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.381308 (+   444us) service_pool.cc:224] Handling call
0709 12:11:20.356400 (+1975092us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002170d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:20.356560 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606451584}
I20260709 12:11:20.443369  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.336514  8725 leader_election.cc:400] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:20.395884 12879 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.449438  9489 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:20.495033  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51786.5us
W20260709 12:11:20.480330  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 143986us
W20260709 12:11:20.489137  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 54938.8us
I20260709 12:11:20.436889 12805 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:20.500975  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51648.2us
I20260709 12:11:20.503196  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.504156  8826 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:20.505280  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.505425  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.505810  8874 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.506002  8835 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:20.506916  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.508555  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.510802  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:20.481021 12822 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.517894  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.520109  8826 raft_consensus.cc:2468] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:20.497538  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.498188  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.491475 12883 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.442655 12599 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.482210 12903 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.521486  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.522471  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.523130  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.496620  8726 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.525981  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.526608  8725 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:20.498744  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.549675  8902 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:11:20.550150  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 53625.5us
I20260709 12:11:20.550623  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.527642  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.551326  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.527645  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.520653  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:20.552668  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.545220  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.553752  8907 raft_consensus.cc:2393] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:20.555830  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.529804  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:20.559919  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.564570  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.561080  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.565675  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:20.567502  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.560813  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.521986 12690 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.569891  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.565582  8903 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:20.579263  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.581444  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.533138 12899 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.584052  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:20.529057 12773 raft_consensus.cc:2804] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.542022 12762 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.587460  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.530551 12898 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.596791  8726 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:20.591202  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 68827.8us
I20260709 12:11:20.597105  8902 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:20.590149  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.521318 12569 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:11:20.599912  8874 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.596873  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.517664 12805 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.554193 12825 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.526463 12822 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.615435  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.611162  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:20.558782 12747 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.585613 12690 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.631321  8799 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:20.630630  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.597908 12824 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.558164 12903 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.554541 12883 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.654973  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.680279 12852 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.616585 12726 raft_consensus.cc:2804] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.604792 12773 raft_consensus.cc:697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:20.634495 12749 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:20.695204  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 98622.1us
I20260709 12:11:20.709934  8756 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.712042  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.713543  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.699074  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:20.622131 12763 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.629953 12564 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.630081 12565 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 12:11:20.690388  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 163851us
I20260709 12:11:20.635064 12690 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.641896 12828 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.614840 12912 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:11:20.642345 12681 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.715922  8907 raft_consensus.cc:3060] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.722450  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.722524  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:20.612217 12898 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.645514 12747 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.622876 12825 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:20.729148  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 93723us
I20260709 12:11:20.760964  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:20.727320 12899 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.693782 12827 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.710297 12896 raft_consensus.cc:2764] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:20.646783 12902 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 12:11:20.682955  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 71863.2us
I20260709 12:11:20.743763  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:20.691607 12839 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.729351  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:20.768438  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:20.727115 12824 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.777670  8827 raft_consensus.cc:1240] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.706946 12852 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.724961 12762 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.708552 12895 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.275s
I20260709 12:11:20.776322 12684 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.730304 12828 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:20.744084 12488 consensus_queue.cc:1048] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:11:20.801213  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 55960.8us
I20260709 12:11:20.741850 12789 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.294s
I20260709 12:11:20.801788  8907 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:20.736357 12726 raft_consensus.cc:697] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:20.803877 12905 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.770000 12763 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.815244  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:20.787765 12681 consensus_queue.cc:1048] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:20.789223 12844 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:20.740799 12860 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.819407  8834 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:20.793332 12906 consensus_meta.cc:287] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 12:11:20.741290 12893 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.822294  8759 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.784373 12891 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.832845  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53368us
W20260709 12:11:20.809535 12908 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.280s	user 0.000s	sys 0.002s
I20260709 12:11:20.808933  8908 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:20.847147  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62347.1us
W20260709 12:11:20.825621 12871 consensus_meta.cc:287] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.653s	user 0.015s	sys 0.000s
I20260709 12:11:20.853211  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:20.764946 12651 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:20.889230 12651 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:20.893263 12822 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:20.898238 12919 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 12:11:20.902243 12883 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.902765 12745 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:20.782131 12827 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:20.903302  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 50190.5us
W20260709 12:11:20.903635 12909 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:11:20.904863 12827 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:20.905076 12911 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:11:20.858520 12860 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:20.906837 12896 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.826655 12901 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.838985 12879 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:20.871632 12913 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:20.865536 12906 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.874059 12726 consensus_queue.cc:237] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.875372 12852 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.876600 12825 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:20.877291 12917 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:11:20.878091 12839 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.879171 12898 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.824951 12930 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:20.881090 12903 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:20.881688 12805 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.884917 12602 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.811697 12773 consensus_queue.cc:237] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.813702 12824 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:20.886883 12886 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.001s
I20260709 12:11:20.902617  8835 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:20.832954 12828 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.892498 12651 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:21.002190 12824 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:20.956115  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:20.960510  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 189937us
W20260709 12:11:20.961254  8830 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.022s
I20260709 12:11:20.907262 12896 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:21.014410 12896 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.919440 12565 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.016924 12565 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:21.017469 12565 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.906870 12860 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.977840  8756 raft_consensus.cc:1240] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.951834 12901 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:21.050904 12901 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.052066 12899 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:21.052812 12899 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.961889 12866 consensus_queue.cc:1059] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:11:21.055470 12866 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.055940 12866 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:20.869525 12929 consensus_queue.cc:1059] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
W20260709 12:11:20.862809  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 119127us
W20260709 12:11:21.011413  8830 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.022s
I20260709 12:11:21.011502  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:21.008149 12886 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:20.997583 12789 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:21.036490  8907 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.991559 12859 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.057147 12929 raft_consensus.cc:3055] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.061304 12684 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.050303 12747 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:21.062248 12789 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.061600 12859 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:21.057245  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:21.064443 12859 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:21.060832  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49414.1us
W20260709 12:11:21.049448 12868 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:21.061718 12929 raft_consensus.cc:740] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:20.963668  8828 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:21.079193 12886 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:21.079752 12789 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.079926 12929 consensus_queue.cc:260] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.081452 12929 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.085876  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 248867us
I20260709 12:11:21.095664 12602 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.097150  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.102792  8826 raft_consensus.cc:2468] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
W20260709 12:11:21.095072  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 256640us
W20260709 12:11:21.165244  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 51627.5us
W20260709 12:11:21.167164  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 110003us
I20260709 12:11:21.166997  9487 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:21.196518 12818 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.197012 12565 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.197870 12907 raft_consensus.cc:3055] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.198341 12907 raft_consensus.cc:740] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:21.199193 12907 consensus_queue.cc:260] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.199651 12565 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:21.083410 12866 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.191460 12839 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:11:21.205624 12866 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.206856 12939 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:21.207654 12939 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.214262  8754 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:21.200350 12907 raft_consensus.cc:3060] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.223199  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.192469 12879 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.235335 12599 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:21.237515 12914 log.cc:927] Time spent T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.474s	user 0.003s	sys 0.003s
W20260709 12:11:21.258311  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.210489 12886 consensus_queue.cc:1175] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "005ae7a1e140481db6cc04faeb268d9c" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
I20260709 12:11:21.264488  9489 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:21.267038 12818 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.267730 12818 consensus_queue.cc:1059] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:21.269775 12895 raft_consensus.cc:3055] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.270394 12895 raft_consensus.cc:740] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:21.243178 12939 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:21.271514 12895 consensus_queue.cc:260] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.223719 12690 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.277030 12690 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:21.277815  8906 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:21.278887  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:21.269649 12899 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.279047  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.274433 12895 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.286890  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.287299  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:21.298326  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:21.290997  8874 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:21.293964  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.304360  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:21.305367  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:21.311805  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:21.327126 12901 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.338536  8909 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.339838  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 773) took 1115 ms. Trace:
I20260709 12:11:21.362797  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.364156  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.364511  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.365705  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.365015  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.366484  8752 raft_consensus.cc:2393] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:21.362213  8829 rpcz_store.cc:276] 0709 12:11:20.224366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.414808 (+190442us) service_pool.cc:224] Handling call
0709 12:11:20.415137 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:20.415483 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.415509 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:20.523633 (+108124us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b2c00010c48. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:11:20.530403 (+  6770us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.814928 (+284525us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.841605 (+ 26677us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.857083 (+ 15478us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.232126 (+375043us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18000df1e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:21.339120 (+106994us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18000df1e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287 00007fce3815e208
0709 12:11:21.339372 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.339490 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.339550 (+    60us) raft_consensus.cc:1685] finished
0709 12:11:21.339571 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.339755 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139439,"prepare.queue_time_us":20494,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":500806,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":343,"spinlock_wait_cycles":173799424,"thread_start_us":223281,"threads_started":1,"wal-append.queue_time_us":274712}
I20260709 12:11:21.370651  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.371464  8829 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:21.337026 12860 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.285401 12896 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:21.373245 12944 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:21.390053  9489 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:21.391355 12786 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.391892 12786 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.391628 12896 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:21.392408 12786 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.392131  8903 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.342902 12901 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:21.345575 12822 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.345878  8901 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.347185  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.347625 12745 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.349095 12825 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:21.350020  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2349) took 1139 ms. Trace:
I20260709 12:11:21.422049  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.421748  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.421576  8832 rpcz_store.cc:276] 0709 12:11:20.211010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.395059 (+184049us) service_pool.cc:224] Handling call
0709 12:11:20.395895 (+   836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.396481 (+   586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.396529 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.762122 (+365593us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b2c00010c48. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:11:20.769645 (+  7523us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.931179 (+161534us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:20.970481 (+ 39302us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.349612 (+379131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.349691 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.349736 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:21.349830 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.349963 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378838,"prepare.queue_time_us":37553,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":382815,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"spinlock_wait_cycles":110051712,"thread_start_us":127491,"threads_started":1,"wal-append.queue_time_us":355964}
I20260709 12:11:21.352280  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.353500 12898 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.314270 12941 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:21.355048  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.355989  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 774) took 1131 ms. Trace:
I20260709 12:11:21.358130 12615 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.360441  8828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2351) took 1136 ms. Trace:
I20260709 12:11:21.306286 12690 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.372506  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.373889  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.373353  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.396525  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.393862 12939 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.397670 12878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.008s	sys 0.004s
I20260709 12:11:21.401825 12828 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.429883  8833 rpcz_store.cc:276] 0709 12:11:20.224761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.415617 (+190856us) service_pool.cc:224] Handling call
0709 12:11:20.416053 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.416601 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.416672 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.548386 (+131714us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b2c00010c48. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:11:20.548829 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.961315 (+412486us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:20.979330 (+ 18015us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.355582 (+376252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.355672 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.355711 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:21.355800 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.355917 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383494,"prepare.queue_time_us":17365,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":378742,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":158961920,"thread_start_us":412134,"threads_started":1,"wal-append.queue_time_us":559152}
I20260709 12:11:21.457993  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.441849  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:21.431896  8828 rpcz_store.cc:276] 0709 12:11:20.224057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.401187 (+177130us) service_pool.cc:224] Handling call
0709 12:11:20.404801 (+  3614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.405163 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.405187 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.495124 (+ 89937us) log.cc:844] Serialized 564 byte log entry
0709 12:11:20.963556 (+468432us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.294522 (+330966us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.359846 (+ 65324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.359995 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.360071 (+    76us) raft_consensus.cc:1685] finished
0709 12:11:21.360111 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.360323 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64615,"raft.queue_time_us":64786,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":467404,"threads_started":1,"wal-append.queue_time_us":496075}
I20260709 12:11:21.461390  8829 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.434335 12896 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:21.469761 12896 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.473786  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.474509  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.473879  8908 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.476418  9489 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:21.480686  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.481858  8826 raft_consensus.cc:2393] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 8: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
W20260709 12:11:21.459619 12878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.010s	sys 0.005s
I20260709 12:11:21.489528  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.490546 12897 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.490801 12828 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.490581 12950 raft_consensus.cc:2804] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.434798 12745 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.459456 12898 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.493083  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:21.503017  9488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.027s
W20260709 12:11:21.503455  9488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.027s
I20260709 12:11:21.434119 12602 consensus_queue.cc:1059] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:11:21.496836  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.508903  8826 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.500545  8835 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:21.478672 12860 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.459196 12825 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.510908  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.514348  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.514490  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.422557 12822 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.514031 12950 raft_consensus.cc:697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:21.526470  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.527045 12602 consensus_queue.cc:1243] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:21.526676 12896 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:21.550877  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:21.563254  8905 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:21.556559  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:21.473949 12939 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.571542 12822 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.572206  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.575141  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.576834  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.577172  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:21.550374 12859 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.579316 12726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.021s	sys 0.004s
I20260709 12:11:21.594201 12899 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:21.595666 12726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.021s	sys 0.004s
W20260709 12:11:21.601022 12929 consensus_meta.cc:287] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.003s
I20260709 12:11:21.621665 12898 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:21.620702 12894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.298s	user 0.037s	sys 0.056s
W20260709 12:11:21.625089 12894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.038s	sys 0.056s
I20260709 12:11:21.608093 12950 consensus_queue.cc:237] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:21.674754  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 175277us
W20260709 12:11:21.677464  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.523926  8829 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:21.686400  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.686967  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.687702  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:21.687992  8835 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.688974  8830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.025s
W20260709 12:11:21.696952  8830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.007s	sys 0.025s
I20260709 12:11:21.697449  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.697904  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:21.698633  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2353) took 1431 ms. Trace:
I20260709 12:11:21.699083  8756 raft_consensus.cc:2410] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:21.700079  8906 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.703614  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.705170  8752 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
W20260709 12:11:21.706341  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.706672  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.712430  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:21.699157  8830 rpcz_store.cc:276] 0709 12:11:20.267105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.424174 (+157069us) service_pool.cc:224] Handling call
0709 12:11:20.424439 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.424663 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:21.057015 (+632352us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.697896 (+640881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.698016 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:21.698162 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.698266 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.698500 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255854,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1272069,"threads_started":2,"wal-append.queue_time_us":561839}
I20260709 12:11:21.690567  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:21.691767  8872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.014s	sys 0.052s
W20260709 12:11:21.733282  8872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.014s	sys 0.052s
I20260709 12:11:21.692137  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:21.733796  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 612172us
I20260709 12:11:21.725488 12688 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:21.739014  8799 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:21.690132  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:21.745188  8829 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.746279  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.748369  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.740073 12602 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.750437 12688 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:21.761626  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.762789  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.757484  9488 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:21.624758 12825 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.808102  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:21.810191  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:21.812223 12907 consensus_meta.cc:287] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.005s
I20260709 12:11:21.814872  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.816286  8752 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:21.815933  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.817090  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:21.820009  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.774121 12822 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.838366 12955 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.842056 12844 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.842545 12844 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:21.846592  8835 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:21.754433 12616 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 12:11:21.845870  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50979.6us
I20260709 12:11:21.862982  8755 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
W20260709 12:11:21.869832  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 71330.3us
I20260709 12:11:21.874607  8756 raft_consensus.cc:2393] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:21.865442 12688 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.840276 12786 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.844178 12844 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:21.888425 12688 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:21.894697 12897 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:21.895619  8826 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:21.890125 12602 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:21.901562 12569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.018s	sys 0.033s
I20260709 12:11:21.901341 12805 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:21.921157  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.921887  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 164892us
I20260709 12:11:21.918716  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:21.929391  8835 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.928609  8724 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:21.942517  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:21.943596  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:21.944365  8831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.022s	sys 0.038s
W20260709 12:11:21.945173  8831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.023s	sys 0.038s
I20260709 12:11:21.945773 12844 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.946220 12786 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.948855 12602 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:21.952215 12602 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:21.925254 12805 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:21.931584 12569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.018s	sys 0.033s
I20260709 12:11:21.945437  9524 raft_consensus.cc:2393] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 9: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:21.900596 12688 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:21.961704  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 430927us
W20260709 12:11:21.973551  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 62927.7us
I20260709 12:11:21.964474 12822 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.981369 12929 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:21.982362 12929 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.000717  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.006080 12599 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:22.006606 12911 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
W20260709 12:11:22.007678  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 64345.3us
I20260709 12:11:21.999214 12898 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:22.013060  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 212729us
I20260709 12:11:22.020918  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:22.024756  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2371) took 1109 ms. Trace:
I20260709 12:11:22.027449  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.041659  8900 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
W20260709 12:11:22.044314  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 69147.7us
I20260709 12:11:22.014626 12898 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.061170 12898 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.015307 12825 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:22.062297 12825 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.065393  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.028196  8830 rpcz_store.cc:276] 0709 12:11:20.906882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.737177 (+830295us) service_pool.cc:224] Handling call
0709 12:11:21.737810 (+   633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.738426 (+   616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.738454 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.739204 (+   750us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.892665 (+153461us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.892705 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.904921 (+ 12216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.015575 (+110654us) raft_consensus.cc:1685] finished
0709 12:11:22.015600 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.015768 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35127,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"thread_start_us":152853,"threads_started":1,"wal-append.queue_time_us":214922}
I20260709 12:11:22.053134  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:22.054085  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.054308  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2369) took 1148 ms. Trace:
I20260709 12:11:22.059614 12828 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:22.023386  8798 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:39957 timed out after 1.611s (SENT) [suppressed 51 similar messages]
W20260709 12:11:22.095932  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 72567.3us
I20260709 12:11:22.104034  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:22.112296 12967 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:11:22.118167 12945 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:22.119248  8754 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:22.118897 12945 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:22.119904  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 110074us
I20260709 12:11:22.121948  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:22.125648 12966 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.002s
I20260709 12:11:22.127853 12945 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:22.132805  8759 consensus_meta.cc:287] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.010s
I20260709 12:11:22.133417  8759 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:22.133817 12616 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.068090  8831 rpcz_store.cc:276] 0709 12:11:20.906230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.015463 (+109233us) service_pool.cc:224] Handling call
0709 12:11:21.015786 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.356425 (+340639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.356455 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.356941 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.946096 (+589155us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.946246 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.946388 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.053985 (+107597us) raft_consensus.cc:1685] finished
0709 12:11:22.054017 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.054222 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340277,"raft.queue_time_us":341499,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":49,"thread_start_us":588495,"threads_started":1,"wal-append.queue_time_us":694308}
I20260709 12:11:22.142287  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:22.143031  8831 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.143362 12805 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.145524 12805 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.146126  8909 raft_consensus.cc:1217] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Deduplicated request from leader. Original: 5.4->[7.5-8.6]   Dedup: 8.6->[]
I20260709 12:11:22.146721  8909 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:11:22.100370  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:22.162717  8829 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:22.164382  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:22.166132  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:22.166909  8834 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:22.168473  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:22.171515  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 50362.5us
I20260709 12:11:22.173185 12822 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:22.181203  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.184002  8754 raft_consensus.cc:1240] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.180233  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:22.193807  8908 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.201105  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.199638 12828 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.213061 12977 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.213908 12977 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.215421 12828 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.216192 12977 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.201327  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.220788  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:22.188301 12929 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:22.254356  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.257710  8725 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.259326  8902 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:22.260939 12972 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:22.261163  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.264139 12830 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.265206 12879 raft_consensus.cc:3055] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.265623 12830 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.266409 12830 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:22.296900  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68003.6us
I20260709 12:11:22.295500 12878 consensus_queue.cc:1059] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 8.6, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:22.257901  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:22.252866 12897 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:22.275074 12951 log.cc:927] Time spent T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.773s	user 0.003s	sys 0.000s
I20260709 12:11:22.305035 12899 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.282164  8830 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.291379  9523 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:22.291141  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.228435 12745 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.357929  8831 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:22.298062  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 788) took 1082 ms. Trace:
I20260709 12:11:22.265694 12879 raft_consensus.cc:740] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:22.346599  8908 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:22.351020 12969 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:22.351919 12972 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.344974 12899 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:22.358652 12822 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.365521  8833 rpcz_store.cc:276] 0709 12:11:21.215876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.296383 (+1080507us) service_pool.cc:224] Handling call
0709 12:11:22.297285 (+   902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.297561 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.297590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.297653 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.297684 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.297747 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.297861 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.394842  8829 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:22.395105  8872 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:22.367631 12602 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.403319  8829 pending_rounds.cc:85] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:11:22.403848  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 784) took 1189 ms. Trace:
I20260709 12:11:22.408396  8826 rpcz_store.cc:276] 0709 12:11:21.214770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.921278 (+706508us) service_pool.cc:224] Handling call
0709 12:11:21.921860 (+   582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.922459 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.922489 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.923114 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.071803 (+148689us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:22.157325 (+ 85522us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.402098 (+244773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.402201 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.402264 (+    63us) raft_consensus.cc:1685] finished
0709 12:11:22.402282 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.403769 (+  1487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1342,"prepare.queue_time_us":233032,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":60772,"raft.run_cpu_time_us":531,"raft.run_wall_time_us":11550,"thread_start_us":468748,"threads_started":3,"wal-append.queue_time_us":225806}
I20260709 12:11:22.362816 12898 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.366062 12878 consensus_queue.cc:1243] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:22.407698  8829 pending_rounds.cc:107] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:22.418540  8829 raft_consensus.cc:2889] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.419607  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2297) took 1249 ms. Trace:
W20260709 12:11:22.425824  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.431273  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 298616us
I20260709 12:11:22.425379  8835 rpcz_store.cc:276] 0709 12:11:21.169977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.868956 (+698979us) service_pool.cc:224] Handling call
0709 12:11:21.906252 (+ 37296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.413918 (+507666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.413968 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.419205 (+  5237us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.419263 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.419352 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.419531 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56536,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":219000,"threads_started":1}
I20260709 12:11:22.416347 12929 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.389256 12822 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.453446  8831 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:22.459163  8835 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.419327 12897 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.460152  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2301) took 1238 ms. Trace:
I20260709 12:11:22.462342  8831 rpcz_store.cc:276] 0709 12:11:21.216506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.393977 (+1177471us) service_pool.cc:224] Handling call
0709 12:11:22.438432 (+ 44455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.454078 (+ 15646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.454436 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.463691  8826 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:22.464694  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2306) took 1207 ms. Trace:
I20260709 12:11:22.465135  8826 rpcz_store.cc:276] 0709 12:11:21.257235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.416902 (+1159667us) service_pool.cc:224] Handling call
0709 12:11:22.461157 (+ 44255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.464271 (+  3114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.464590 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.466576  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2307) took 1202 ms. Trace:
I20260709 12:11:22.467269  8835 rpcz_store.cc:276] 0709 12:11:21.257506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.436398 (+1178892us) service_pool.cc:224] Handling call
0709 12:11:22.458895 (+ 22497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.459826 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.460097 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.489789 12615 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:22.466717 12745 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:22.487726 12972 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.490772 12615 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.499125  8725 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.462548 12954 consensus_queue.cc:1059] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:11:22.536202  8831 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:22.538609  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:22.451872 12830 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.537236  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2310) took 1278 ms. Trace:
I20260709 12:11:22.543800  8831 rpcz_store.cc:276] 0709 12:11:21.258341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.488845 (+1230504us) service_pool.cc:224] Handling call
0709 12:11:22.535860 (+ 47015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.536850 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.537160 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:22.552663  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.552790  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 83972.2us
I20260709 12:11:22.553871  8725 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.552696 12933 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.555450  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.555775 12933 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:22.556298 12878 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.557065 12878 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.556841 12933 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.558960  8725 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.559897 12602 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.560875  8833 raft_consensus.cc:1240] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:22.561677  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2309) took 1303 ms. Trace:
W20260709 12:11:22.562275 12976 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:11:22.562999 12830 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.564723 12954 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.565382 12954 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.567139  8725 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.568017 12954 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:22.484001 12899 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.538509  8874 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:22.570906 12898 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.562063  8833 rpcz_store.cc:276] 0709 12:11:21.258040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.462300 (+1204260us) service_pool.cc:224] Handling call
0709 12:11:22.531715 (+ 69415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.561353 (+ 29638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.561584 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.558866  8908 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:22.581264  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 152073us
I20260709 12:11:22.582249  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:22.551826  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:22.584218 12859 consensus_meta.cc:287] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.998s	user 0.015s	sys 0.014s
I20260709 12:11:22.584246 12983 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:22.586625 12897 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.546288 12745 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.588915 12954 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.589830 12954 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:22.587019 12983 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.587239 12895 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.590857 12114 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.590799 12984 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:22.592308  8874 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.592581 12899 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.549389 12972 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.594813 12615 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.590304 12745 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.601048  8760 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:22.570755 12602 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.612794  9525 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:22.604985 12895 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:22.622411  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.622836 12939 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.623750  8833 raft_consensus.cc:1240] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:22.625473  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 230468us
I20260709 12:11:22.626084 12839 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.596482 12825 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.629938  9524 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:22.631163  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2314) took 1371 ms. Trace:
I20260709 12:11:22.631815  8833 rpcz_store.cc:276] 0709 12:11:21.259531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.580739 (+1321208us) service_pool.cc:224] Handling call
0709 12:11:22.605838 (+ 25099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.630847 (+ 25009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.631086 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.607533 12983 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.632725  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.613824 12114 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:22.629272 12969 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.640391  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2311) took 1381 ms. Trace:
I20260709 12:11:22.640793  8831 rpcz_store.cc:276] 0709 12:11:21.258578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.544939 (+1286361us) service_pool.cc:224] Handling call
0709 12:11:22.625066 (+ 80127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.636687 (+ 11621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.636725 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.636771 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:22.640211 (+  3440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.640258 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.640346 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.635212 12745 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:22.645494  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 78535.8us
I20260709 12:11:22.636413 12895 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.654219  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:22.655480  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52178 (request call id 2304) took 1437 ms. Trace:
I20260709 12:11:22.655869  8832 rpcz_store.cc:276] 0709 12:11:21.218029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.653713 (+1435684us) service_pool.cc:224] Handling call
0709 12:11:22.655390 (+  1677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.643589 12969 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.648808 12895 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.663713  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2373) took 1360 ms. Trace:
I20260709 12:11:22.664366  8832 rpcz_store.cc:276] 0709 12:11:21.303312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.658087 (+1354775us) service_pool.cc:224] Handling call
0709 12:11:22.658638 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.658920 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.658957 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.659021 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.659065 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.663477 (+  4412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.663613 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.643098 12988 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:22.678864  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.632587 12954 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.669956  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 786) took 1454 ms. Trace:
W20260709 12:11:22.685734  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 145684us
I20260709 12:11:22.688016 12114 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.632421 12984 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:22.697954 12987 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:22.680452  8834 rpcz_store.cc:276] 0709 12:11:21.215291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.167651 (+952360us) service_pool.cc:224] Handling call
0709 12:11:22.170051 (+  2400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.403903 (+233852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.403960 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.445978 (+ 42018us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.575747 (+129769us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:22.614349 (+ 38602us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.625272 (+ 10923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.625336 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.669680 (+ 44344us) raft_consensus.cc:1685] finished
0709 12:11:22.669702 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.669888 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8879,"prepare.queue_time_us":38398,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":56761,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":222,"thread_start_us":325363,"threads_started":2,"wal-append.queue_time_us":153083}
I20260709 12:11:22.701624  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2318) took 1338 ms. Trace:
I20260709 12:11:22.701736 12726 consensus_queue.cc:1059] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.702103  8834 rpcz_store.cc:276] 0709 12:11:21.363230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.700149 (+1336919us) service_pool.cc:224] Handling call
0709 12:11:22.700921 (+   772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.701266 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.701292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.701358 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.701388 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.701456 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.701569 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.703509  8834 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.703819 12688 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.705238  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 787) took 1489 ms. Trace:
I20260709 12:11:22.705593 12822 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.708046 12945 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:22.708490 12945 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:22.708371  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.713694 12945 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.715649 12945 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.717262  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 789) took 1435 ms. Trace:
I20260709 12:11:22.717824  8833 rpcz_store.cc:276] 0709 12:11:21.281871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.638093 (+1356222us) service_pool.cc:224] Handling call
0709 12:11:22.681622 (+ 43529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.695642 (+ 14020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.695701 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.695779 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.716927 (+ 21148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.717033 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.717185 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.695973  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.704063  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 790) took 1319 ms. Trace:
I20260709 12:11:22.697844 12988 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:22.708588  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2380) took 1237 ms. Trace:
I20260709 12:11:22.720765  8835 rpcz_store.cc:276] 0709 12:11:21.471416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.707468 (+1236052us) service_pool.cc:224] Handling call
0709 12:11:22.707888 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.708144 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.708184 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.708249 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.708292 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.708371 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.708509 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.721776  8834 rpcz_store.cc:276] 0709 12:11:21.384386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.703010 (+1318624us) service_pool.cc:224] Handling call
0709 12:11:22.703336 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.703850 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.704008 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.725003 12984 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.727758  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2381) took 1214 ms. Trace:
W20260709 12:11:22.729995 12961 log.cc:927] Time spent T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.686s	user 0.003s	sys 0.000s
I20260709 12:11:22.731227  8833 rpcz_store.cc:276] 0709 12:11:21.513305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.725644 (+1212339us) service_pool.cc:224] Handling call
0709 12:11:22.726433 (+   789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.727375 (+   942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.727403 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.727467 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:22.727520 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.727577 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.727684 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.732299 12988 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.734453  8833 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.705751  8827 rpcz_store.cc:276] 0709 12:11:21.215595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.286422 (+1070827us) service_pool.cc:224] Handling call
0709 12:11:22.287026 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.287729 (+   703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.287756 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.288510 (+   754us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.528174 (+239664us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.528226 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.528311 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.704718 (+176407us) raft_consensus.cc:1685] finished
0709 12:11:22.704753 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.704988 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13458,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":160357,"threads_started":1,"wal-append.queue_time_us":281428}
I20260709 12:11:22.734503 12810 raft_consensus.cc:3055] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.736596  8833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 792) took 1022 ms. Trace:
I20260709 12:11:22.738008  8833 rpcz_store.cc:276] 0709 12:11:21.714371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.733893 (+1019522us) service_pool.cc:224] Handling call
0709 12:11:22.734233 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.736353 (+  2120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.736540 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.741866  8830 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
W20260709 12:11:22.750419  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 158267us
I20260709 12:11:22.749678  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2374) took 1444 ms. Trace:
I20260709 12:11:22.753502  8832 rpcz_store.cc:276] 0709 12:11:21.304780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.678105 (+1373325us) service_pool.cc:224] Handling call
0709 12:11:22.738530 (+ 60425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.743015 (+  4485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.743051 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.749385 (+  6334us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.749436 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.749508 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.749619 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.735781 12988 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:22.739347 12810 raft_consensus.cc:740] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:22.756924  8798 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:22.764060  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.765220  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 70610.3us
I20260709 12:11:22.752205 12602 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.771812  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 793) took 1049 ms. Trace:
I20260709 12:11:22.772193  8827 rpcz_store.cc:276] 0709 12:11:21.722712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.743213 (+1020501us) service_pool.cc:224] Handling call
0709 12:11:22.751489 (+  8276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.768841 (+ 17352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.768880 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.768919 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:22.771578 (+  2659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.771629 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.771730 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:22.783810  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46793.1us
W20260709 12:11:22.787408  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 105257us
I20260709 12:11:22.788551  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.794653  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 775) took 1508 ms. Trace:
I20260709 12:11:22.795215  9525 rpcz_store.cc:276] 0709 12:11:21.285931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.286931 (+  1000us) service_pool.cc:224] Handling call
0709 12:11:22.794390 (+1507459us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400528fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:22.794540 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957966208}
I20260709 12:11:22.796940  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:22.798550 12745 raft_consensus.cc:2764] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:22.800019  8799 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:22.800616  8908 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.760427  8759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43806
I20260709 12:11:22.805263  8759 raft_consensus.cc:606] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 12:11:22.805684  8759 raft_consensus.cc:614] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.805950 12879 consensus_queue.cc:260] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.807258 12879 raft_consensus.cc:3060] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.790949  8829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2305) took 1537 ms. Trace:
W20260709 12:11:22.808951 12964 log.cc:927] Time spent T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.797s	user 0.004s	sys 0.000s
I20260709 12:11:22.771258 12984 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.813999  8827 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:22.784958  8798 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:22.815634  8826 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:11:22.811549  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.808305  8829 rpcz_store.cc:276] 0709 12:11:21.256820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.395989 (+1139169us) service_pool.cc:224] Handling call
0709 12:11:22.396652 (+   663us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:22.567349 (+170697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.567381 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:22.568010 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 12:11:22.630863 (+ 62853us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.642341 (+ 11478us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.642666 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.642788 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.642838 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.790675 (+147837us) raft_consensus.cc:1685] finished
0709 12:11:22.790695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.790885 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32436,"prepare.queue_time_us":15855,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":85,"raft.queue_time_us":33919,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":10523,"thread_start_us":62393,"threads_started":1,"wal-append.queue_time_us":117212}
I20260709 12:11:22.814997  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2382) took 1089 ms. Trace:
I20260709 12:11:22.821493  8832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 794) took 1097 ms. Trace:
I20260709 12:11:22.821985  8827 rpcz_store.cc:276] 0709 12:11:21.725635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.774086 (+1048451us) service_pool.cc:224] Handling call
0709 12:11:22.785939 (+ 11853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.814616 (+ 28677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.814915 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.829108  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.829860 12878 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.830082  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.830885  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.830693 12878 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.831635  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:22.823328 12977 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:22.832414  8904 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.826540  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:22.834332  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:22.834499 12929 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.780040 12822 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.836751  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.836807  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.835855  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:22.845940  8902 raft_consensus.cc:1217] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Deduplicated request from leader. Original: 5.4->[7.5-8.6]   Dedup: 8.6->[]
I20260709 12:11:22.846572  8902 raft_consensus.cc:1240] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:11:22.847223  8832 rpcz_store.cc:276] 0709 12:11:21.724177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.755266 (+1031089us) service_pool.cc:224] Handling call
0709 12:11:22.769238 (+ 13972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.818489 (+ 49251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.821154 (+  2665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.821205 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.821252 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.821316 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.821427 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.823568 12939 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.818924 12810 consensus_queue.cc:260] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:22.862983  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.868124  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 83297.3us
I20260709 12:11:22.849015 12991 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.842329 12745 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.879346  8827 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:22.848881 12907 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.882593  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:22.886934  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:22.887917  9490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.892334  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 103942us
I20260709 12:11:22.901535 12841 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:22.902420 12841 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.861500 12822 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.914573  8904 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:22.915794  8754 raft_consensus.cc:1275] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:22.917428  8827 raft_consensus.cc:1275] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:22.920121  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:22.928068  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.931445  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.931728  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.932206  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:22.907641 12745 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.934209  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:22.930768  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:22.939105  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:22.880965 12939 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:22.940372  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 104571us
I20260709 12:11:22.937988  8756 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:22.936036 12830 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.943193 12830 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:22.944310 12988 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:22.945182 12988 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.946085 12830 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:22.921902 12825 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.952592  8798 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:22.953092  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:22.953073  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:22.966176  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:22.928455 12954 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:22.976537 12841 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:22.977221 12996 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:11:22.934703 12878 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.974864  8751 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:22.987872  8826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52178 (request call id 2320) took 1052 ms. Trace:
I20260709 12:11:22.988372  8826 rpcz_store.cc:276] 0709 12:11:21.937169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.793189 (+856020us) service_pool.cc:224] Handling call
0709 12:11:22.815221 (+ 22032us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:22.816290 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.981582 (+165292us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54003bc250. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:22.981742 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49312000}
I20260709 12:11:22.989015 12939 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:22.989306 12789 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:22.977224 12993 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:23.010846  8726 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:22.798821  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:22.990018 12789 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:22.952932 12988 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:22.975917  8901 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:23.019853  9525 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:22.952492 12810 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.018291  8906 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 13.
W20260709 12:11:23.041191 12999 log.cc:927] Time spent T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.051s	user 0.002s	sys 0.003s
I20260709 12:11:23.034473  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:23.049032  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 107010us
I20260709 12:11:22.983522 12954 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:23.054327  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 43671.2us
I20260709 12:11:23.049029 12825 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.010866 12950 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.056592  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2372) took 1753 ms. Trace:
I20260709 12:11:23.042673 12983 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:23.042626 12991 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:23.070855 12991 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.073944 12789 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.063040 12929 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:23.062511  8831 rpcz_store.cc:276] 0709 12:11:21.302917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.641859 (+1338942us) service_pool.cc:224] Handling call
0709 12:11:22.673312 (+ 31453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.673848 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.673881 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.674461 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.738957 (+ 64496us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:22.739004 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.739081 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.056233 (+317152us) raft_consensus.cc:1685] finished
0709 12:11:23.056267 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.056503 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1413,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":114,"thread_start_us":64009,"threads_started":1,"wal-append.queue_time_us":106519}
W20260709 12:11:23.052150 12997 log.cc:927] Time spent T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.102s	user 0.003s	sys 0.005s
I20260709 12:11:23.067271 12804 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.067533 12883 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:23.068065  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 131303us
I20260709 12:11:23.061383 12822 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:23.091185  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 177841us
I20260709 12:11:23.076792 13002 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.054816 12954 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.059823 12939 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:11:23.092844  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 82852.6us
I20260709 12:11:23.095527 13002 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:23.098531 13002 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.114521  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.115275  8827 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:11:23.123095  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.100943 12681 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.094256 12945 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:23.125361 12681 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.127223 12939 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.127684 12681 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.101192 12883 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:23.129604 12939 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.129271 12883 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.077703 12950 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.132055 12950 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.101545  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.081563 12825 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.106767  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.132570 13002 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.149915  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.150624  8831 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
W20260709 12:11:23.150717  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44055.6us
I20260709 12:11:23.150909  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.152279  8798 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.096388 13001 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:11:23.144446  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:23.153170  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:23.132830  8826 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:23.136528  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43822 (request call id 2141) took 1151 ms. Trace:
W20260709 12:11:23.142562  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.101867  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:23.148994  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:23.192408  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 46270.7us
I20260709 12:11:23.193121  9523 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.192925  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.200519  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.201721 12983 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:23.203197  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 101463us
I20260709 12:11:23.205572  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:23.139282 12825 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:23.191193 13002 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:23.209484  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 57294.1us
I20260709 12:11:23.210216  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.211555  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.211810 12825 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.208732 12789 consensus_queue.cc:1048] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.103897 13003 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:23.214329 12745 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.214066 13003 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.214849 12745 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.216235 13003 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.209190 12954 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.216889  8827 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:23.218153 12954 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.216907 12929 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.218945 12745 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.212512 12825 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.201237  8906 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:23.192991  8760 rpcz_store.cc:276] 0709 12:11:21.988056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.011247 (+ 23191us) service_pool.cc:224] Handling call
0709 12:11:23.136313 (+1125066us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54002b2ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:23.136436 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250330880}
I20260709 12:11:23.153823 12977 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.223623 12804 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.231503  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.237347  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.230461 12879 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.250453  8874 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:23.261576  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 56100us
I20260709 12:11:23.262358  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.244236 12984 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.272198  8834 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:23.272817 12949 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:23.273538  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.278594 12825 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.280839  8874 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.281886  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.283030 13001 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.283497 13001 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.283850 13001 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.284410 13011 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.284883 13011 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.285203 13011 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.286239 12954 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.286667 12954 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.287019 12954 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.289117 12939 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.289700  8799 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.290755  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.291538  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.292802 12745 raft_consensus.cc:2804] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.294811 12822 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.244560 12977 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.289624 12939 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.299113  8835 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:23.291545  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.318466  8908 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:23.319757  8724 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:23.330930  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:23.332193  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:23.332568  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:23.333195  8830 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.333089  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.334733 12984 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:23.335222 12984 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.335671 12984 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.336073  8753 raft_consensus.cc:1275] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:23.321733 12804 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:23.338814 12804 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.342267 12939 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.316313 12822 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.345017 12822 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.347409 12901 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.347955 12901 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:23.348322 12901 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.349627  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.350428  8751 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:23.350301 12977 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.325166 12745 raft_consensus.cc:697] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:23.352257 12745 consensus_queue.cc:237] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.347457 12114 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 12:11:23.335940  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73663.3us
I20260709 12:11:23.354976 12899 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.355432 12899 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.355826 12899 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.358666 12879 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:23.335011 12945 consensus_queue.cc:1048] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.373593  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.374379  8757 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
W20260709 12:11:23.379120  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.371497 12939 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.381671 12939 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.382081 12939 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.382547 12969 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:23.383200 13023 log.cc:927] Time spent T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:11:23.384528 12977 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.385253 12804 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.365305  9489 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.391393  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.370796 12810 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.407015  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.409264  8831 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:23.407760  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.416213  9523 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:23.416739  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.418449  8830 raft_consensus.cc:2468] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 14.
I20260709 12:11:23.419977  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:23.440750  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.443471  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.444443  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.403188 12859 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.441609  8906 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:23.389815 13010 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:23.455570  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:23.454602  8760 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:23.458644  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.460858  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.467214  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.468448 13010 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.468894  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.496906 13010 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.455149 12859 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.457718 12879 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.521050  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.524979  8751 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:23.519893 13010 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.532262  8909 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:23.464855 12991 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.574548  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.575973  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:23.579988  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 288489us
W20260709 12:11:23.587693  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 137554us
I20260709 12:11:23.522138 12859 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.538619 12786 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.591045 12839 consensus_queue.cc:1059] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:23.586447 12991 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:23.628127  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.634706  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.573309 12879 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.635982  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.649500 12681 consensus_queue.cc:1048] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:23.653008 12983 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:23.657341 13020 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:11:23.667574 13017 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:11:23.669457 12984 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:23.656468 13021 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:23.604212 13001 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.606561 12786 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.680397  8799 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.681068  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:23.694460  8906 raft_consensus.cc:2393] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 14: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:23.696007 12991 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.683243 12899 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.646481 12954 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.703820  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:23.701184  8874 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.704038 13010 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.729290 13010 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.705403 12954 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.703591 12899 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.697039 12984 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:23.747344  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:23.748075  8835 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.748967 12841 raft_consensus.cc:3055] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.749500 12841 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:23.750541 12841 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.752079 12841 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.752976 12786 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.753854 12839 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.754463 12839 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.757406  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:23.693925 12602 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.769217  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:23.769487 12804 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:23.769594 12899 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.706561 12933 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.770081 12839 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.695638  8726 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.777048 12839 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:23.777253  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 81746.9us
I20260709 12:11:23.768224  8835 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:23.777431 12899 raft_consensus.cc:3055] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:23.778278  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.778241  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:23.781287  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 155649us
I20260709 12:11:23.782534  8902 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 13.
W20260709 12:11:23.783231  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 82124.4us
I20260709 12:11:23.694911 12977 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.792011  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.794701  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.794905  8799 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.789256  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.801362  9487 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.700582 12939 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.805932  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.776491 12804 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.810925 12804 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.786652 12899 raft_consensus.cc:740] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:23.792557 12959 raft_consensus.cc:2804] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:23.698086 13011 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.816870  8751 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 7.
I20260709 12:11:23.793957 12602 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.818504  8828 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 6.
I20260709 12:11:23.816453  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:23.788110 12933 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.822911  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:23.826661 13001 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.823926 12822 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.804129 12745 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:23.844062  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.844376 12933 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.844928  8829 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:23.845964  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.848476  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.844249 12939 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.850128  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.851320  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a81765aa0b4241bacb910d72fb71cb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.827638 13002 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:23.804724 12859 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.852751 12818 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.852953 12899 consensus_queue.cc:260] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.853601 12818 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:23.852480  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.854730  9523 raft_consensus.cc:2393] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:23.851421 12822 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.841898  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:23.856518  8833 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.854193 12852 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.861478  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:23.871785  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.872785  8829 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
W20260709 12:11:23.881222  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 44186.3us
I20260709 12:11:23.881374  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:23.881527  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:23.858104 12901 consensus_meta.cc:287] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
I20260709 12:11:23.878410  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.884792  8753 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:23.852365 13002 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.891644  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.892026  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.893433  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.858592 12959 raft_consensus.cc:697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:23.902678  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 82919.5us
I20260709 12:11:23.857524 12745 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:23.906049  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.907455  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.878532 12983 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.902369 12859 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:23.910879  8829 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:23.895385 12879 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:23.913406  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.918481 12959 consensus_queue.cc:237] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.906188  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:23.925372  8756 raft_consensus.cc:2410] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:23.932225  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.907291  8752 raft_consensus.cc:2376] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7. Re-sending same reply.
I20260709 12:11:23.939109  8909 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:23.903716 12818 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.936399 12839 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.947116 12839 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.949366 12839 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:23.945432  9487 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:23.950783 12745 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:23.952759  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.953398  8752 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.954315  8826 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:23.960005  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.960896  8903 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:23.962807  8752 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:23.967875  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:23.968815  8829 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:23.970141  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60876.5us
I20260709 12:11:23.975298  8826 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:23.978971  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.980837  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.982975  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:23.983130  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.984011  8756 raft_consensus.cc:3060] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.983943  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:23.985738  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.897199 12901 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:23.961555 12933 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.992612  8826 raft_consensus.cc:1240] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:24.027297  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:23.998817  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:24.050792  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 68541.5us
I20260709 12:11:24.051904  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:23.976235 13009 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.064229  8906 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:24.067101  8759 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:24.067886  8901 raft_consensus.cc:1240] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.072294  9487 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:23.965373 12822 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:11:24.077765 13035 log.cc:927] Time spent T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:11:24.082726  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:24.097308  9524 raft_consensus.cc:606] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:23.995558 12933 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.098230  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.104959 12901 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:24.064778 12984 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.106101 12984 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.109055 13037 raft_consensus.cc:2804] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.109674 13037 raft_consensus.cc:697] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:24.110697 13037 consensus_queue.cc:237] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:24.112752  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 43564.1us
I20260709 12:11:24.114295 12933 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.114485  9525 raft_consensus.cc:1240] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.115500  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:24.118294  8751 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:24.087122  8756 raft_consensus.cc:2468] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:24.089461 12859 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.089795 13011 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:24.093928  8907 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:24.134262  8726 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:24.137428  8752 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:24.124549  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:24.145720  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.146827  8752 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:24.172896  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:24.173626  8906 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:24.176302  8829 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 14.
I20260709 12:11:24.122697 12859 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.174324 12883 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.186049 12984 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:24.179476 12602 consensus_queue.cc:1059] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:24.092514 13009 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.206593  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.207466  8752 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 13.
I20260709 12:11:24.207770 13009 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:24.205693 12602 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.208515 12602 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:24.209895 12602 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.211913 12602 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.174659 13039 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.188544 12859 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.193630  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:24.224539  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 135489us
I20260709 12:11:24.227398  8833 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:24.225004  8754 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:24.228981  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:24.229650  8907 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:24.231851  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.232540  8829 raft_consensus.cc:3060] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.238049  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.239018  8752 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:24.239284  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.240576  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.240912  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.242419  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:24.244616  8752 raft_consensus.cc:1275] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:24.244433  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.241595  8753 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:24.244009  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.247519  8755 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:24.244378  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.248183 13002 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:24.231185 13039 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:24.255347 13039 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:24.256799 12949 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:24.257679 12949 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.260860  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.261587  8833 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:24.265801  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.267285  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.270159  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.272281  8829 raft_consensus.cc:2468] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:24.274554  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.275455  8833 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:24.281363  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.282058  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:24.286301  8725 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.296916  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.270888 13038 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.271450 12602 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.301677  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.280812 12839 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.304719  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:24.305370  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.307816  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.308139  8798 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:24.308272  8833 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.283946 12883 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.310302  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.313714  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.304593 13012 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.319340 13012 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.306206 12602 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.310099 12841 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.313967 12939 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.387365  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.388885  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:24.389577  8906 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:24.391279  8833 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:24.392558  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.393565  8833 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:24.321985 12839 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:24.393993  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 76228.8us
I20260709 12:11:24.421326  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.323027 13038 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:24.382359 13024 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.700s	user 0.006s	sys 0.000s
I20260709 12:11:24.386409 12950 raft_consensus.cc:993] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:11:24.361044 12822 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.356545 13012 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.382710 13044 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:11:24.426066  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:24.428507  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 108889us
I20260709 12:11:24.319785 13026 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.323740 12879 consensus_queue.cc:1059] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:11:24.356096 12602 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.383203 12949 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:24.413825 12983 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.447948  8798 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:24.483134  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 57166.9us
I20260709 12:11:24.484149  8725 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.490785  8832 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.445756 12841 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.446023 12895 raft_consensus.cc:1081] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:11:24.449122 13026 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:24.490198 13021 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:11:24.497665 13024 log.cc:927] Time spent T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:24.492205 13038 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.499573 12841 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.463083 12933 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.503497 12822 raft_consensus.cc:2764] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:11:24.521338 13043 log.cc:927] Time spent T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:24.525463 13042 log.cc:927] Time spent T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:11:24.538729  8834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2396) took 1249 ms. Trace:
I20260709 12:11:24.505934 13026 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.513402  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 65645.7us
I20260709 12:11:24.492856 13012 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.564535 13012 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:24.565411  9525 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:24.567991 12933 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:24.568621  9524 raft_consensus.cc:606] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:24.569080  9524 raft_consensus.cc:614] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:24.542012 12841 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:24.589222 13049 log.cc:927] Time spent T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:11:24.502828 13054 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.539324 12859 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:24.547760 13033 log.cc:927] Time spent T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.720s	user 0.002s	sys 0.002s
I20260709 12:11:24.549665  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.548913  8834 rpcz_store.cc:276] 0709 12:11:23.289506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.292413 (+  2907us) service_pool.cc:224] Handling call
0709 12:11:23.292878 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:23.293394 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:23.293757 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.529435 (+235678us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:23.607594 (+ 78159us) log.cc:844] Serialized 52 byte log entry
0709 12:11:23.607842 (+   248us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:23.607895 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.608005 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.381598 (+773593us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:24.538262 (+156664us) raft_consensus.cc:1685] finished
0709 12:11:24.538402 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.538623 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":780,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":8139,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":35981,"spinlock_wait_cycles":3800960,"thread_start_us":235100,"threads_started":1,"wal-append.queue_time_us":327183}
I20260709 12:11:24.555883 12899 raft_consensus.cc:3060] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.607816  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:24.618621  8906 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.629849  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 80265.1us
I20260709 12:11:24.630999  8798 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.634240  8798 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:24.643157  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.644156  8833 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.643316  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.646129  8831 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.620604 13054 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:24.626766  8901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:11:24.666034  8901 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:24.666550  8901 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.669883  8798 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.675518  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:24.634888 12977 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.693472  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.646004 13039 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.651950 12745 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:24.701745  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55671.6us
I20260709 12:11:24.703620  8831 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:24.705018  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.672684 13050 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.665083 12804 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 12:11:24.706820 12818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.028s	sys 0.042s
I20260709 12:11:24.723155  8833 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
W20260709 12:11:24.723590 12818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.028s	sys 0.042s
I20260709 12:11:24.736441  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.718827 13039 raft_consensus.cc:2764] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:24.740130  8757 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.718524 13001 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.750510  8830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 814) took 1353 ms. Trace:
I20260709 12:11:24.751109  8830 rpcz_store.cc:276] 0709 12:11:23.396810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.442198 (+ 45388us) service_pool.cc:224] Handling call
0709 12:11:23.442683 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.455515 (+ 12832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.455546 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.460267 (+  4721us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.674511 (+214244us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:23.693531 (+ 19020us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.693942 (+   411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.694020 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.547018 (+852998us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:24.743879 (+196861us) raft_consensus.cc:1685] finished
0709 12:11:24.750236 (+  6357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.750424 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18340,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":54,"raft.queue_time_us":1994,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":5687,"spinlock_wait_cycles":17899776,"thread_start_us":87645,"threads_started":1,"wal-append.queue_time_us":274746}
I20260709 12:11:24.726817 13055 raft_consensus.cc:2764] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:24.765059 12859 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:24.767051  8759 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:24.768142  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.769402  8754 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:24.770591  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.771929  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.773016  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.773741  8760 raft_consensus.cc:3060] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.776113  8759 raft_consensus.cc:1240] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:24.780160  8906 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:24.724823 12745 consensus_queue.cc:1059] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:24.789052  8757 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:24.747502 13001 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:24.806155  8760 raft_consensus.cc:2468] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 14.
I20260709 12:11:24.791987 13039 raft_consensus.cc:3055] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.745188 13026 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:24.814579  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 128873us
W20260709 12:11:24.810052  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 106911us
I20260709 12:11:24.824384  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:24.825050  8906 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.807125 13001 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.850589  8833 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:24.853809  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:24.854745  8757 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.829696  9488 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:24.861996  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.820055 13039 raft_consensus.cc:740] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:24.869112  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:24.871306  8754 raft_consensus.cc:2393] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:24.777081 13054 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:24.872095  8906 raft_consensus.cc:2468] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 14.
I20260709 12:11:24.876008  8757 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:11:24.883176  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.883915  8833 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:24.890136  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 60534us
I20260709 12:11:24.890568  9489 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:24.862556 13063 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.892648  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:24.893026  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.899252  8834 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:24.894088  8827 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
W20260709 12:11:24.900175  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 62489.4us
I20260709 12:11:24.900940  8751 raft_consensus.cc:1275] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:24.902890  8828 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:24.841868 13008 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:24.841645 13005 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:11:24.907739  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 214403us
I20260709 12:11:24.912050  8798 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
W20260709 12:11:24.913085  8724 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.921664  8798 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.909202 12949 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.928447  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.930534  9488 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:24.915884 13012 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.938180  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:24.918716 12984 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.941195  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57327b790014487690d5754a4e058fae"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:24.892287 13063 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:24.948199  9524 raft_consensus.cc:606] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:24.945322 13073 consensus_queue.cc:1059] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:24.946009  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.955515  8798 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:24.946830 13076 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.938120 12977 raft_consensus.cc:2764] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:24.947814 12984 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.929697 13010 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:11:24.971760  8658 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 149) took 19340 ms (client timeout 15000 ms). Trace:
W20260709 12:11:24.971968  8706 auto_rebalancer.cc:893] Removing replace marker failed: Replica 005ae7a1e140481db6cc04faeb268d9c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:24.958101 13062 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.984719 12984 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.005674  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:24.958664 12938 raft_consensus.cc:2804] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:24.953727 13067 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.008956 13067 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.009493 13067 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.977200 13060 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:11:24.960335 12983 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.013644  8759 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.014076  8759 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:25.014307 12983 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:25.014802 12983 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.014931  8759 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.016077  8759 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.960929 13012 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:25.017518 13012 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:24.960436 13064 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.019778 13064 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.020187 13064 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:24.999265  8706 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:11:25.020828  8706 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:11:24.927627 13039 consensus_queue.cc:260] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:24.997917 13063 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.009052 12938 raft_consensus.cc:697] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:24.994078  8901 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:24.962165  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 44941.4us
I20260709 12:11:25.036010  8907 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:24.996596  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:25.037022  8831 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
W20260709 12:11:25.035238  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 66272.5us
W20260709 12:11:25.042037  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 97792.5us
I20260709 12:11:25.042958  8872 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:25.044117 13026 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.042631 13062 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.051627 13062 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.054842 12938 consensus_queue.cc:237] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.062546  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:25.063201  9487 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:25.063902  8906 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:25.065974 12991 raft_consensus.cc:2804] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.066578 12991 raft_consensus.cc:697] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:25.067492 12991 consensus_queue.cc:237] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.070796  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:25.074189  8753 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:25.079561  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:25.086627  8901 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.088047  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:24.984365 12841 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.035696 13076 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:25.096662  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 132318us
I20260709 12:11:25.105386  8798 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:25.112794  8752 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:25.112934  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49874.6us
I20260709 12:11:25.116814  8758 raft_consensus.cc:1275] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:25.118373  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:25.102138 12839 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.116485 12950 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.995911  8658 rpcz_store.cc:269] 0709 12:11:05.641168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.675871 (+ 34703us) service_pool.cc:224] Handling call
0709 12:11:24.920412 (+19244541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:20.190259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:20.191034 (+   775us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:20.191069 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:20.191087 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:20.315870 (+124783us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:20.316428 (+   558us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:20.316464 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:11:20.321500 (+  5036us) tablet.cc:701] Row locks acquired
0709 12:11:20.321531 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:11:20.321685 (+   154us) write_op.cc:270] Start()
0709 12:11:20.321821 (+   136us) write_op.cc:276] Timestamp: P: 1783599080321641 usec, L: 0
0709 12:11:20.321849 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:11:20.322590 (+   741us) log.cc:844] Serialized 6345 byte log entry
0709 12:11:21.007349 (+684759us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce350390ac 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b
0709 12:11:22.293635 (+1286286us) op_driver.cc:464] REPLICATION: finished
0709 12:11:22.616562 (+322927us) write_op.cc:301] APPLY: starting
0709 12:11:22.616719 (+   157us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:22.618257 (+  1538us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:22.618309 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:22.620028 (+  1719us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:22.620467 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=32
0709 12:11:22.620544 (+    77us) write_op.cc:312] APPLY: finished
0709 12:11:22.621154 (+   610us) log.cc:844] Serialized 113 byte log entry
0709 12:11:22.633539 (+ 12385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.651002 (+ 17463us) write_op.cc:454] Released schema lock
0709 12:11:22.651119 (+   117us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:22.657489 (+  6370us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.657527 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3691090,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":320853,"apply.run_cpu_time_us":6106,"apply.run_wall_time_us":40936,"num_ops":16,"prepare.queue_time_us":470487,"prepare.run_cpu_time_us":99800,"prepare.run_wall_time_us":1438541,"raft.queue_time_us":279590,"raft.run_cpu_time_us":29546,"raft.run_wall_time_us":252260,"replication_time_us":1971460,"spinlock_wait_cycles":236365184,"thread_start_us":1985377,"threads_started":4,"wal-append.queue_time_us":1517540,"wal-append.run_cpu_time_us":44386,"wal-append.run_wall_time_us":1781783}]]}
I20260709 12:11:25.095920 13005 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:25.117635 13062 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.116158 12949 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
W20260709 12:11:25.126394 12602 consensus_meta.cc:287] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260709 12:11:25.126425  8798 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.125059 12839 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.121724 12983 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.136663 13052 consensus_queue.cc:1048] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:25.137212 13076 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.129411 13083 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.130337 13084 consensus_queue.cc:1048] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:25.249164 13071 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:25.250140 13073 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:25.149024 13064 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.251638 13067 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.252085 12950 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.253180 13064 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.148110 13001 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.253906 13067 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.162453 13062 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.152483 12841 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.154634  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:11:25.208189  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 81876.8us
I20260709 12:11:25.217396  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.259521  8828 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.207813 12602 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.259667  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.207784 12839 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.244232  9525 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.224668 12949 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.255389  8903 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.210170 13026 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.242753 12984 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.274068 12959 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:25.300609  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.273303  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:25.282887  8798 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.293505 12602 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.287160 13067 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:25.294886 13001 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:25.295387  8755 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.303520  9523 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.311589  9523 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:25.312609  9523 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.313783  9523 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.309738 13067 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.332113 13067 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.337160  8874 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:25.325430  8754 pending_rounds.cc:85] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 10
I20260709 12:11:25.338043  8754 pending_rounds.cc:107] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:11:25.338402  8754 raft_consensus.cc:2889] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.351483  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:25.355260  9523 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
W20260709 12:11:25.356069  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 48456.7us
W20260709 12:11:25.363554  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.366621  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:25.310611 13064 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.391434  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:25.374044 13084 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.394593  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:25.378157 13001 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.370405 13002 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:25.401670 12959 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:25.397377 13094 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.411580 13084 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.418319  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:25.398555 12991 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.421146  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.438326  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.449098  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.457578 13002 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:25.458089 13002 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:25.449036 13026 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.461176  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.462980 12602 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:25.463495 13059 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.463635 12602 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.464283 13059 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.464753 13059 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.465852 12839 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.450249 12822 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:25.469664  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.470832  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.472035 12822 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.474340 12822 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.475370  8760 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.420316 12991 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:25.481338 12991 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.490283  8758 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.491321  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.494282 13005 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:25.495173 12681 raft_consensus.cc:3055] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.495056 13005 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.495676 12681 raft_consensus.cc:740] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:25.497071 13008 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:25.497815 13008 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.499110  9521 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.500142 13008 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.500705  9521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 784) took 1386 ms. Trace:
I20260709 12:11:25.501144  9521 rpcz_store.cc:276] 0709 12:11:24.114335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.115153 (+   818us) service_pool.cc:224] Handling call
0709 12:11:24.115492 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.498791 (+1383299us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54005297a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380badc0 00007fce381451c0 00007fce38146231 00007fce38142d8f 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c
0709 12:11:25.499593 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.500409 (+   816us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400528fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:25.500595 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2535461120}
I20260709 12:11:25.503218 13005 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:25.504019 12984 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.505409 12681 consensus_queue.cc:260] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.506817 12681 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.509071  9524 raft_consensus.cc:606] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:25.513589 13067 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.510146  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:25.539594  8903 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.517474  8907 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:25.540030  8758 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:25.517879  8828 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
W20260709 12:11:25.518035  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 65427.9us
I20260709 12:11:25.519027  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.541260  8830 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.541157  8760 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:25.486277 12839 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.556674  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:25.557781  8760 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:25.560731  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.542537 12984 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.567675 13067 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.572975 12984 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.575903 12984 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.542729 12822 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.577587 12822 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.582717  8833 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.580309 12822 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.581344 13062 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.674932 12977 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.561225 13083 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:25.647243 13084 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.649395  9523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:25.775286  9523 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.650578 12841 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:25.651260  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 64599.9us
I20260709 12:11:25.587054 12839 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:25.792444  8830 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:25.793787  8831 raft_consensus.cc:1240] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 12:11:25.817343  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:25.653697 13059 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.655444  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:25.655457 12991 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.660925  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:25.661702  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:25.662163  8903 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
W20260709 12:11:25.662729  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.663749  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:25.664692  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:25.697122 12786 raft_consensus.cc:993] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:25.696987 12859 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:25.697486  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 142452us
W20260709 12:11:25.727797  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 177993us
I20260709 12:11:25.599165 13045 raft_consensus.cc:993] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
W20260709 12:11:25.759323  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 267683us
I20260709 12:11:25.762905  8833 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:25.760051  8725 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:25.777889  8798 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:25.869560  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:25.869868  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 109935us
W20260709 12:11:25.870183  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 92415.7us
I20260709 12:11:25.870734  8725 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:25.871119  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:25.818293  8826 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:25.872440  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:25.873947  8874 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:25.874236  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:25.875056  8830 raft_consensus.cc:2393] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:25.860356  9523 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:25.862905  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.874903  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.848484  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:25.879922  8752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43822 (request call id 2171) took 1131 ms. Trace:
I20260709 12:11:25.872016 13084 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.881086  8752 rpcz_store.cc:276] 0709 12:11:24.742248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.742460 (+   212us) service_pool.cc:224] Handling call
0709 12:11:24.742826 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.113433 (+370607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.873349 (+759916us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540014c8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:25.873539 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850326784}
I20260709 12:11:25.872714 12935 raft_consensus.cc:1081] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:25.883812  8801 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:25.878409 12879 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.885183 12879 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:25.886133 12933 raft_consensus.cc:1081] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:25.886055 12879 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.811426 12841 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.896235 12745 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.903617  8830 raft_consensus.cc:1240] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.914131  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:25.880128 13063 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.882854 13050 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.810797 12839 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:25.793757 13083 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.907303  8831 raft_consensus.cc:1240] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 12:11:25.791543 12977 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.920320  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:25.921916  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.924860 13063 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:25.926136 13063 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.926472 12977 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.921509 13050 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.929458 13050 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.927845  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:25.909322 13002 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:25.930847 13002 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.914937 13059 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.933060 13083 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:25.933925  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:25.934906  8907 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:25.939451  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:25.942118  8828 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.953651  8828 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:25.965740  8831 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.968779  8830 raft_consensus.cc:3055] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:25.969378  8830 raft_consensus.cc:740] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:25.880508 13067 consensus_queue.cc:1059] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:25.905800 13082 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.970330  8830 consensus_queue.cc:260] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:25.985001  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 111127us
I20260709 12:11:25.988137  8830 raft_consensus.cc:3060] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.989660  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:25.915859 13039 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.914918 12991 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:25.973280  8828 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:25.927287 12841 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:25.930255 12839 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.027976  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:25.909423 13103 consensus_queue.cc:1048] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:11:25.983189 13083 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:26.037287  8828 raft_consensus.cc:1240] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:26.037107  9489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.025203 13089 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.028096 12745 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:26.027539 13082 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:26.052205  8830 raft_consensus.cc:1275] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:26.055505  8830 pending_rounds.cc:85] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 9
W20260709 12:11:26.057682  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 183283us
I20260709 12:11:26.055896  8830 pending_rounds.cc:107] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:26.060209  8830 raft_consensus.cc:2889] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.060808  9520 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:26.051954 13089 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:25.879320  8646 maintenance_manager.cc:643] P 11a02b83f2af4df69b08a1f984747bcd: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.418s	user 0.193s	sys 0.078s Metrics: {"bytes_written":30521,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":175717,"dirs.run_cpu_time_us":529,"dirs.run_wall_time_us":67562,"drs_written":1,"lbm_read_time_us":9673,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":44861,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":108053,"threads_started":2,"update_count":16,"wal-append.queue_time_us":133552}
I20260709 12:11:26.072276 13087 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:26.053323 13083 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.099164 13082 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.088464  8647 maintenance_manager.cc:419] P 11a02b83f2af4df69b08a1f984747bcd: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8546 bytes on disk
I20260709 12:11:26.110172  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:26.100337 12745 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.065022 13089 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.116063  8759 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:26.118506  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.122293  8903 raft_consensus.cc:1240] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:26.129585  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.130451  8903 raft_consensus.cc:1240] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.130698  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.131598  8907 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.065100 13076 consensus_queue.cc:1059] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:26.196319 13114 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:26.204833 12991 raft_consensus.cc:3055] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.205351 12991 raft_consensus.cc:740] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:26.206203 12991 consensus_queue.cc:260] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.143843 12841 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.207953 12841 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.216787  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.217680  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
W20260709 12:11:26.218389 13117 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:26.218529  9524 raft_consensus.cc:606] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:26.221562  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:26.215510 13059 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.222716 13059 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.224021  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:26.225402  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:26.121245 13079 consensus_queue.cc:1059] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:11:26.229758 13094 raft_consensus.cc:3055] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.230206 13094 raft_consensus.cc:740] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:26.231204 13094 consensus_queue.cc:260] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.233784  8646 maintenance_manager.cc:643] P 11a02b83f2af4df69b08a1f984747bcd: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.096s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":502,"lbm_reads_lt_1ms":4}
I20260709 12:11:26.232614 13094 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.238080 13083 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.197129 13114 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.242602  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:26.246759  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.247340 12878 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:26.248485  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35690 (request call id 687) took 1253 ms. Trace:
I20260709 12:11:26.248988  9525 rpcz_store.cc:276] 0709 12:11:24.995512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.995659 (+   147us) service_pool.cc:224] Handling call
0709 12:11:24.996057 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.284016 (+287959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.248236 (+964220us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54007b02d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:26.248423 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570262912}
I20260709 12:11:26.249693  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.249960 12841 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.253154  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.242004 13114 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.258663  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.260361 12841 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.267133 12841 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.261155  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.269012  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.272473 12841 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.276791 13059 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.277065  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:26.277765  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.278250  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.280231  8903 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:26.257125  8907 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:26.284600  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.285336  8907 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:26.288282  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.292780 12991 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.297973  8835 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:26.298866 13102 log.cc:927] Time spent T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.746s	user 0.006s	sys 0.014s
I20260709 12:11:26.305084 12839 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.305766 12839 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.308081 12839 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.309832  8724 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:26.310238 13059 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.310837  8724 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.313386 13054 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.313868 13054 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:26.314733 13054 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.316810 12939 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.319173 12602 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.320112  8724 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:26.320806 12977 raft_consensus.cc:3055] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.321183 12977 raft_consensus.cc:740] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:26.321969 12977 consensus_queue.cc:260] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.322356  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.322933  8906 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:26.323132 12977 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.323932 13059 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.324407 13059 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.324781 13059 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.292017  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.352104  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:26.353498  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.354594  8907 raft_consensus.cc:2393] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 12: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:26.355850  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.359577  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:26.369400  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.360584  8751 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
W20260709 12:11:26.379302  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.380594  8760 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:26.380968  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:26.381537  8752 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.385214  8754 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:26.383033  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
W20260709 12:11:26.390087  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 82856.1us
I20260709 12:11:26.385324 13089 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.392789 13067 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.393093 13050 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.393359 13067 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.393959 13089 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.395203 13050 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.396308  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:26.386772  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 274231us
I20260709 12:11:26.403931  8799 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.405728  8754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57327b790014487690d5754a4e058fae"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:26.406260  8754 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.406610  8754 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.407582  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:26.409155  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:26.409690  8751 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.395215 13067 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.378227 12602 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.378667 12883 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.399554  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:26.413255  8799 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.413977  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:26.396821 12841 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.427279 12841 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.429450 12841 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.430029 13045 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:26.434556  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.436177  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.437541  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:26.414489  8760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:26.440130  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.442852  8799 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:26.444144  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.444909  8760 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.445379  8760 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.449186  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:26.451503  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:26.455309  8831 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:26.446851  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.424654 12602 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.479029  8799 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.421036 12822 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.482257  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:26.483099  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:26.483290  8726 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:26.485466  8799 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:26.486332 12959 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.458515 13116 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.459126 13067 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.460829 12839 raft_consensus.cc:493] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:26.494674  8654 catalog_manager.cc:5697] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 3 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 6 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:26.495502 13081 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.523999  8760 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.476218 13026 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.546238  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 61000.4us
I20260709 12:11:26.496516 12983 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.513613 12899 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.565935  8751 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:26.570266  8754 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:26.573006  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 95151.7us
I20260709 12:11:26.573163  8754 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.580241  8903 raft_consensus.cc:1240] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.547461 13055 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.502787 13089 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.582043 13089 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:26.582442 13089 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.585280 12786 consensus_queue.cc:1059] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:26.587306 12786 raft_consensus.cc:3055] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.587663 12786 raft_consensus.cc:740] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:26.588207  8752 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.589002 12786 consensus_queue.cc:260] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.597337 12786 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.557601 13104 log.cc:927] Time spent T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.593s	user 0.007s	sys 0.003s
I20260709 12:11:26.558077  8654 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:26.561013  8827 raft_consensus.cc:2393] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:26.539209 13116 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:26.592917 13046 raft_consensus.cc:993] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
W20260709 12:11:26.595424 13099 log.cc:927] Time spent T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:11:26.599078  8726 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:26.500344 12745 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.601100 13074 consensus_queue.cc:1059] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:26.691499  8654 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 3 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:26.612864 12991 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:26.542750 13114 consensus_queue.cc:1059] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:11:26.540350 13078 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.482640 12602 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.552606  8799 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.546602 12839 raft_consensus.cc:515] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.628468  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:26.631291  8798 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:26.719597  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 88391.4us
I20260709 12:11:26.636905  8835 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:26.696426 13054 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.641603  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.641669 12939 raft_consensus.cc:493] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:26.645236 12852 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.645479  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:26.728135  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 82781.2us
I20260709 12:11:26.646710 13065 consensus_queue.cc:1048] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:26.648053 13045 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:26.649737  8725 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.656085 13059 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.668540 13067 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.669586  8901 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:26.678221 13116 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.693027  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 94052.7us
I20260709 12:11:26.501091 13084 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 12:11:26.696580 12745 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.689883 13058 raft_consensus.cc:1081] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:26.709033  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2143) took 1333 ms. Trace:
I20260709 12:11:26.500451 13082 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 12:11:26.689324 12883 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.722009  8903 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:26.724184  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 171647us
I20260709 12:11:26.763278  8799 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.724895  8654 catalog_manager.cc:5697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:26.736182  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 86549.2us
I20260709 12:11:26.766077  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.723331 13083 raft_consensus.cc:2804] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.730902 12939 raft_consensus.cc:515] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.774695  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:26.775013  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:26.746505  8874 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.755561  8753 raft_consensus.cc:1240] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.759479  8751 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.731141 12681 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.730211 13050 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.757189  8756 rpcz_store.cc:276] 0709 12:11:25.376015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.479538 (+103523us) service_pool.cc:224] Handling call
0709 12:11:25.480182 (+   644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:25.481303 (+  1121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.481356 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:25.485193 (+  3837us) log.cc:844] Serialized 52 byte log entry
0709 12:11:25.811545 (+326352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:26.040000 (+228455us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.040753 (+   753us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.053122 (+ 12369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.053208 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.299336 (+246128us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b1800325660. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:26.557217 (+257881us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b240012beb8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34edc9c4 00007fce34edaacb 00007fce35095dc9 00007fce35095a55 00007fce3509509d 00007fce37cc710e 00007fce37cde88c 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221
0709 12:11:26.708816 (+151599us) raft_consensus.cc:1685] finished
0709 12:11:26.708837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.708968 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9718,"prepare.queue_time_us":361616,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":23609,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":7938,"spinlock_wait_cycles":40911360,"thread_start_us":438135,"threads_started":2,"wal-append.queue_time_us":358711}
I20260709 12:11:26.710575 12991 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.737993 12878 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.777174 13094 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.739259 13078 consensus_queue.cc:1059] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:11:26.778117 12983 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.797953  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.733681 13103 consensus_queue.cc:1059] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:26.754009 13067 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.790059 13081 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.834504 13026 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.838392  8654 catalog_manager.cc:5697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 2 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 6 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:26.843096 13103 raft_consensus.cc:3055] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.856671 13103 raft_consensus.cc:740] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:26.857666 13103 consensus_queue.cc:260] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.859182 13103 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.790288 13083 raft_consensus.cc:697] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:26.792084 13131 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:11:26.790381 12879 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.863521  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:26.830192  8874 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.855062  8758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:26.866070  8758 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.866565  8758 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.790326 13001 consensus_queue.cc:1059] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:11:26.872440  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 81089.8us
W20260709 12:11:26.877130  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47084.9us
I20260709 12:11:26.877445  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:26.853785  8903 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:26.887696  8833 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:26.869771 12822 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.889151  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.890522  8654 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 3 to 4, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 4 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
W20260709 12:11:26.895311  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 77785.1us
I20260709 12:11:26.861076 13083 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.853760 13026 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.913470  9525 raft_consensus.cc:3055] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.913970  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:26.913930  9525 raft_consensus.cc:740] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:26.917781  8834 raft_consensus.cc:1275] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:26.917992  9520 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:26.885628 13062 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.852835 13081 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.931612  8833 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:26.889842 13114 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.890128 12841 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:26.932924  9525 consensus_queue.cc:260] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:26.915621 13089 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:26.967936  8724 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:26.953308 13071 raft_consensus.cc:3055] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.963410 13067 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.963961 12745 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.942142 12839 leader_election.cc:290] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.964509 13059 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:26.988533  9525 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.978032 13058 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:26.997771 13092 raft_consensus.cc:3055] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:26.998452 13092 raft_consensus.cc:740] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:27.008467 12878 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.008997 13059 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:27.009187 12878 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:27.009565 13059 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.010213 12878 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.011905 13059 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.012735 13138 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:27.013522 13081 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:27.015610 13092 consensus_queue.cc:260] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.016902 13092 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.021638  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a342b86867884bfaa83a903e1502daaa" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:26.967523 12602 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.026921 12602 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.028901 13089 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:27.029579  8901 raft_consensus.cc:3060] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:27.034158  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 137334us
I20260709 12:11:27.043090  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:27.044147  8757 raft_consensus.cc:2368] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:27.046236  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.047150  8903 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:27.048844  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.049998  8900 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.049006  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.051682  8909 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:27.113472  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:27.118688  8907 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:27.131249  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.134094  8901 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:27.149868  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:27.153767  8906 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:27.154381  8906 pending_rounds.cc:85] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 7
I20260709 12:11:27.154647  8906 pending_rounds.cc:107] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:27.154927  8906 raft_consensus.cc:2889] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.159117  9525 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 12.
I20260709 12:11:26.983814 12991 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:26.981463 13071 raft_consensus.cc:740] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:27.020149 12933 consensus_queue.cc:1059] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:11:27.170835  8902 pending_rounds.cc:85] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Aborting all ops after (but not including) 7
I20260709 12:11:27.172122  8902 pending_rounds.cc:107] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:27.172565  8902 raft_consensus.cc:2889] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.196779  8829 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:27.197268  8829 pending_rounds.cc:85] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 7
I20260709 12:11:27.197532  8829 pending_rounds.cc:107] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:27.197781  8829 raft_consensus.cc:2889] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.199847  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:27.167879 12969 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.200495  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:27.201274  8833 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.205796  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:27.206683  8830 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:27.210853  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:27.200541  8829 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.212442  8830 raft_consensus.cc:2393] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 9: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:27.231267  8829 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 13.
I20260709 12:11:27.248003  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:27.251760  8833 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:27.193199 13059 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:11:27.261282  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 59519.2us
I20260709 12:11:27.267577  8725 leader_election.cc:304] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:27.289121  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:27.219817 12969 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.294816 13131 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.306700 12899 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:27.307113  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:27.308004 12839 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.308324  8725 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:27.308715 12839 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:27.309463 12839 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.309621  8725 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:27.325140  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.325896  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.309516 12899 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.326668  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.329284  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:27.236979 13116 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.335395  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.339172  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd6228ae6144924a1ddc7362f86742d" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.292512 12602 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:27.357849  8908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:27.360128 12899 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 13 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:27.361076 13153 log.cc:927] Time spent T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:27.361007  8904 raft_consensus.cc:2393] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:27.361128  8760 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:27.329696 12939 leader_election.cc:290] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.371459  8908 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:27.361441 12899 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:27.374455  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 208318us
I20260709 12:11:27.330376 12878 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.235278 13071 consensus_queue.cc:260] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.348209  8907 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.290760 12959 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.290457 13141 raft_consensus.cc:2749] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:27.324483 13010 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:27.349853  9521 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.350876 13058 raft_consensus.cc:3055] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.351696 13116 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:27.352419  8827 raft_consensus.cc:1240] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:27.352970 13147 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:11:27.355386 12786 consensus_meta.cc:287] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
I20260709 12:11:27.366246  8900 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.359062  8758 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.365978  8724 leader_election.cc:304] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:27.382174  8760 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:27.422210  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 56382.1us
W20260709 12:11:27.380970  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 331288us
I20260709 12:11:27.384872  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:27.386888  8753 raft_consensus.cc:1240] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:27.375123 13103 consensus_meta.cc:287] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.001s
I20260709 12:11:27.421470  8756 raft_consensus.cc:1240] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.428550  8799 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:27.401425 12878 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:27.397392 13131 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:27.430059  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 262124us
I20260709 12:11:27.453887  8872 leader_election.cc:400] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:27.418321 13058 raft_consensus.cc:740] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:27.454377  8872 leader_election.cc:403] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:27.415987 12959 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.460331  8799 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.460851  8758 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:27.461540  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:27.463567  8752 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.438714 13159 raft_consensus.cc:2749] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.472088  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:27.445959 12822 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:27.436456 12681 consensus_queue.cc:1048] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:27.483861  8872 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:27.441691 13079 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:11:27.470347 12745 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.475699 13138 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:27.479389 13050 consensus_queue.cc:1059] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:27.463960 13083 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:27.473259 13081 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:27.476414 13142 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.497270 13163 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.490396 13143 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.503757  8758 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:27.487479 12991 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957) with higher term. Message: Invalid argument: T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10.
I20260709 12:11:27.506153 12745 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.486231 12822 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.522631 12745 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.514431 13143 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:11:27.527572  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 127364us
I20260709 12:11:27.513639 13084 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:27.536741  8904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.537931  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:27.513986 13081 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:27.559664  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 139433us
I20260709 12:11:27.530675 13143 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.565403  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:27.563943  9525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:27.566015  9524 raft_consensus.cc:3055] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:27.566428  9524 raft_consensus.cc:740] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:27.530992 12969 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.519354 13138 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.510012 13058 consensus_queue.cc:260] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.511813 12878 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:27.574107 13160 log.cc:927] Time spent T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:27.574510 13026 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.579385 13138 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.569123  9524 consensus_queue.cc:260] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:27.581983  9524 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.584810  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.586323  8724 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:11:27.597927  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.596971 13169 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 12:11:27.598400 12977 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.600380 12977 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:27.601279 12977 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.616969 12977 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.618643 13081 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.598675 13054 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:27.619669 13054 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:27.620532 13054 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.623871  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.623986  8798 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:27.604167  8900 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 13.
I20260709 12:11:27.605104 12959 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:27.605302 13168 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:27.601645 12939 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:27.597136 13076 raft_consensus.cc:3055] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:27.634016 13076 raft_consensus.cc:740] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:27.635332 13076 consensus_queue.cc:260] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.609437  8832 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:27.609792 12822 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:27.598819  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 113320us
I20260709 12:11:27.629344  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.636934 13050 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:27.626020 12839 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:27.641098  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 197738us
I20260709 12:11:27.669853  8901 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:27.670353  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.670732  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.673537  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:27.677160  8826 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:27.677423  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.677903  8901 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:27.678894  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.679512  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.681154  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.674041  8751 raft_consensus.cc:1240] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.626017 13081 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.691712  8799 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.691598  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:27.695655  8834 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.701566  8799 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.661113 13076 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.708375  8759 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
W20260709 12:11:27.713311  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 64118.8us
I20260709 12:11:27.715559  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:27.716156  9520 raft_consensus.cc:606] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:27.716483  9520 raft_consensus.cc:614] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:27.719918  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.721587  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:27.722515  9520 raft_consensus.cc:606] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:27.726656  8835 raft_consensus.cc:1240] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.697856 12822 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.730633  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.733091  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.705951 13116 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.708384 13026 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.769984 12839 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.753207 12822 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.773213  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57327b790014487690d5754a4e058fae"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:27.773882  9520 raft_consensus.cc:606] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.774215  9520 raft_consensus.cc:614] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:27.774451 12822 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.723775 13138 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:27.777041  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.760486 12899 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:27.779302  9520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:27.783571 13181 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:27.788801 13171 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
W20260709 12:11:27.583420 13173 consensus_queue.cc:1175] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "005ae7a1e140481db6cc04faeb268d9c" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:27.813156 13148 log.cc:927] Time spent T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.526s	user 0.005s	sys 0.000s
W20260709 12:11:27.824520  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 104656us
I20260709 12:11:27.825356  8799 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.827085  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.827888  8902 raft_consensus.cc:2410] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:27.822825  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 136754us
W20260709 12:11:27.830053  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 71067.4us
I20260709 12:11:27.830361  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:27.831626  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:27.835274  8902 raft_consensus.cc:2393] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 10: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:27.809793 13055 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.835328 13181 raft_consensus.cc:2749] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.842633 12822 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.878685  8902 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.882040  8900 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.872494  9524 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:27.900899 12939 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:27.902544 13179 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:27.844847 13055 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.910523 13055 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.918285 13179 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:27.919329 13179 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.923419 13179 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:27.927474  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.937965  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:27.940071  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:27.941056  8902 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:27.943895  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:27.948942  8834 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:27.933362  8906 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:27.957762  8831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 878) took 1071 ms. Trace:
I20260709 12:11:27.958180  8831 rpcz_store.cc:276] 0709 12:11:26.886539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.887106 (+   567us) service_pool.cc:224] Handling call
0709 12:11:26.910811 (+ 23705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.942249 (+ 31438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.942283 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.945838 (+  3555us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.177594 (+231756us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.177646 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.579952 (+402306us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5400216bd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:27.580038 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.812179 (+232141us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:27.957558 (+145379us) raft_consensus.cc:1685] finished
0709 12:11:27.957579 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.957707 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17307,"raft.queue_time_us":733,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":2794,"spinlock_wait_cycles":131028480,"thread_start_us":226476,"threads_started":1,"wal-append.queue_time_us":282466}
I20260709 12:11:27.934720 13071 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.956895 12822 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.942050 12745 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:27.945781 13144 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:27.998095 12822 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.011355 12822 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.019289 13185 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.020032 13185 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.022981 13185 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.030241 12745 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.033864  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:28.034701  8902 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.036983  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:28.037678  8759 raft_consensus.cc:3060] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.045230  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.056736  8759 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:28.046397 13143 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.072875 12933 raft_consensus.cc:993] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:28.074520 12933 raft_consensus.cc:1081] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:28.076182  9521 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:28.084122  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.085282  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.087107  8908 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:28.088068 13143 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:28.098639 12822 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.052768 13185 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.100845 13185 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.104081  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.095443 13144 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:11:28.096403  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:28.119127 12822 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.124738 13141 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.125267 13141 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:28.125345  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:28.126284 13141 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.128010 13141 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:28.128789  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 49854.7us
I20260709 12:11:28.130209 13058 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.130466  8725 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:28.131510  8725 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:28.107926 12941 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.145017 12941 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.146843  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:28.147486  8906 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.110162  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:28.148393  8832 raft_consensus.cc:2368] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:28.112838 13116 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.132987  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 47162.1us
I20260709 12:11:28.133639  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:28.133888  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:28.136869  8902 raft_consensus.cc:2468] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:28.137580  8834 raft_consensus.cc:1240] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.139405 13159 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.140748 12883 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:28.110795  9487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.167219  8799 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:28.170511  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:28.187243 13150 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:28.194962  9488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.167411 13116 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:28.287719  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 120573us
W20260709 12:11:28.286332  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 68143.9us
I20260709 12:11:28.277426  8832 raft_consensus.cc:1240] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.307555  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:28.285672  8906 raft_consensus.cc:2468] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
W20260709 12:11:28.275096  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 80708.6us
I20260709 12:11:28.309666  8799 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:28.278092  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 97641.7us
W20260709 12:11:28.283324  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 149503us
I20260709 12:11:28.179729 12939 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.319533 12818 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.310683 13050 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.321175 13050 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.323726 13050 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.325484 12878 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.326145 12878 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.326682  8827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35550 (request call id 881) took 1291 ms. Trace:
I20260709 12:11:28.329988  8827 rpcz_store.cc:276] 0709 12:11:27.035531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.043649 (+  8118us) service_pool.cc:224] Handling call
0709 12:11:27.071605 (+ 27956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.419023 (+347418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.326393 (+907370us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400389ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:11:28.326611 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645359488}
I20260709 12:11:28.181878 12602 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:11:28.311800  8751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:28.341529  8751 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:28.342068  8751 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.344611  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.345388  8900 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:28.314417  8906 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.379876  8725 leader_election.cc:400] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:28.380275  8725 leader_election.cc:403] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.346311  8799 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:28.304230 12883 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:28.381047  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 264153us
I20260709 12:11:28.306484 13143 raft_consensus.cc:2804] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:28.390133  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.397696  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52265.1us
I20260709 12:11:28.353626 12941 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.374733 13114 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.373927 13184 raft_consensus.cc:2804] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:28.353888 13142 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.377117 13039 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:28.392803 12878 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.319466 12939 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.420532  8751 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.425736  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.403697 13081 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:28.428330  8900 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:28.379555 13131 consensus_queue.cc:1059] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:28.388270 13159 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:28.432682  8751 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:28.436582  9520 raft_consensus.cc:606] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:28.440714  9520 raft_consensus.cc:614] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:28.440232  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 62574.9us
I20260709 12:11:28.428365 12899 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:28.426741 13185 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.459839  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
W20260709 12:11:28.465654  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55049.9us
I20260709 12:11:28.431864 13081 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.467878  8874 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:28.431529 13184 raft_consensus.cc:697] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:28.414695 13114 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.468984  9525 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:28.427438 13039 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.477048 13081 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.488453 12939 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:28.489939 13196 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:11:28.550925  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 61471.3us
I20260709 12:11:28.515631 13200 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.539119 13081 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.507534 13159 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:28.582772  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 179580us
I20260709 12:11:28.591743  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:28.586418  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.588416  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.593416  8751 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:28.593434  8754 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:28.596814 12818 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:28.597095 13201 log.cc:927] Time spent T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:11:28.597409 12818 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.591256 13219 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.599824 13219 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:28.601228 13207 log.cc:927] Time spent T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:28.566277 13143 raft_consensus.cc:697] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
W20260709 12:11:28.611346 13192 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 12:11:28.615077 13039 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:28.616676 12969 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.576718 13116 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.782389 12969 raft_consensus.cc:493] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.783071 12969 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.592607 13184 consensus_queue.cc:237] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.785363  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.786043  8758 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:28.630640  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:28.642405  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 47164.6us
I20260709 12:11:28.768828 12950 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:28.787122  8909 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:28.787418 12950 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.794970  8756 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:28.769191 12841 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.798162 12841 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:28.800968 13206 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:11:28.769771 13114 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:28.770843  8905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38210 (request call id 2168) took 1091 ms. Trace:
W20260709 12:11:28.771255 13169 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.125s	user 0.002s	sys 0.003s
I20260709 12:11:28.802858  8905 rpcz_store.cc:276] 0709 12:11:27.679424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.680321 (+   897us) service_pool.cc:224] Handling call
0709 12:11:27.680650 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.698152 (+ 17502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.698186 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.698711 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.927944 (+229233us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180043d3e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:11:28.043067 (+115123us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.043112 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.043183 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.610639 (+567456us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:28.770630 (+159991us) raft_consensus.cc:1685] finished
0709 12:11:28.770649 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.770765 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6387,"raft.queue_time_us":626,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6123,"spinlock_wait_cycles":13605504,"thread_start_us":114934,"threads_started":1,"wal-append.queue_time_us":602266}
I20260709 12:11:28.770664 13143 consensus_queue.cc:237] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:28.772040  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 94734.8us
I20260709 12:11:28.818928  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:28.820344 13083 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.820845 13083 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.821270 13083 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.821995 12841 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.822939 12950 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.825525  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:28.827466 13116 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.828110 13116 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.830247 13116 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.830740 13116 raft_consensus.cc:493] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.831193 13116 raft_consensus.cc:515] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.831559  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.832161  8833 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:28.833316 13116 leader_election.cc:290] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.833835 13116 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:28.834447  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.834546 13116 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.835180  8830 raft_consensus.cc:2368] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:28.835966  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:28.836509 13116 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.830703 12818 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.776199 13081 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:28.777933  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 219675us
I20260709 12:11:28.849617  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:28.850240  8755 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:28.780160 13141 consensus_meta.cc:287] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.007s
W20260709 12:11:28.780815 13220 log.cc:927] Time spent T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.140s	user 0.000s	sys 0.006s
I20260709 12:11:28.767874 13222 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:28.831911 12969 raft_consensus.cc:515] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.838578 13083 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.836506  8834 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.841712  9525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35706 (request call id 795) took 1278 ms. Trace:
I20260709 12:11:28.859717  9525 rpcz_store.cc:276] 0709 12:11:27.563472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.563687 (+   215us) service_pool.cc:224] Handling call
0709 12:11:28.841545 (+1277858us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400528fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:28.841657 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011760000}
I20260709 12:11:28.843618  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.845152  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.845510  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.848918  9524 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:28.851719  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.853374  8831 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:28.844977 12879 raft_consensus.cc:3055] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:28.865768 12879 raft_consensus.cc:740] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:28.866690 12879 consensus_queue.cc:260] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.867440 13083 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.867755 12879 raft_consensus.cc:3060] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.868502  8751 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:28.869616  9518 raft_consensus.cc:2368] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:28.870658 12969 leader_election.cc:290] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.872133  8830 raft_consensus.cc:2368] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 11. Current term is 12.
I20260709 12:11:28.873018 13222 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:28.879092  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.879403  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:28.879873  8906 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 8.
I20260709 12:11:28.880152  8905 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.879122  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.882429  8834 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:28.882925 13073 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.883514 13073 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:28.883723  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.884814 12681 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.885349 12681 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:28.885711  8875 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ce14b8d8c8a43d48b1570f033c4e64f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:28.887514 12681 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:28.893708  9521 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:28.894953  8905 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:28.863904  8758 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:28.902312  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:28.903280  8758 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.899978  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:28.772383 13219 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:28.922338  8905 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:28.923076 13073 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:28.929152 13222 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:28.932355  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.933421  8907 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:28.935237  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:28.935925  8907 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 10.
I20260709 12:11:28.937422  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:28.941915  8724 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:28.945849 12818 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:28.948395  9488 leader_election.cc:304] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:28.962698  8831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:28.963454  8831 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:28.980731 13216 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.981564 13216 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.982055 13216 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.987506  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:28.963956 13058 raft_consensus.cc:2804] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.989178 13058 raft_consensus.cc:697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:28.990106 13058 consensus_queue.cc:237] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.002302  8753 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.998659  9520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36564 (request call id 25) took 1219 ms. Trace:
I20260709 12:11:29.003822  9520 rpcz_store.cc:276] 0709 12:11:27.779026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.779175 (+   149us) service_pool.cc:224] Handling call
0709 12:11:28.998448 (+1219273us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400528fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3813d853 00007fce3d10b60a 00007fce366917d4 00007fce36691762 00007fce36691691 00007fce3669160c 00007fce366908c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:28.998571 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510198144}
I20260709 12:11:29.013212  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.014300 13161 consensus_queue.cc:1059] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 12:11:29.035740  8874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.039837  8801 leader_election.cc:400] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.041188  8801 leader_election.cc:403] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.041828  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.043087  8830 raft_consensus.cc:2393] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 12: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:29.044482  9487 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:29.045691  8830 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:29.051334  8755 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:29.056203  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:29.060375  8798 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.052227 13180 raft_consensus.cc:2764] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:29.079331  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:29.083091  9521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:29.065845 13173 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.083926  9521 raft_consensus.cc:606] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:29.059235 13210 raft_consensus.cc:3060] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.066411 13143 raft_consensus.cc:2804] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.039426 13078 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:29.088798  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:29.096547  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.104041  8903 raft_consensus.cc:2368] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.097220  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.105052  8907 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:29.098407  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.098445  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a516db16ef4c1bae0d02a9c8d29be4" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.106504  8902 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:29.107558  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.113977  9516 raft_consensus.cc:3055] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:29.114434  9516 raft_consensus.cc:740] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:29.085116 12878 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.122249  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.128194  8830 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 9.
I20260709 12:11:29.129498  8758 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:29.128463  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e3054fb6044180b7de9b761b2ea05b" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.130978  8900 raft_consensus.cc:3060] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.130810  8798 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.119303  9516 consensus_queue.cc:260] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.137176  9516 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.138614 12745 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:29.150820  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:29.152463 13232 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:29.090652 12786 consensus_queue.cc:1059] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:29.120564 13143 raft_consensus.cc:697] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:29.150671 12745 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.090934 13077 consensus_queue.cc:1059] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:29.174047  8827 raft_consensus.cc:1240] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Rejecting Update request from peer 005ae7a1e140481db6cc04faeb268d9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.135357 12878 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.133813 12839 raft_consensus.cc:2764] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:29.141932 13084 raft_consensus.cc:2804] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.180114  8826 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:11:29.192715  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:29.187649  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 44450.8us
I20260709 12:11:29.199836 12786 raft_consensus.cc:3055] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.205088  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.205763 12786 raft_consensus.cc:740] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:29.204869  8900 raft_consensus.cc:2468] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:29.206750 12786 consensus_queue.cc:260] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.207146  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.208304  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.209035  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:29.216840  8725 leader_election.cc:400] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 8. Current term is 9.
I20260709 12:11:29.177897 13184 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:29.217038  8832 raft_consensus.cc:1240] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:29.218473  8725 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.179941 12878 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.221815  8725 leader_election.cc:400] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 11. Current term is 12.
I20260709 12:11:29.231937  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.220217 13143 consensus_queue.cc:237] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.243371  8832 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:29.244315 13005 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:29.244778 13005 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:29.245802  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.245673 13005 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.246111  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.246762  8905 raft_consensus.cc:3060] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.246954 13005 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.248010  9516 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 9.
I20260709 12:11:29.214211 13045 raft_consensus.cc:3055] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.250366  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:29.248603 13161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:29.214658 13039 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:29.203109 13084 raft_consensus.cc:697] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:29.266351  8907 raft_consensus.cc:2393] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:29.270896  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.271799  8760 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:29.272786  8905 raft_consensus.cc:2468] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:29.272987  8831 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:29.223017 13205 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.272941  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.277921 13205 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:29.226564 13063 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.224589 13131 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:11:29.252362 13045 raft_consensus.cc:740] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:29.229606 12745 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:29.285768 13230 log.cc:927] Time spent T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 12:11:29.292538  9522 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:29.337622  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 83096.1us
W20260709 12:11:29.294459 13239 log.cc:927] Time spent T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 12:11:29.294780  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:29.339959  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 51353.8us
I20260709 12:11:29.240716 13184 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.305922  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:29.331174 13205 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.308231 13178 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:29.309450 13116 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.281013 13039 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:29.321398  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.351593  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.306556 13084 consensus_queue.cc:237] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.347532  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.354010  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.337181 13063 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:29.359200  8760 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:29.346205 13078 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.350346 13212 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:29.348212 13116 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:29.365551  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:29.365975 13145 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.381851 13116 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.392015 13077 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.376531 13078 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.385933 13145 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.409931  8760 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:29.410308  8760 pending_rounds.cc:85] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Aborting all ops after (but not including) 6
I20260709 12:11:29.410552  8760 pending_rounds.cc:107] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:29.410763  8760 raft_consensus.cc:2889] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.400377 13078 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.417752 12822 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:29.412773 13145 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.382629 13045 consensus_queue.cc:260] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.409689 13063 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.434005 13039 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:29.437932 13184 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:29.443886 13248 ts_tablet_manager.cc:933] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.445845 13058 raft_consensus.cc:993] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:29.445976 13045 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.446657 13145 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:29.448468  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 154981us
I20260709 12:11:29.458971  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:29.459933 13224 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.446621 13058 raft_consensus.cc:1081] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:29.449927 13216 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.475241  9524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35706 (request call id 799) took 1021 ms. Trace:
I20260709 12:11:29.475769  9524 rpcz_store.cc:276] 0709 12:11:28.454084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.454555 (+   471us) service_pool.cc:224] Handling call
0709 12:11:28.842104 (+387549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.863049 (+ 20945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.475003 (+611954us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400528fd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:11:29.475160 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890358656}
I20260709 12:11:29.474694 13224 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:29.481395 13216 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.486081 13145 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:29.488126  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:29.492538  8799 leader_election.cc:400] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.495819  8799 leader_election.cc:304] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:29.496413  8758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:29.497071  8799 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:29.497089  8758 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:29.497983  8758 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.500593  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:29.502645  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.503734  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.504367  8902 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:29.503978  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.505962  8900 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.489099 13172 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.506353 13143 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.513732 13143 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:29.513495 13203 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:29.514314 13143 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.512825  8758 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.513734 13083 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:29.517135  8758 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:29.506533 13179 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:11:29.503744  8907 raft_consensus.cc:1275] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:29.507093 13184 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.499553 13081 raft_consensus.cc:2749] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.500782 13212 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.521731 13212 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.522130 13212 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.522186  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:29.522898  9524 raft_consensus.cc:3055] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:29.523181  9524 raft_consensus.cc:740] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:29.523917  9524 consensus_queue.cc:260] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.525025  9524 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.528775 13172 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.536370 13172 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:29.526932  8900 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:29.539580  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.540400  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.541077  8753 raft_consensus.cc:3060] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.542723 13116 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.545603 13116 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.548158  8753 raft_consensus.cc:2468] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
W20260709 12:11:29.550284  8901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.117s	sys 0.177s
W20260709 12:11:29.550727  8901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.117s	sys 0.177s
I20260709 12:11:29.550351  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.553013 13078 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.554895 13205 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.556918  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:29.563357  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.566807  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:29.571024  8798 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.580127  9524 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:29.580794  8751 raft_consensus.cc:1240] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer 61fbd5afaa194845917d5b1b04571378 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:29.584837  8754 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:29.586699  8726 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:29.586810  8798 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:29.587600 12839 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:29.588449 12839 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:29.587726 12745 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.589670 12839 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.591872  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.592161 12745 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:29.593287 12745 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.583701 13039 consensus_queue.cc:1048] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:29.581697 13184 raft_consensus.cc:2804] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:29.602234 13143 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.576511 13222 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:29.616218 13039 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:29.619278 13039 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.619877 13084 raft_consensus.cc:493] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:29.620553 13084 raft_consensus.cc:515] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:29.625944 13039 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:29.632170 13210 consensus_meta.cc:287] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 12:11:29.632794 13210 raft_consensus.cc:2749] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.633584 12878 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.633627  8828 raft_consensus.cc:2468] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:29.643512 13212 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.617324 13184 raft_consensus.cc:697] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:29.645716  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:29.646770 13212 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:29.647334  8801 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:29.647636 13248 tablet_copy_client.cc:323] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.131:39537
I20260709 12:11:29.648188 13222 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.647080  8907 raft_consensus.cc:2368] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:29.648998  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.650883 13143 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.645377 13184 consensus_queue.cc:237] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.654362  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.663595  8755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.664474  8755 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.668740  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:29.669569  8754 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.658459  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:29.658993  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.671295  8906 raft_consensus.cc:2368] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
W20260709 12:11:29.637180 13226 log.cc:927] Time spent T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.427s	user 0.004s	sys 0.000s
I20260709 12:11:29.672484  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:29.680409  8754 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:29.685130  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:29.691464  8755 raft_consensus.cc:2468] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:29.693251  8872 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:29.693883  8756 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:29.700547  8906 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:29.661489 13078 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:29.694809 13001 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.719533 13001 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:29.721009 13001 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.344043  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:29.717543 12878 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.725052  8901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38194 (request call id 2584) took 1566 ms. Trace:
I20260709 12:11:29.725580  8901 rpcz_store.cc:276] 0709 12:11:28.158317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.158621 (+   304us) service_pool.cc:224] Handling call
0709 12:11:28.159063 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.167968 (+  8905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.168007 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.616783 (+448776us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b2c000a6578. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:11:28.617264 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.551091 (+933827us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.551133 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.551226 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.636547 (+ 85321us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:11:29.724806 (+ 88259us) raft_consensus.cc:1685] finished
0709 12:11:29.724832 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.724968 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8396,"raft.queue_time_us":20592,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":47061,"spinlock_wait_cycles":14652416,"thread_start_us":933487,"threads_started":1,"wal-append.queue_time_us":566574}
I20260709 12:11:29.728987 13225 raft_consensus.cc:2804] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.729635 13225 raft_consensus.cc:697] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:29.730631 13225 consensus_queue.cc:237] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.683844 13212 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:29.732933 13212 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:29.734603  8799 leader_election.cc:400] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.734980  8799 leader_election.cc:403] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.735391 13212 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:29.739751 13251 log.cc:927] Time spent T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:11:29.730639 13145 consensus_queue.cc:1059] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:29.742504 13145 raft_consensus.cc:3055] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.742851 13145 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:29.692776 13143 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:29.743712 13145 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:29.747936  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.749063 13145 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.757472 13205 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:29.774082  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:29.780397  8799 leader_election.cc:400] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:29.768663 13222 raft_consensus.cc:3060] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.785931  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.791430  8907 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:29.791769  8829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.792325  8829 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.793105  8756 raft_consensus.cc:1275] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:29.793623  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.797281  8919 tablet_copy_service.cc:140] P 61fbd5afaa194845917d5b1b04571378: Received BeginTabletCopySession request for tablet 4ce14b8d8c8a43d48b1570f033c4e64f from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:40132)
I20260709 12:11:29.797935  8919 tablet_copy_service.cc:161] P 61fbd5afaa194845917d5b1b04571378: Beginning new tablet copy session on tablet 4ce14b8d8c8a43d48b1570f033c4e64f from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:40132: session id = eaa6fbd6102948888c362ff1ea0b32e8-4ce14b8d8c8a43d48b1570f033c4e64f
I20260709 12:11:29.799590 13081 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:29.807685 13081 consensus_queue.cc:1048] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:29.813691  8829 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:29.817651  8835 raft_consensus.cc:1275] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:29.833545  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.834271  8827 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.748452 12786 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.839573  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.845082  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.846001  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:29.847931  8756 raft_consensus.cc:1275] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:29.851157  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.856570  8902 raft_consensus.cc:2393] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c in current term 11: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:29.856770  8657 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.859277  8657 catalog_manager.cc:5697] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:29.861419  8654 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 221) took 45634 ms (client timeout 15000 ms). Trace:
I20260709 12:11:29.871824  8657 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.861286  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:29.879801  8827 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 6.
I20260709 12:11:29.883273  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:29.874991  8657 catalog_manager.cc:5697] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 8 to 10, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:29.900319  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ff6a40f13a4be9b4a05ca797f8fd52" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:29.903996  8801 leader_election.cc:304] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:29.894060  8657 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 9 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.905841  8657 catalog_manager.cc:5697] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 7 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.915860  8657 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.918579  8657 catalog_manager.cc:5697] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 8, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.921154  8657 catalog_manager.cc:5697] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:29.861915  8654 rpcz_store.cc:269] 0709 12:10:44.232880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.236279 (+  3399us) service_pool.cc:224] Handling call
0709 12:11:29.861309 (+45625030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:27.356163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:27.356815 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:27.356874 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:11:27.356892 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:27.357742 (+   850us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:27.357870 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:27.357903 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:11:27.358507 (+   604us) tablet.cc:701] Row locks acquired
0709 12:11:27.358562 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:11:27.358774 (+   212us) write_op.cc:270] Start()
0709 12:11:27.358934 (+   160us) write_op.cc:276] Timestamp: P: 1783599087358680 usec, L: 0
0709 12:11:27.358957 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:27.359712 (+   755us) log.cc:844] Serialized 2478 byte log entry
0709 12:11:27.862168 (+502456us) op_driver.cc:464] REPLICATION: finished
0709 12:11:27.958642 (+ 96474us) write_op.cc:301] APPLY: starting
0709 12:11:27.958779 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:28.193149 (+234370us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:28.193276 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:28.597715 (+404439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:28.597991 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:11:28.598039 (+    48us) write_op.cc:312] APPLY: finished
0709 12:11:28.598432 (+   393us) log.cc:844] Serialized 65 byte log entry
0709 12:11:28.598642 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.598793 (+   151us) write_op.cc:454] Released schema lock
0709 12:11:28.598855 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:28.599318 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.599345 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13288,"reported_tablets":49,"spinlock_wait_cycles":345856,"child_traces":[["op",{"apply.queue_time_us":96082,"apply.run_cpu_time_us":19923,"apply.run_wall_time_us":640671,"cfile_cache_hit":22,"cfile_cache_hit_bytes":23001,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":74579,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":6,"prepare.queue_time_us":341540,"prepare.run_cpu_time_us":28209,"prepare.run_wall_time_us":137751,"raft.queue_time_us":217704,"raft.run_cpu_time_us":19581,"raft.run_wall_time_us":119497,"replication_time_us":479577,"thread_start_us":508608,"threads_started":4,"wal-append.queue_time_us":155499,"wal-append.run_cpu_time_us":54843,"wal-append.run_wall_time_us":2284859}]]}
I20260709 12:11:29.908663 13116 raft_consensus.cc:2749] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:29.934999  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.898772 13084 leader_election.cc:290] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:29.946163  8902 raft_consensus.cc:2410] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:29.954277  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:29.893149 13245 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:29.934451  8657 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:29.944375 13222 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 10. Current term is 11.
I20260709 12:11:29.979501  8657 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 8 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 9 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:29.988217  8833 raft_consensus.cc:2468] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:29.990091  8657 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.996846  8657 catalog_manager.cc:5697] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.980613 13216 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.983084 13065 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.999816  8657 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 4 to 8, term changed from 7 to 9, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:30.019017  8919 tablet_copy_source_session.cc:215] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:30.005051 13173 consensus_queue.cc:1048] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:30.023005  8657 catalog_manager.cc:5697] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.025672  8657 catalog_manager.cc:5697] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.027611  8657 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.035545  8907 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:30.035681  8901 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:30.035000  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 134552us
I20260709 12:11:30.010519 13216 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.044466 13084 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:30.031356  8657 catalog_manager.cc:5697] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 7 to 9, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 9 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.052835  8657 catalog_manager.cc:5697] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 8, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:30.057603  8657 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:30.065099  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.079708  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:30.087641  9518 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:30.092463 13267 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.097086  9516 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:30.109406  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:30.110544  9522 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:30.115105  8801 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:30.096487 12879 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:30.131889  8827 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:30.131956 13081 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.134913 13081 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:30.135267 13261 log.cc:927] Time spent T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.228s	user 0.004s	sys 0.000s
I20260709 12:11:30.135349 13081 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.136750 13264 log.cc:927] Time spent T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:11:30.101756 13216 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:30.147320  8905 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:30.165678 13248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce14b8d8c8a43d48b1570f033c4e64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:30.174052 13116 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:30.174921 13116 consensus_queue.cc:1243] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer 61fbd5afaa194845917d5b1b04571378 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:30.185559  8751 raft_consensus.cc:1240] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.185712  8874 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:30.189879  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:30.176599 13116 raft_consensus.cc:3055] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.213039  8751 raft_consensus.cc:1275] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:30.218972  8832 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:30.201028 13268 raft_consensus.cc:2804] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.183542 13145 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:30.222092 13116 raft_consensus.cc:740] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:30.187405 13179 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:30.195173 13039 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:30.228276 13184 consensus_queue.cc:1048] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:30.255218 13268 raft_consensus.cc:697] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
W20260709 12:11:30.295369  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 65372.5us
W20260709 12:11:30.294420  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53397.9us
I20260709 12:11:30.299667  8751 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:30.310535  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:30.308244 13081 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.324322 13145 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:30.327517  8751 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:30.329169 13269 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:11:30.329061 13268 consensus_queue.cc:237] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:30.329667 13071 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:30.334709  8725 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:30.336884 12878 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:30.388840  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 91733.4us
I20260709 12:11:30.337108 13081 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:30.385887 13270 log.cc:927] Time spent T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:30.381232 13275 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.339010 13116 consensus_queue.cc:260] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:30.428382  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 92463.6us
W20260709 12:11:30.461252 13274 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:30.434016 13222 consensus_queue.cc:1059] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:30.502943  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 101247us
I20260709 12:11:30.513109  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:30.513852  9522 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.545595  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 58577us
I20260709 12:11:30.491861 13284 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:30.515892 12745 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.557785 12745 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.560735 13143 consensus_queue.cc:1048] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:30.511842 12822 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.565240 12822 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.569123 12745 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:30.570024 12822 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:30.583221  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:30.589908  9516 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:30.587344  9522 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:30.592794 13058 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.593499 13058 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.602289 13058 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:30.604748  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:30.604853  8801 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:30.605644  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:30.610611  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:30.616143  8827 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:30.611581  8828 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:30.621269  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
W20260709 12:11:30.623395  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.623600  8758 raft_consensus.cc:1275] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:30.634279  8798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.637494  8801 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:30.639322  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:30.619153 13282 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.625528 13289 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:30.637652 12822 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.638450 13203 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:30.653333 13161 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.655216 13116 raft_consensus.cc:3060] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.642815 13216 raft_consensus.cc:2804] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.635767 13081 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:30.669787 13081 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.671325 13216 raft_consensus.cc:697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:30.664373 13161 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.673058 13161 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.651222 13282 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:30.679315 13282 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:30.682626  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:30.741662  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 253144us
I20260709 12:11:30.672456 13216 consensus_queue.cc:237] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:30.744467 13294 log.cc:927] Time spent T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:11:30.749483  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:30.750759  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 167128us
I20260709 12:11:30.663954 13289 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.772912  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:30.773445 13289 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:30.773659  8901 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 13.
I20260709 12:11:30.774248  8751 raft_consensus.cc:3060] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.790235  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:30.791085  9522 raft_consensus.cc:2368] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:30.792230 12822 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.792881 12822 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.795094 13161 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.813091  8828 raft_consensus.cc:1275] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:30.813593  8828 pending_rounds.cc:85] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Aborting all ops after (but not including) 6
I20260709 12:11:30.813841  8828 pending_rounds.cc:107] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:30.814090  8828 raft_consensus.cc:2889] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:30.827216  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 196953us
W20260709 12:11:30.827453  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 143598us
I20260709 12:11:30.833053  8726 leader_election.cc:400] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:30.847134  8726 leader_election.cc:403] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:30.852656  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:30.853309 13071 consensus_queue.cc:1048] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:30.865942  8751 raft_consensus.cc:2468] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:30.869020  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479206f1d4545ec83633cfa7a99b648" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:30.869094  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:30.879478  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:30.868573 13282 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ae7a1e140481db6cc04faeb268d9c for earlier term 10. Current term is 11.
I20260709 12:11:30.886411 13084 consensus_queue.cc:1048] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:30.901126 13280 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.901590 13280 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:30.901942 13280 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:30.907641 13296 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:11:30.911494 13248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35686 (request call id 801) took 1543 ms. Trace:
I20260709 12:11:30.912285 13248 rpcz_store.cc:276] 0709 12:11:29.329946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.330100 (+   154us) service_pool.cc:224] Handling call
0709 12:11:29.444490 (+114390us) ts_tablet_manager.cc:934] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
0709 12:11:30.163710 (+719220us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:30.614272 (+450562us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:30.624978 (+ 10706us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:30.738077 (+113099us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:30.770486 (+ 32409us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:30.858620 (+ 88134us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:30.866636 (+  8016us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":73387,"tablet-copy.queue_time_us":89621,"thread_start_us":160282,"threads_started":2}
I20260709 12:11:30.915853 13248 tablet_copy_client.cc:806] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:30.916824 13248 tablet_copy_client.cc:670] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:30.920324 13081 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:30.922684 12822 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:30.924976  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:30.926702 13161 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:30.943871  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53561.4us
I20260709 12:11:30.948510  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:30.958537  9518 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:30.959091  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:30.968768 13248 tablet_copy_client.cc:538] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:30.982384  8827 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 12: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:30.989499  8754 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:30.993616  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:30.993690  8725 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:31.014308  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.026314  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:31.030155 13224 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:31.045615 13046 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:31.068849  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 75245.2us
I20260709 12:11:31.052608 12841 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:31.093328 13302 log.cc:927] Time spent T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 12:11:31.109874 12822 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:31.113652 13268 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.114315 13268 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:31.115749  9522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a04653cca743d0966d20df2225c35d"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:31.116406  9522 raft_consensus.cc:606] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:31.114745  8827 raft_consensus.cc:1275] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:31.112207  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:31.122915  9524 raft_consensus.cc:2393] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 12: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:31.123714 13280 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.129977 13225 consensus_queue.cc:1048] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.132243  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:31.134075  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:31.134287  8754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:31.134898  8754 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
W20260709 12:11:31.136282 13300 log.cc:927] Time spent T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:11:31.138011  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:31.144686 13084 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.140807  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:31.157482 13268 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:31.167987 13225 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.192703  9518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:31.193701  9518 raft_consensus.cc:606] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:31.183969 13225 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.187505 13116 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.202174 13225 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.240046 13280 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:31.240244  9524 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.241350 13248 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:11:31.241547  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:31.246243 13084 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:31.246465  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:31.247397  9524 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:31.253646  8903 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 13.
I20260709 12:11:31.255215  8799 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:31.269601 13280 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.293169 13280 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:31.294430 13280 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.295706 13225 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:31.307438 13079 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:31.310155 13079 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.325026 13084 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:31.337754  9518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:31.338992  9518 raft_consensus.cc:606] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:31.339555  9518 raft_consensus.cc:614] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:31.348227 13079 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:31.358793  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:31.360220  9518 raft_consensus.cc:2368] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12.
I20260709 12:11:31.361572  8875 leader_election.cc:400] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12.
I20260709 12:11:31.361914  8875 leader_election.cc:403] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:31.333280 13084 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:31.384742  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:31.385962  8759 raft_consensus.cc:2393] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 11: Already voted for candidate 005ae7a1e140481db6cc04faeb268d9c in this term.
I20260709 12:11:31.389827  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:31.391023  8907 raft_consensus.cc:2368] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:31.393052  8799 leader_election.cc:400] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:31.393525  8799 leader_election.cc:403] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:31.401860 12822 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.408793  8759 raft_consensus.cc:1275] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.394588 13078 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.437229  8907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:31.438019  8907 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:31.401453 13084 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:31.453191  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 179890us
I20260709 12:11:31.447631 13240 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.427269 13210 consensus_queue.cc:1048] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:31.466245  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:31.467859  8827 raft_consensus.cc:2368] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12.
I20260709 12:11:31.484797  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:31.485610  8751 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.507051 13077 raft_consensus.cc:993] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:31.507704 13077 raft_consensus.cc:1081] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:31.514822  8903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e45c621a9c684915a4c110e0801e4efa"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:31.515513  8903 raft_consensus.cc:606] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:31.470290 13240 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.515910  8903 raft_consensus.cc:614] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:31.541945  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a04653cca743d0966d20df2225c35d"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:35550
I20260709 12:11:31.542686  8827 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.543067  8827 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.548465  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:31.577747  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:31.579097  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:31.584573  8751 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:31.583604  8827 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.565477 13225 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:31.596405  8872 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378; no voters: 
I20260709 12:11:31.606217  8827 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:31.609344  8874 leader_election.cc:400] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12.
I20260709 12:11:31.617355 12822 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537) with higher term. Message: Invalid argument: T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 for earlier term 11. Current term is 12.
I20260709 12:11:31.626245  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:31.627022  9518 raft_consensus.cc:3055] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.627388  9518 raft_consensus.cc:740] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:31.634706  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:31.635406  8903 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.659524  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:31.656750  9518 consensus_queue.cc:260] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.657526 13225 raft_consensus.cc:2804] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.681691  9518 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.687021  8903 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:31.695214  8830 raft_consensus.cc:2468] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:31.689033  8799 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:31.682747 13225 raft_consensus.cc:697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:31.703403 13222 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:31.725754 13222 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:31.727044 13222 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:31.699333 13240 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:31.748220 13225 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:31.759994 13078 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899) with higher term. Message: Invalid argument: T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 11. Current term is 12.
I20260709 12:11:31.579928  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.782044  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:31.782893  8906 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:31.805203  9518 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:31.852530  9524 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:31.854827  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:11:31.858860 13172 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.859465 13172 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.859884 13172 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.908286  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 150) took 8278 ms. Trace:
I20260709 12:11:31.909021  8657 rpcz_store.cc:276] 0709 12:11:23.704126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.704982 (+   856us) service_pool.cc:224] Handling call
0709 12:11:31.889003 (+8184021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:30.298221 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:30.388594 (+ 90373us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:30.397758 (+  9164us) write_op.cc:435] Acquired schema lock
0709 12:11:30.403599 (+  5841us) tablet.cc:662] Decoding operations
0709 12:11:30.557138 (+153539us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:30.557224 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:30.557258 (+    34us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:11:30.558921 (+  1663us) tablet.cc:701] Row locks acquired
0709 12:11:30.558945 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:11:30.559161 (+   216us) write_op.cc:270] Start()
0709 12:11:30.559305 (+   144us) write_op.cc:276] Timestamp: P: 1783599090559090 usec, L: 0
0709 12:11:30.562580 (+  3275us) op_driver.cc:348] REPLICATION: starting
0709 12:11:30.563456 (+   876us) log.cc:844] Serialized 7873 byte log entry
0709 12:11:30.799979 (+236523us) op_driver.cc:464] REPLICATION: finished
0709 12:11:31.102186 (+302207us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b18000842e0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350563f3 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:11:31.102437 (+   251us) write_op.cc:301] APPLY: starting
0709 12:11:31.102537 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:31.221140 (+118603us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:31.221166 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:31.505106 (+283940us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:31.505442 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:11:31.505495 (+    53us) write_op.cc:312] APPLY: finished
0709 12:11:31.506015 (+   520us) log.cc:844] Serialized 180 byte log entry
0709 12:11:31.506208 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.506430 (+   222us) write_op.cc:454] Released schema lock
0709 12:11:31.506504 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:31.506983 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.507013 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123775,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":205076,"apply.run_cpu_time_us":27916,"apply.run_wall_time_us":404495,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":154907,"prepare.run_cpu_time_us":47511,"prepare.run_wall_time_us":378918,"raft.queue_time_us":70148,"raft.run_cpu_time_us":27400,"raft.run_wall_time_us":204045,"replication_time_us":228833,"spinlock_wait_cycles":21344512,"thread_start_us":387972,"threads_started":4,"wal-append.queue_time_us":153192}]]}
I20260709 12:11:31.955336 13045 raft_consensus.cc:993] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:31.955986 13045 raft_consensus.cc:1081] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:31.920931 13280 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:11:31.976672  8756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:38804
I20260709 12:11:31.977485  8756 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.977962  8756 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.986550  8906 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:31.990195 13280 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:32.000895  8756 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.004163 13172 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.009797  8756 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:32.018213  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:32.020741 13172 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:32.025177  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:32.036247 13248 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:11:32.037744 13248 tablet_bootstrap.cc:492] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:11:32.038784 13248 ts_tablet_manager.cc:1403] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.798s	user 0.074s	sys 0.048s
I20260709 12:11:32.042821 13248 raft_consensus.cc:359] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:32.108680  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:32.110497  8830 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.142179  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:32.146582  9518 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:32.157491 13071 raft_consensus.cc:993] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:32.170783 13173 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.194007  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:32.195096  9524 raft_consensus.cc:3055] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.195477  9524 raft_consensus.cc:740] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:32.204808 13248 raft_consensus.cc:740] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:11:32.228082 13314 raft_consensus.cc:1081] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Signalling peer 005ae7a1e140481db6cc04faeb268d9c to start an election
I20260709 12:11:32.235631 13084 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:11:32.250283  8902 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:32.259299  8754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:43822
I20260709 12:11:32.260217  8754 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:32.260747  8754 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.268348  8759 raft_consensus.cc:1240] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Rejecting Update request from peer eaa6fbd6102948888c362ff1ea0b32e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.233213  8830 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:32.283872  8835 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:32.206123 13248 consensus_queue.cc:260] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:32.290071  9524 consensus_queue.cc:260] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.302556 13222 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:32.303138  8875 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:32.316103  9522 raft_consensus.cc:1240] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Rejecting Update request from peer fd116b86a1e4445c994a361f776beba1 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:32.317848  8754 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.326277  9524 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.338845  8754 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:32.340088 13225 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:32.347818  8759 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:32.351580  8725 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:32.358070 13222 consensus_queue.cc:1059] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:32.360579 13248 ts_tablet_manager.cc:1434] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.321s	user 0.003s	sys 0.007s
I20260709 12:11:32.364660 13081 raft_consensus.cc:3055] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.367995  9518 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:32.402208 13081 raft_consensus.cc:740] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:32.264575  8656 catalog_manager.cc:5697] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.403570 13081 consensus_queue.cc:260] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.404422  8656 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 6 to 8, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.405463 13081 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.407346  9524 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:32.379841  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:32.408190  9522 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.409703 13084 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:32.393488  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:32.412562  8901 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.406821  8656 catalog_manager.cc:5697] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.383003 13225 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:32.412932  8901 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:32.416579  8901 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.418380  8901 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.422953  8919 tablet_copy_service.cc:342] P 61fbd5afaa194845917d5b1b04571378: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-4ce14b8d8c8a43d48b1570f033c4e64f received from {username='slave'} at 127.0.0.1:40132
I20260709 12:11:32.423739  8919 tablet_copy_service.cc:434] P 61fbd5afaa194845917d5b1b04571378: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-4ce14b8d8c8a43d48b1570f033c4e64f on tablet 4ce14b8d8c8a43d48b1570f033c4e64f with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:32.439194  8901 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:32.444671  8656 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 7 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 9 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:32.452401  8656 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:32.454571  8656 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 8 to 10, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.469395  9522 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ae7a1e140481db6cc04faeb268d9c in term 11.
I20260709 12:11:32.477021 12602 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.478010 12602 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
W20260709 12:11:32.478988  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 127787us
I20260709 12:11:32.483970  8726 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
W20260709 12:11:32.486075  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 46386.7us
I20260709 12:11:32.495636 12878 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.496241 12878 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Leader. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:32.497303 12878 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.499492  8656 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.479583 12602 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.538435  8656 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.592476 13212 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:32.607632  8751 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:32.609082  8833 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:11:32.628752  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 51557.5us
I20260709 12:11:32.601569  8656 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.671250  8656 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 6 to 8, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 8 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:32.678936  8656 catalog_manager.cc:5697] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.712672 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40124 (request call id 8) took 5398 ms. Trace:
I20260709 12:11:32.711265  8656 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:32.732702  8656 catalog_manager.cc:5697] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.735421  8656 catalog_manager.cc:5697] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.737424  8656 catalog_manager.cc:5697] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.739429  8656 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 6, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 6 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.743351  9522 raft_consensus.cc:3060] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEARNER]: Advancing to term 12
I20260709 12:11:32.713864 13212 rpcz_store.cc:276] 0709 12:11:27.314412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.314576 (+   164us) service_pool.cc:224] Handling call
0709 12:11:27.915313 (+600737us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b58008e04d0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3809f0aa 00007fce38121447 00007fce3813e70a 00007fce3813f76a 00007fce3813e91b 00007fce3814a03c 00007fce381496b3 00007fce3d109d29 00007fce366881d4 00007fce36688162
0709 12:11:27.998874 (+ 83561us) log.cc:844] Serialized 506 byte log entry
0709 12:11:28.330679 (+331805us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b54000134a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380bc142 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634 0000000000388479 00007fce35056475
0709 12:11:28.789787 (+459108us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54000134a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380bc142 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634 0000000000388479 00007fce35056475
0709 12:11:28.806761 (+ 16974us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18001b6e20. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce350242a6 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380c3b26 00007fce380bd49a 00007fce380bc714
0709 12:11:28.807272 (+   511us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54000134a0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380c3b26 00007fce380bd49a 00007fce380bc714 00007fce3809ceaa 00007fce380a3d53 00007fce380a3cd9 00007fce380a3c69 00007fce380a3c31 00007fce380a2dfd 0000000000388634
0709 12:11:32.712522 (+3905250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60169,"raft.run_cpu_time_us":19967,"raft.run_wall_time_us":1456531,"spinlock_wait_cycles":1355648896,"thread_start_us":133564,"threads_started":1,"wal-append.queue_time_us":298747,"wal-append.run_cpu_time_us":2838,"wal-append.run_wall_time_us":1189846}
I20260709 12:11:32.764441  9522 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEARNER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:32.779412  8656 catalog_manager.cc:5697] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 3 to 5, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 5 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.781800  8656 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.783469  8656 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 4 to 8, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.811932 13161 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.813102 13161 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.816712  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:32.817431  8833 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:32.819150  9489 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:32.820341 13045 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.820811 13045 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.821381 13045 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.825443 13161 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:32.829026  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:32.829806  8905 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
W20260709 12:11:32.846040  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet cac426ada8f6447ebc8beff698a38039: Illegal state: Replica fd116b86a1e4445c994a361f776beba1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:32.851601 13045 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:32.854604  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet 5751232c878a452c84d5bd9127abfc1d: Illegal state: Replica 61fbd5afaa194845917d5b1b04571378 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:32.861500 13045 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:32.863761  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:32.864483  8901 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.868819  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet d0e4c6e5758d4fb18617b5b7c30cd334: Illegal state: Replica 61fbd5afaa194845917d5b1b04571378 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:32.878819  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:32.879482  8833 raft_consensus.cc:3060] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.892575  8901 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:32.893978  9488 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:32.895994 13045 raft_consensus.cc:2804] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:32.905043 13045 raft_consensus.cc:697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:32.910445 13045 consensus_queue.cc:237] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:32.932708  9522 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:32.934278 12602 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.937063  8826 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:32.939791 12879 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:32.909400  8833 raft_consensus.cc:2468] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:33.015865  9522 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:33.018245 12841 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:33.091945  8905 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:33.094812 12841 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:33.253818  8658 catalog_manager.cc:5697] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.265367  8658 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 11, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.267575  8658 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 11, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.270273  8658 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 10 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.273273  8658 catalog_manager.cc:5697] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 11, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 11 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.277285  8658 catalog_manager.cc:5697] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
W20260709 12:11:33.272238  8656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 222) took 20333 ms (client timeout 15000 ms). Trace:
W20260709 12:11:33.288947  8656 rpcz_store.cc:269] 0709 12:11:12.939427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.944891 (+  5464us) service_pool.cc:224] Handling call
0709 12:11:33.272116 (+20327225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:32.891970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:32.892792 (+   822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:32.892846 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:11:32.892881 (+    35us) tablet.cc:662] Decoding operations
0709 12:11:32.902537 (+  9656us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:32.902651 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:32.902685 (+    34us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:11:32.904399 (+  1714us) tablet.cc:701] Row locks acquired
0709 12:11:32.904448 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:32.904670 (+   222us) write_op.cc:270] Start()
0709 12:11:32.904849 (+   179us) write_op.cc:276] Timestamp: P: 1783599092904571 usec, L: 0
0709 12:11:32.904892 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:11:32.905762 (+   870us) log.cc:844] Serialized 7517 byte log entry
0709 12:11:33.069366 (+163604us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.114617 (+ 45251us) write_op.cc:301] APPLY: starting
0709 12:11:33.114973 (+   356us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.150640 (+ 35667us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.150773 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.183393 (+ 32620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.183762 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:11:33.183844 (+    82us) write_op.cc:312] APPLY: finished
0709 12:11:33.184347 (+   503us) log.cc:844] Serialized 172 byte log entry
0709 12:11:33.184566 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.196144 (+ 11578us) write_op.cc:454] Released schema lock
0709 12:11:33.196234 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.196727 (+   493us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.214183 (+ 17456us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":44135,"apply.run_cpu_time_us":24201,"apply.run_wall_time_us":82090,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":47577,"prepare.run_cpu_time_us":7087,"prepare.run_wall_time_us":29029,"raft.queue_time_us":116898,"raft.run_cpu_time_us":5072,"raft.run_wall_time_us":65355,"replication_time_us":157149,"thread_start_us":195848,"threads_started":4,"wal-append.queue_time_us":23073}]]}
I20260709 12:11:33.293838  8658 catalog_manager.cc:5697] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.296437  8658 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 10 to 11, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.298522  8658 catalog_manager.cc:5697] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 9 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.300432  8658 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 5 to 11, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.302851  8658 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 9 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.304311  8658 catalog_manager.cc:5697] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.309698  8658 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.317492  8658 catalog_manager.cc:5697] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.319010  8658 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.323050  8658 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 3 to 6, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.333684  8658 catalog_manager.cc:5697] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.335275  8658 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.336848  8658 catalog_manager.cc:5697] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.338447  8658 catalog_manager.cc:5697] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.339251 13071 raft_consensus.cc:1064] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:33.339942  8658 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 10, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 10 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.350430 13071 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:33.374090  9524 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEARNER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.383167 13267 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.411276  8833 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.413625  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.414089  8759 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.415745 13212 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.425000 13212 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 8 to 10, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.430240  8751 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.457211 13267 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:11:33.486303  8833 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:33.491494 13045 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:33.500336  8835 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.525760  8906 raft_consensus.cc:1275] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:33.538113 13045 consensus_queue.cc:1048] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.539297  9524 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.540875  8657 catalog_manager.cc:5697] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 10 to 14, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 14 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.581642  8657 catalog_manager.cc:5697] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.583611  8657 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 5 to 6, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.589603  8657 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 10 to 11, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.602773  8658 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 238) took 7385 ms. Trace:
I20260709 12:11:33.613430  8657 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 11, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } attrs { replace: true } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.616155  8657 catalog_manager.cc:5697] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 11, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.633733  8657 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 6 to 9, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 9 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.677914  9524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35"
dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:36564
I20260709 12:11:33.603929  8658 rpcz_store.cc:276] 0709 12:11:26.216967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.224786 (+  7819us) service_pool.cc:224] Handling call
0709 12:11:33.602674 (+7377888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.361349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.361925 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.361962 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:33.361975 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:33.363604 (+  1629us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.363666 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.363699 (+    33us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:11:33.365288 (+  1589us) tablet.cc:701] Row locks acquired
0709 12:11:33.365308 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:11:33.365466 (+   158us) write_op.cc:270] Start()
0709 12:11:33.365588 (+   122us) write_op.cc:276] Timestamp: P: 1783599093365416 usec, L: 0
0709 12:11:33.365610 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.370867 (+  5257us) log.cc:844] Serialized 8283 byte log entry
0709 12:11:33.373951 (+  3084us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.374498 (+   547us) write_op.cc:301] APPLY: starting
0709 12:11:33.374600 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.405369 (+ 30769us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.405473 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.495277 (+ 89804us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.495577 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:11:33.495621 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:33.496064 (+   443us) log.cc:844] Serialized 188 byte log entry
0709 12:11:33.496285 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.496491 (+   206us) write_op.cc:454] Released schema lock
0709 12:11:33.496562 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.529035 (+ 32473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.534269 (+  5234us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":310,"apply.run_cpu_time_us":25730,"apply.run_wall_time_us":141445,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87822,"num_ops":21,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":5581,"prepare.run_wall_time_us":12491,"replication_time_us":8168}]]}
I20260709 12:11:33.678771  9524 raft_consensus.cc:606] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:33.679463  9524 raft_consensus.cc:614] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.646417  8657 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 11 to 12, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.698230  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:33.698889  8901 raft_consensus.cc:606] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
W20260709 12:11:33.709070  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 99709.9us
I20260709 12:11:33.711984  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:33.712693  8901 raft_consensus.cc:606] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:33.713065  8901 raft_consensus.cc:614] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.729286  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "005ae7a1e140481db6cc04faeb268d9c"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:33.729879  8901 raft_consensus.cc:606] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Received request to transfer leadership to TS 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:33.731204  8901 raft_consensus.cc:614] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:33.743319  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 70105.4us
I20260709 12:11:33.750829  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:33.733450  8657 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 8 to 9, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 9 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:33.751690  8901 raft_consensus.cc:606] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
W20260709 12:11:33.756572  8860 heartbeater.cc:646] Failed to heartbeat to 127.7.102.190:46065 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.102.190:46065 timed out after 15.000s (SENT)
I20260709 12:11:33.757054  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:33.757822  8901 raft_consensus.cc:606] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:33.758186  8901 raft_consensus.cc:614] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.759079  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:33.760905  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:33.762681  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.788301 13356 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.791273 13356 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:33.802377  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:33.812593 13356 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:33.813752  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:33.814515  9524 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 14.
I20260709 12:11:33.817198  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:33.818462 13356 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.818851 13356 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.819221 13356 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.838806 13267 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:33.839532 13267 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:33.843020  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:33.843768  9524 raft_consensus.cc:2393] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 14: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:33.844719 13356 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:33.845325 13267 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:33.866822 13356 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 election: Requested vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:33.866737  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:33.867538  9524 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.868996  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:33.880091  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:33.884338  8833 raft_consensus.cc:2368] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 14. Current term is 15.
I20260709 12:11:33.885252  8907 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.886502  9524 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 15.
I20260709 12:11:33.935429  8801 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:33.936121  8907 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 15.
I20260709 12:11:33.936453 13356 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.937001 13356 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:33.937903 13356 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:33.958531  8874 leader_election.cc:400] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 14. Current term is 15.
I20260709 12:11:33.959076  8874 leader_election.cc:403] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.962114 13145 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317) with higher term. Message: Invalid argument: T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 for earlier term 14. Current term is 15.
I20260709 12:11:33.963413  8657 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44342 (request call id 151) took 1888 ms. Trace:
I20260709 12:11:33.963860  8657 rpcz_store.cc:276] 0709 12:11:32.075163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.076982 (+  1819us) service_pool.cc:224] Handling call
0709 12:11:33.963291 (+1886309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.793189 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.793777 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.793813 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:33.793833 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:33.794814 (+   981us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.794882 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.794913 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:33.795689 (+   776us) tablet.cc:701] Row locks acquired
0709 12:11:33.795706 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:33.795865 (+   159us) write_op.cc:270] Start()
0709 12:11:33.796000 (+   135us) write_op.cc:276] Timestamp: P: 1783599093795816 usec, L: 0
0709 12:11:33.796020 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.799327 (+  3307us) log.cc:844] Serialized 3660 byte log entry
0709 12:11:33.807704 (+  8377us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.808850 (+  1146us) write_op.cc:301] APPLY: starting
0709 12:11:33.808951 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.871957 (+ 63006us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.872069 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.939294 (+ 67225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.939530 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:33.939574 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:33.939908 (+   334us) log.cc:844] Serialized 89 byte log entry
0709 12:11:33.945367 (+  5459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.945502 (+   135us) write_op.cc:454] Released schema lock
0709 12:11:33.945552 (+    50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":49421,"reported_tablets":17,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":209,"apply.run_cpu_time_us":12491,"apply.run_wall_time_us":161793,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37638,"num_ops":9,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":3887,"prepare.run_wall_time_us":12154,"replication_time_us":11539}]]}
I20260709 12:11:33.968472  8658 catalog_manager.cc:5697] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.983207  8658 catalog_manager.cc:5697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 3 to 10, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.987282  8658 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 10 to 11, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.989140  8658 catalog_manager.cc:5697] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 10 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:33.991211  8658 catalog_manager.cc:5697] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.007498  8658 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.009428  8658 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 13, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 13 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.023360  8658 catalog_manager.cc:5697] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 6 to 14, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 14 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.025249  8658 catalog_manager.cc:5697] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 10 to 12, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 12 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.027716 13267 raft_consensus.cc:993] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:34.033190 13267 raft_consensus.cc:1081] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:34.035873  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52186
I20260709 12:11:34.036482  8827 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.036878  8827 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.048753  8658 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 11 to 13, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 13 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.054055  8658 catalog_manager.cc:5697] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.051642  8827 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:34.067101  8827 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:34.070868  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:34.073057  8753 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.075876  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:34.076511  8901 raft_consensus.cc:3055] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.076848  8901 raft_consensus.cc:740] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:34.077574  8901 consensus_queue.cc:260] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:34.078784  8901 raft_consensus.cc:3060] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.080766  8753 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:34.085788  8901 raft_consensus.cc:2468] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 10.
I20260709 12:11:34.087605  8798 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:34.070974  8658 catalog_manager.cc:5697] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 11, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 11 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.095852  8658 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 10 to 11, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 11 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.098212  8658 catalog_manager.cc:5697] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 6 to 12, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.099784  8658 catalog_manager.cc:5697] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.108430 13071 raft_consensus.cc:993] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:34.108992 13071 raft_consensus.cc:1081] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:34.097267 13116 raft_consensus.cc:2804] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.110942  8830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52186
I20260709 12:11:34.111439 13116 raft_consensus.cc:697] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:34.111651  8830 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.112200  8830 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.112498 13116 consensus_queue.cc:237] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:34.104092  8658 catalog_manager.cc:5697] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 9, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 9 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.118011  8658 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 10, term changed from 10 to 12, VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:34.120117  8658 catalog_manager.cc:5697] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 8 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.121627  8658 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 7 to 12, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129). New cstate: current_term: 12 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.170506  8830 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:34.183707  8657 catalog_manager.cc:5697] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.203438  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:34.204190  8751 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.205215  8657 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 10, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:34.214354  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:34.215023  8901 raft_consensus.cc:3055] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:34.215355  8901 raft_consensus.cc:740] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:34.216164  8901 consensus_queue.cc:260] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:34.222711  8901 raft_consensus.cc:3060] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.213699  8830 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:34.242420  8751 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 14.
I20260709 12:11:34.243886  8798 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:34.245218 13357 raft_consensus.cc:2804] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:34.245833 13357 raft_consensus.cc:697] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 14 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:34.245898  8901 raft_consensus.cc:2468] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 14.
I20260709 12:11:34.246937 13357 consensus_queue.cc:237] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:34.356115  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 48444.9us
I20260709 12:11:34.366300  9524 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:34.368229 13325 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:11:34.387658  8906 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:34.389714 13325 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:34.517369  8658 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 11 to 15, leader changed from eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 15 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:34.518563  8654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41812 (request call id 223) took 3543 ms. Trace:
I20260709 12:11:34.518952  8654 rpcz_store.cc:276] 0709 12:11:30.974794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.980116 (+  5322us) service_pool.cc:224] Handling call
0709 12:11:34.518367 (+3538251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5629,"reported_tablets":50}
W20260709 12:11:34.623929  8653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41796 (request call id 233) took 16130 ms (client timeout 15000 ms). Trace:
W20260709 12:11:34.624411  8653 rpcz_store.cc:269] 0709 12:11:18.493273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.497053 (+  3780us) service_pool.cc:224] Handling call
0709 12:11:34.623798 (+16126745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22562,"reported_tablets":50}
I20260709 12:11:34.650942  8901 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:34.657210 13116 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:34.693838  8751 raft_consensus.cc:1275] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:34.696343 13356 consensus_queue.cc:1048] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:34.710812  8751 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:34.715492 13357 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:34.726263  8907 raft_consensus.cc:1275] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:34.732146 13357 consensus_queue.cc:1048] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:34.749604  8655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41782 (request call id 237) took 28546 ms (client timeout 15000 ms). Trace:
W20260709 12:11:34.751248  8655 rpcz_store.cc:269] 0709 12:11:06.202579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.202857 (+   278us) service_pool.cc:224] Handling call
0709 12:11:34.749318 (+28546461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2565647,"reported_tablets":50}
I20260709 12:11:34.892479  8656 catalog_manager.cc:5697] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: term changed from 13 to 14, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 14 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } }
I20260709 12:11:34.986634  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:35.020475  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 143480us
I20260709 12:11:35.203476  8653 catalog_manager.cc:5697] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 9 to 10, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.266952  8906 consensus_queue.cc:237] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:35.313493  8833 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:35.320749  8901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
new_leader_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 12:11:35.321503  8901 raft_consensus.cc:606] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Received request to transfer leadership to TS fd116b86a1e4445c994a361f776beba1
I20260709 12:11:35.321869  8901 raft_consensus.cc:614] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:35.347215  9524 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:35.348853 13356 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:35.355899  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 49093.8us
I20260709 12:11:35.413461  9518 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:35.415014 13387 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:35.496270  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.504936  8906 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:35.524915  8800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.539310  8758 raft_consensus.cc:1275] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:35.596593 13399 consensus_queue.cc:1048] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:35.607954  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 49182.4us
I20260709 12:11:35.610076 13365 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:35.612401 13356 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 8 to 10, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:35.615149  9524 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:35.658399 13267 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:35.712253  8643 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ce14b8d8c8a43d48b1570f033c4e64f with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:35.721858  8901 raft_consensus.cc:2955] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:35.759639  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 117336us
I20260709 12:11:35.787748  9518 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:35.828320  8644 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0e4c6e5758d4fb18617b5b7c30cd334 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:35.837157  8759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
mode: GRACEFUL
new_leader_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:51006
I20260709 12:11:35.837823  8759 raft_consensus.cc:606] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Received request to transfer leadership to TS 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:35.839437  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:35.841284  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:35.842144  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:35.861107  8759 raft_consensus.cc:2955] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:35.873329  8656 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 8 to 10, VOTER 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) evicted. New cstate: current_term: 11 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:36.065088 13357 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:36.065759 13357 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } attrs { replace: true } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:36.066315  8655 catalog_manager.cc:5697] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index 10 to 11, VOTER fd116b86a1e4445c994a361f776beba1 (127.7.102.130) evicted. New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.069543  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "005ae7a1e140481db6cc04faeb268d9c" is_pre_election: true
I20260709 12:11:36.073472  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:36.076201  8743 tablet_service.cc:1558] Processing DeleteTablet for tablet d0e4c6e5758d4fb18617b5b7c30cd334 with delete_type TABLET_DATA_TOMBSTONED (TS 005ae7a1e140481db6cc04faeb268d9c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:43806
I20260709 12:11:36.076989  8799 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:36.078714 13116 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.082876 13357 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:36.084095  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:36.142704  8818 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce14b8d8c8a43d48b1570f033c4e64f with delete_type TABLET_DATA_TOMBSTONED (TS fd116b86a1e4445c994a361f776beba1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46770
I20260709 12:11:36.147941 13422 tablet_replica.cc:333] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:11:36.178364 13420 tablet_replica.cc:333] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:36.180801 13422 raft_consensus.cc:2243] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:36.191401 13422 raft_consensus.cc:2272] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:36.194904 13422 ts_tablet_manager.cc:1916] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:36.196374 13420 raft_consensus.cc:2243] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:36.199815 13420 raft_consensus.cc:2272] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:36.210525 13420 ts_tablet_manager.cc:1916] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:36.218080 13422 ts_tablet_manager.cc:1929] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:11:36.229614 13400 raft_consensus.cc:993] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: : Instructing follower 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:11:36.229737 13422 log.cc:1199] T 4ce14b8d8c8a43d48b1570f033c4e64f P fd116b86a1e4445c994a361f776beba1: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/wals/4ce14b8d8c8a43d48b1570f033c4e64f
I20260709 12:11:36.230374 13400 raft_consensus.cc:1081] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Signalling peer 61fbd5afaa194845917d5b1b04571378 to start an election
I20260709 12:11:36.232954  8901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
 from {username='slave'} at 127.0.0.1:38194
I20260709 12:11:36.233152  8644 catalog_manager.cc:5028] TS fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): tablet 4ce14b8d8c8a43d48b1570f033c4e64f (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:11:36.233582  8901 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.234017  8901 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.244182  8901 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:36.258791  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:36.259385  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18b8defabce4ce7a420d8548c885e28" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "005ae7a1e140481db6cc04faeb268d9c"
I20260709 12:11:36.259636  8901 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:36.260164  8758 raft_consensus.cc:3055] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.260581  8758 raft_consensus.cc:740] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 005ae7a1e140481db6cc04faeb268d9c, State: Running, Role: LEADER
I20260709 12:11:36.261457  8758 consensus_queue.cc:260] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:36.262849  8758 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.259454  9518 raft_consensus.cc:3060] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.275215  9518 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:36.276779 13420 ts_tablet_manager.cc:1929] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:11:36.277275 13420 log.cc:1199] T d0e4c6e5758d4fb18617b5b7c30cd334 P 005ae7a1e140481db6cc04faeb268d9c: Deleting WAL directory at /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/wals/d0e4c6e5758d4fb18617b5b7c30cd334
I20260709 12:11:36.278545  8875 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:36.280335 13394 raft_consensus.cc:2804] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.281760 13394 raft_consensus.cc:697] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:36.282692 13394 consensus_queue.cc:237] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:36.284289  8758 raft_consensus.cc:2468] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:36.298431  8642 catalog_manager.cc:5028] TS 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): tablet d0e4c6e5758d4fb18617b5b7c30cd334 (table test-workload [id=ec8fe22733c840e299e729aec5181346]) successfully deleted
I20260709 12:11:36.380263  8656 catalog_manager.cc:5697] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 11 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:37.011976  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.024576  9524 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:37.088395  8758 raft_consensus.cc:1275] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:37.093523 13394 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:11:37.168955  7578 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:37.172403  7578 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:37.173243  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.201864 13432 consensus_queue.cc:1048] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:37.371031  7578 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:37.372956  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 54366.4us
I20260709 12:11:37.382887  8760 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:37.428560  8903 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:37.430373 13401 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:37.430775  8826 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Refusing update from remote peer 005ae7a1e140481db6cc04faeb268d9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:11:37.432157  8726 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba96dc62a22549a6ab209325db961b36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:37.433881 13436 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:37.483314  7578 tablet_server.cc:179] TabletServer@127.7.102.129:0 shutting down...
W20260709 12:11:37.487103  8872 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 12:11:37.505684 13388 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:37.517905  8826 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:11:37.541043  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 53974us
W20260709 12:11:37.555233  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 65339.3us
W20260709 12:11:37.572173  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.680670  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.710074  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.710733  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.711326  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.711928  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.714604  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:37.716172  8656 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c reported cstate change: config changed from index -1 to 5, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 6 leader_uuid: "005ae7a1e140481db6cc04faeb268d9c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:37.760124  8726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 45763us
I20260709 12:11:37.574189  8903 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:37.790294  8827 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:11:37.944896  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:37.945564  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49435.3us
W20260709 12:11:37.950608  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 53851.7us
W20260709 12:11:38.022701  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 157686us
W20260709 12:11:38.045287  8801 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cda6b7a1dd54b79a208e39c8a0de491. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.063719  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.064244  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 43913us
W20260709 12:11:38.064898  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.065639  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:38.072613  8903 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:38.139974  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 76701.8us
W20260709 12:11:38.146420  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.150172  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.148083  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.154527  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.155148  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.155653  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:38.155303 13325 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:38.156253  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.160105  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.161954  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.169358  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.170713  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.171844  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.173558  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.175367  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.182943  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.193238  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.167126  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.194993  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.197932  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.201063  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.202075  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.264811  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:38.290737 13478 ts_tablet_manager.cc:933] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:11:38.319442 13116 raft_consensus.cc:2955] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Committing config change with OpId 10.6: config changed from index -1 to 6, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:38.329066  8905 raft_consensus.cc:2955] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Committing config change with OpId 10.6: config changed from index -1 to 6, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
W20260709 12:11:38.371687  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet d412a1e35a1a4f75b3628a5642ddd121: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:38.378458  8706 auto_rebalancer.cc:629] Failed to schedule move for tablet d9af31792ab541fbb5b308c83cf60c08: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:38.365784 13478 tablet_copy_client.cc:323] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.129:39957
I20260709 12:11:38.434636  8656 catalog_manager.cc:5697] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: config changed from index -1 to 6, NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) added. New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } } }
I20260709 12:11:38.516227  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:11:38.527101  7578 tablet_replica.cc:333] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.528317  7578 raft_consensus.cc:2243] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.530547  7578 raft_consensus.cc:2272] T 6479206f1d4545ec83633cfa7a99b648 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.548097  7578 tablet_replica.cc:333] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.552704  7578 raft_consensus.cc:2243] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.554075  7578 raft_consensus.cc:2272] T 93fd9eae511442cda809efae9c60a8dd P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.557545  7578 tablet_replica.cc:333] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.558612  7578 raft_consensus.cc:2243] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.559859  7578 raft_consensus.cc:2272] T 2947e409c3964d228748bbb8d2e40832 P 005ae7a1e140481db6cc04faeb268d9c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.562932  7578 tablet_replica.cc:333] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.563921  7578 raft_consensus.cc:2243] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.564662  7578 raft_consensus.cc:2272] T 0dd6228ae6144924a1ddc7362f86742d P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.570605  7578 tablet_replica.cc:333] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.571913  7578 raft_consensus.cc:2243] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.572597  7578 raft_consensus.cc:2272] T a342b86867884bfaa83a903e1502daaa P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.575799  7578 tablet_replica.cc:333] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.576880  7578 raft_consensus.cc:2243] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.592562  7578 raft_consensus.cc:2272] T c18b8defabce4ce7a420d8548c885e28 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.592665 13474 raft_consensus.cc:493] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.593468 13474 raft_consensus.cc:515] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.595698 13474 leader_election.cc:290] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.595170 13428 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.596987 13428 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.599962  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.602737  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3efa45bd1e40c79e9873e78f82e8e6" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.606040 13388 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.606693 13388 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.607326 13428 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.609611 13436 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.609930 13388 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.610229 13436 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.611775  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.612607 13436 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.617017 13440 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.614956  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.617995  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.616420  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.619423  8726 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.616744  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.620819 13436 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.621968  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.617641 13440 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.609172 13428 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:38.614426  8725 leader_election.cc:304] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.629743  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.631595  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.635327 13388 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:38.632011  8724 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.636080 13436 raft_consensus.cc:2749] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.643402  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.642808 13476 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.641640 13388 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.645886  8724 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.634727 13428 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.646972 13476 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.648036 13388 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.635818 13474 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.649612  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.651078  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.649168  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.649662  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.654953 13482 ts_tablet_manager.cc:933] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:38.642766 13440 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.648499 13428 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.662247  8724 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.666280  8726 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.667507 13474 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.667837 13440 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:38.668525 13482 tablet_copy_client.cc:323] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:11:38.670668  7578 tablet_replica.cc:333] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.671314  8844 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet 6cda6b7a1dd54b79a208e39c8a0de491 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:11:38.671766  7578 raft_consensus.cc:2243] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.671969  8844 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet 6cda6b7a1dd54b79a208e39c8a0de491 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-6cda6b7a1dd54b79a208e39c8a0de491
I20260709 12:11:38.672554  7578 raft_consensus.cc:2272] T 01a81765aa0b4241bacb910d72fb71cb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.679029 13474 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.680825 13474 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.682219 13388 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.687071 13388 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.687578  7578 tablet_replica.cc:333] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.688609  7578 raft_consensus.cc:2243] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.689219 13388 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.689422 13474 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.693651 13476 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.702471  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.702808  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.719616 13428 raft_consensus.cc:493] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.708108  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.721338 13476 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.721879 13440 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.704499  7578 raft_consensus.cc:2272] T 98ff6a40f13a4be9b4a05ca797f8fd52 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.711807  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea14ea70b8b462ca548019b513f4211" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.723126 13428 raft_consensus.cc:515] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.723913 13476 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.725787  7578 tablet_replica.cc:333] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.728596  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.729909  7578 raft_consensus.cc:2243] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.730774  7578 raft_consensus.cc:2272] T 12a516db16ef4c1bae0d02a9c8d29be4 P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.740309  7578 tablet_replica.cc:333] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.734242 13476 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.741091 13431 raft_consensus.cc:493] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.726226 13440 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.741792 13431 raft_consensus.cc:515] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.742710  8844 tablet_copy_source_session.cc:215] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:38.743436 13440 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.740984 13476 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.744110 13431 leader_election.cc:290] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.745186  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.745724 13388 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.746529 13482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cda6b7a1dd54b79a208e39c8a0de491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:38.746315 13388 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.746656  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.748802 13440 raft_consensus.cc:493] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:38.749791  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.749382 13440 raft_consensus.cc:515] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.751452  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a6b1a7ca5440f18f286ddd5e44afce" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.751803  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.753206  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.751798 13388 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.753508  8725 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.752703 13476 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.754814  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.754964 13388 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.755784  7578 raft_consensus.cc:2243] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.756381  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.757061  7578 raft_consensus.cc:2272] T 67e3054fb6044180b7de9b761b2ea05b P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.757349  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.759951  8725 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.761255  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82912909b984cbb88197808b3d66347" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.761549  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.762465  8724 leader_election.cc:304] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.763420 13436 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.763742 13388 raft_consensus.cc:2749] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.765488  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.766753  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c57fe22a6bf47dca31c488f82e72a1f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.768967  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.762598 13476 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.770632  7578 tablet_replica.cc:333] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.768569  8724 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.781592 13476 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.782021  8724 leader_election.cc:304] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.782474 13476 raft_consensus.cc:493] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:38.783293 13388 raft_consensus.cc:2749] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.783185 13476 raft_consensus.cc:515] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.772707  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.756255 13440 leader_election.cc:290] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.770834 13428 leader_election.cc:290] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.789371 13436 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.791656 13476 leader_election.cc:290] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.792877  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.793272  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd13939e80e4c668025684b9dbc3f54" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.795995  8726 leader_election.cc:304] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.798676 13476 raft_consensus.cc:2749] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:38.800155  8725 leader_election.cc:304] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.805567 13482 tablet_copy_client.cc:806] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:38.815541 13482 tablet_copy_client.cc:670] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:38.805667 13476 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.807029 13436 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.809378  7578 raft_consensus.cc:2243] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.817174 13436 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.818006  7578 raft_consensus.cc:2272] T d412a1e35a1a4f75b3628a5642ddd121 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.810010 13428 raft_consensus.cc:2749] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.819482 13436 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.810499  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.821024 13476 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.823266 13476 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.823789 13476 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.825248  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.826732 13388 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:38.827310 13388 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.827651  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.828750  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.832101 13482 tablet_copy_client.cc:538] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:38.834316  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bb8ebab2aa4ea6b0a85f0aac706c35" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.835274 13388 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.836298  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.837196  7578 tablet_replica.cc:333] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.840008  7578 raft_consensus.cc:2243] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.838316  8725 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.841755 13440 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.838622 13388 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.843696 13388 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:38.839900  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.838115  8726 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.846446  8726 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.847075 13436 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.850769  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.851454 13388 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:38.852181 13440 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.854704  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:38.849858  7578 raft_consensus.cc:2272] T 4f78b2d2f5154e388ca8e35799e1afeb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.860369  7578 tablet_replica.cc:333] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.865569  7578 raft_consensus.cc:2243] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.866587  7578 raft_consensus.cc:2272] T a82912909b984cbb88197808b3d66347 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.861423  8726 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:38.871311 13482 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
I20260709 12:11:38.874059 13476 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.880165 13476 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.880910 13476 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.883852 13476 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.885191  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.887296  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412fc8b910864ab39eda6a2eaa63b886" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.892669  8724 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.893497 13388 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.903053  7578 tablet_replica.cc:333] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.913318 13436 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.914029 13436 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.917241  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.920993 13436 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.921913  7578 raft_consensus.cc:2243] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.922851  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac426ada8f6447ebc8beff698a38039" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.923446  7578 raft_consensus.cc:2272] T d9af31792ab541fbb5b308c83cf60c08 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.924602  8724 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.925565 13476 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.927672  7578 tablet_replica.cc:333] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.928776  7578 raft_consensus.cc:2243] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.931619  7578 raft_consensus.cc:2272] T 2ea14ea70b8b462ca548019b513f4211 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.934760  7578 tablet_replica.cc:333] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.940661 13476 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:38.941360 13476 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.943643 13476 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.944983  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.946986  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.947270  7578 raft_consensus.cc:2243] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.948673  7578 raft_consensus.cc:2272] T ba96dc62a22549a6ab209325db961b36 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.950244  8724 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.951195 13476 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.962191  7578 tablet_replica.cc:333] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.963097  7578 raft_consensus.cc:2243] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:38.963707  7578 raft_consensus.cc:2272] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.966701  7578 tablet_replica.cc:333] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:38.970824 13476 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:38.971509 13476 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:38.976547  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:38.978341 13476 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:38.980247  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70cbe0e284f4df0aca5c9f02140ce70" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:38.982671  8724 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:38.986292  7578 raft_consensus.cc:2243] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:38.987665  7578 raft_consensus.cc:2272] T 69ecd2fc45134ac8a031c2a6f90284d7 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.003786 13436 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.014736  7578 tablet_replica.cc:333] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.024155  7578 raft_consensus.cc:2243] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.026654  7578 raft_consensus.cc:2272] T 3d58802311724215aa71fccdaeca35f7 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.030226  7578 tablet_replica.cc:333] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.031199  7578 raft_consensus.cc:2243] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.044838  7578 raft_consensus.cc:2272] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:38.975411 13482 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:39.055963  7578 tablet_replica.cc:333] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.057859 13482 tablet_bootstrap.cc:492] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:11:39.058970 13482 ts_tablet_manager.cc:1403] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.188s	user 0.023s	sys 0.017s
I20260709 12:11:39.062326 13482 raft_consensus.cc:359] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:39.070626 13482 raft_consensus.cc:740] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:11:39.075026 13482 consensus_queue.cc:260] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:39.078320 13482 ts_tablet_manager.cc:1434] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:11:39.062744  7578 raft_consensus.cc:2243] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.096076  7578 raft_consensus.cc:2272] T 56a6b1a7ca5440f18f286ddd5e44afce P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.102937  8844 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-6cda6b7a1dd54b79a208e39c8a0de491 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:11:39.103528  8844 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-6cda6b7a1dd54b79a208e39c8a0de491 on tablet 6cda6b7a1dd54b79a208e39c8a0de491 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:39.266259  7578 tablet_replica.cc:333] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.267953  7578 raft_consensus.cc:2243] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.268822  7578 raft_consensus.cc:2272] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.298228  7578 tablet_replica.cc:333] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.317152  7578 raft_consensus.cc:2243] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.337523  7578 raft_consensus.cc:2272] T 412fc8b910864ab39eda6a2eaa63b886 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:39.424723  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.586944  7578 tablet_replica.cc:333] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.588263  7578 raft_consensus.cc:2243] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.689878  9524 raft_consensus.cc:1217] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 12:11:39.704843  7578 raft_consensus.cc:2272] T d70cbe0e284f4df0aca5c9f02140ce70 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.693998 13486 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:39.740201  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:39.810350  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 70227.3us
I20260709 12:11:39.712126  7578 tablet_replica.cc:333] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.816375  7578 raft_consensus.cc:2243] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.770090 13490 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:39.862313 13490 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:39.865538 13490 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:39.751724 13486 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:39.871553 13486 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:39.769034  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 49089.6us
W20260709 12:11:39.831007  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.887357  7578 raft_consensus.cc:2272] T 431583fc4c754d42936c71ee0279ae80 P 005ae7a1e140481db6cc04faeb268d9c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.890996  7578 tablet_replica.cc:333] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:39.926496 13490 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:39.985930 13490 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:39.947293  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91560.4us
W20260709 12:11:39.954411  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:39.998399  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.001772  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.002717  8832 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:39.988353 13490 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.010488  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.030158 13490 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.030745 13490 raft_consensus.cc:493] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.031212 13490 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.036578 13485 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.037360 13485 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.018080  7578 raft_consensus.cc:2243] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.019656  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:39.984874 13486 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.039960 13486 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.041079  8826 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
W20260709 12:11:40.027359  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 66019.8us
I20260709 12:11:40.078547  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.094355 13438 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.135479 13438 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.137905 13438 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.109928 13442 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:40.116756  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 90816.8us
I20260709 12:11:40.117839 13488 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.139055 13488 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.144078 13442 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:40.151621  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73219us
I20260709 12:11:40.134766 13486 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.139189  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:40.125360 13485 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:40.133165  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.155557  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.159411  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.161100  7578 raft_consensus.cc:2272] T d7cbe23065834283bc7d53543908a219 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:40.179960  8826 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:40.187275  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.190625 13486 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.191221  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.162490 13489 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.194284 13465 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.200002 13465 raft_consensus.cc:493] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.200547 13465 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.201612 13488 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.164276 13487 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.205178 13487 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:40.207497  7578 tablet_replica.cc:333] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.207994 13487 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.199949 13489 raft_consensus.cc:493] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.208720  7578 raft_consensus.cc:2243] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.209045 13489 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.197381 13490 raft_consensus.cc:515] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.213910  8902 raft_consensus.cc:2393] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 14: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:40.214825 13490 leader_election.cc:290] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.216553 13446 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.217496 13446 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.176000 13442 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.224126 13446 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.233985  7578 raft_consensus.cc:2272] T cfd13939e80e4c668025684b9dbc3f54 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:40.233440  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 56320.1us
I20260709 12:11:40.191373 13486 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:40.243909  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.245312 13465 raft_consensus.cc:515] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.247527 13465 leader_election.cc:290] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.251174 13436 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:40.251766 13436 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.252604  8832 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
I20260709 12:11:40.227253 13489 raft_consensus.cc:515] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.257794  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.260753  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.239424 13486 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.265785  8906 raft_consensus.cc:2393] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 12: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:40.266471  9489 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.263168 13436 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:40.274292  8872 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.275683  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.276897 13489 leader_election.cc:290] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:40.277710  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 90511.9us
I20260709 12:11:40.281781  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.282663  8826 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 6.
W20260709 12:11:40.283154  8798 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.284510  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d412a1e35a1a4f75b3628a5642ddd121" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.285204  8832 raft_consensus.cc:3060] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.287856 13442 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.288445 13442 raft_consensus.cc:493] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.288913 13442 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.292906 13485 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.285180  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2947e409c3964d228748bbb8d2e40832" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.293764 13485 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.294248 13476 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:40.294872  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.294997 13476 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:40.277191  8872 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.300787  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 111796us
W20260709 12:11:40.302795  8872 leader_election.cc:336] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.303186  9487 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.303913  9487 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.294762  7578 tablet_replica.cc:333] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.305560  7578 raft_consensus.cc:2243] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.306490 13476 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.306690 13490 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:40.306654  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.307374  7578 raft_consensus.cc:2272] T 4c57fe22a6bf47dca31c488f82e72a1f P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:40.294239  8826 raft_consensus.cc:3060] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.314416 13497 raft_consensus.cc:1064] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
W20260709 12:11:40.308840  9487 leader_election.cc:336] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.309896  8832 raft_consensus.cc:2468] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:40.310092  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fd9eae511442cda809efae9c60a8dd" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.319953  8799 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:40.320363  8834 raft_consensus.cc:3060] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.296550 13485 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.329133  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.329880  8833 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:11:40.319396 13490 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.332719 13490 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:40.340566  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.341341  8902 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:40.342821 13442 raft_consensus.cc:515] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.344830  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.345160 13442 leader_election.cc:290] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.349181 13497 consensus_queue.cc:237] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 4, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.319253 13446 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.353964  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.355932 13491 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.367167  8826 raft_consensus.cc:2468] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 14.
I20260709 12:11:40.365609  8834 raft_consensus.cc:2468] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
W20260709 12:11:40.356532  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 91356.4us
I20260709 12:11:40.375609  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f78b2d2f5154e388ca8e35799e1afeb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.366922 13491 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.376819 13491 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.382222 13488 raft_consensus.cc:2749] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.376437  8834 raft_consensus.cc:3060] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.392930  7578 tablet_replica.cc:333] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.398871  7578 raft_consensus.cc:2243] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.396765 13490 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:40.408455 13488 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:40.415691  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.422590  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 112468us
I20260709 12:11:40.426731  7578 raft_consensus.cc:2272] T cac426ada8f6447ebc8beff698a38039 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:40.417732  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.451967  8903 raft_consensus.cc:2393] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 7: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
W20260709 12:11:40.445436  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 125182us
I20260709 12:11:40.407492 13491 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:40.454950  9487 leader_election.cc:336] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.460872 13490 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.425911 13488 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.474949  8903 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:40.475485 13488 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.477669  9524 raft_consensus.cc:1275] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:40.479176 13476 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:40.479818 13476 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.481102  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:40.481877  9516 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 11.
I20260709 12:11:40.482590 13476 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.484297  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.492341 13494 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:40.495698  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.496490 13488 consensus_queue.cc:1048] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:40.497344  8874 leader_election.cc:304] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.502012 13490 raft_consensus.cc:2804] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.502439  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.502521 13490 raft_consensus.cc:697] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:40.503985 13490 consensus_queue.cc:237] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.505446 13498 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.506042 13498 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.506461 13498 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.509792 13496 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.510274 13496 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:40.510639 13496 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.518566  8834 raft_consensus.cc:2468] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:40.516672  8874 leader_election.cc:304] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:40.523063  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:40.524056  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.516521 13498 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.526222 13505 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:40.526857 13505 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.528216 13504 raft_consensus.cc:2804] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.528848 13504 raft_consensus.cc:697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:40.529693 13504 consensus_queue.cc:237] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:40.530238  8725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 260557us
I20260709 12:11:40.530957  8725 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.532310  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecd2fc45134ac8a031c2a6f90284d7" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:40.532923  9524 raft_consensus.cc:3060] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.533285 13436 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.538594  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.539178  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.522301  8874 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
W20260709 12:11:40.537774  8872 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.552067  8872 leader_election.cc:336] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.556851  9489 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:40.558422  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:40.554036  8872 leader_election.cc:336] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.567660  9524 raft_consensus.cc:2468] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 12.
I20260709 12:11:40.567898  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.569007  8834 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:40.566747  8872 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.571420  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:40.572579  8872 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.582888  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4b3d74e26942a59cf5bdf2c24fcf1a" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.585875  8801 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:40.544384 13498 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.560958 13465 raft_consensus.cc:2804] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.550523 13505 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.588968 13488 raft_consensus.cc:2804] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.602361 13488 raft_consensus.cc:697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:40.603506 13488 consensus_queue.cc:237] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.604967 13499 raft_consensus.cc:2804] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:40.605574 13499 raft_consensus.cc:697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:40.606580 13499 consensus_queue.cc:237] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.612650  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:40.608464  8834 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 7.
I20260709 12:11:40.616882  7578 tablet_replica.cc:333] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
W20260709 12:11:40.617063  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 55169.4us
I20260709 12:11:40.617904  7578 raft_consensus.cc:2243] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:40.620285 13505 raft_consensus.cc:493] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
W20260709 12:11:40.624367  8801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.627704 13496 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.629352  8900 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 12: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:40.632258  7578 raft_consensus.cc:2272] T 57327b790014487690d5754a4e058fae P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:40.625541  8872 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.608517 13465 raft_consensus.cc:697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:40.610462 13491 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.624766 13436 raft_consensus.cc:493] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:11:40.639838 13436 raft_consensus.cc:515] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.642247 13436 leader_election.cc:290] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.648303 13503 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:40.648958 13503 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:40.653765  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.651252 13503 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.671214  8655 catalog_manager.cc:5697] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 11 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.688970  7578 tablet_replica.cc:333] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.689975  7578 raft_consensus.cc:2243] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:40.624256 13505 raft_consensus.cc:515] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.696880 13505 leader_election.cc:290] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.701056  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:40.736805  8724 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 149847us
I20260709 12:11:40.762028  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63977b2ac46b48f0ba26c573aeeb69fc" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.762162  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.766583  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:40.767113  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ed5434fbd54337b1b9a26153e96d0e" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.768057 13487 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:40.768407  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.768656 13487 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:40.769726 13487 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:40.697665 13465 consensus_queue.cc:237] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.781471  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:40.797266  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.803448  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.818024  8724 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:40.819574  8725 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.821802 13515 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.808135 13492 raft_consensus.cc:2955] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index 6 to 7, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:40.822825 13496 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:40.830116  7578 raft_consensus.cc:2272] T efe90059a90047969b785a597928a512 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:40.830941  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.821290  8725 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.832604 13515 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.835346  8725 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.836124 13515 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:40.837409  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:40.838107  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:40.838698  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.839250 13516 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:40.848012  8798 leader_election.cc:336] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:40.848032  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.848568  8798 leader_election.cc:304] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:40.830976 13476 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:40.858773 13491 raft_consensus.cc:2749] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.859995  7578 tablet_replica.cc:333] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.863372 13476 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:40.866117 13476 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:40.867782 13516 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:11:40.871196 13516 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.869197  7578 raft_consensus.cc:2243] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.870433  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:40.869758  8798 leader_election.cc:336] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.873100  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:40.872565  8798 leader_election.cc:304] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:40.873916  8832 raft_consensus.cc:2393] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61fbd5afaa194845917d5b1b04571378 in current term 12: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:40.877041  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce14b8d8c8a43d48b1570f033c4e64f" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:40.877408  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.886559 13516 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.889969  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.894323  7578 raft_consensus.cc:2272] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:40.902530  8653 catalog_manager.cc:5697] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 10, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 10 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.905699  8656 catalog_manager.cc:5697] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 11 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 12 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:40.911615  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:40.919082  8725 leader_election.cc:304] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.919453  8726 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:40.882761 13476 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:40.921957  8725 leader_election.cc:304] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.924597 13510 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.955447 13476 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:40.958078 13476 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:40.920768 13516 raft_consensus.cc:2749] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:40.959444 13521 log.cc:927] Time spent T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:40.960889 13515 raft_consensus.cc:2749] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.884804 13488 raft_consensus.cc:2749] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.951972  7578 tablet_replica.cc:333] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.963201  8725 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.964319  7578 raft_consensus.cc:2243] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.965890  7578 raft_consensus.cc:2272] T 92b5e15f0c384f1e8ed394830c71cd90 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:40.964866  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 47842us
I20260709 12:11:40.966085 13510 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:40.921953  8798 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.981175  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:40.981585  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 61619.9us
W20260709 12:11:40.982491  8798 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.982991  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbf5632da664f5c88b13382f86fbdfe" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:40.923040  8902 raft_consensus.cc:2955] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 6 to 7, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:40.985625  8872 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:40.986796  8798 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:40.988297  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:40.992690 13494 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:40.995182  7578 tablet_replica.cc:333] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:40.996089  7578 raft_consensus.cc:2243] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:40.986044 13510 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:11:41.001255 13510 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:41.003726 13510 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:41.005092  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:41.007568  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:41.009187  8723 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.988701  8724 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:40.987093  8872 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:41.011615  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.014189  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcd7668cd44a658ba674d10aa778d9" candidate_uuid: "005ae7a1e140481db6cc04faeb268d9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:41.016505  8724 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ae7a1e140481db6cc04faeb268d9c; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:11:41.017750  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:41.018420  8798 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:41.019291  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.019791 13502 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:41.019840  8798 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:41.021752  8798 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:41.022168  8798 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
W20260709 12:11:41.022994  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:41.023794  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.024408 13488 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.024863 13516 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:41.024477  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:41.027635  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.041292  7578 raft_consensus.cc:2272] T 36d20759d6564b039af8cca0f84b0eb5 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.041477 13516 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.044137  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.046109  7578 tablet_replica.cc:333] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.047283  7578 raft_consensus.cc:2243] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:11:41.052812  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 179157us
I20260709 12:11:41.056428  9518 raft_consensus.cc:2955] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 6 to 7, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:41.063227  7578 raft_consensus.cc:2272] T 883fe3a6d9a747ed8f95a683702eb669 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.086481  7578 tablet_replica.cc:333] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.087338  7578 raft_consensus.cc:2243] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:41.088382  7578 raft_consensus.cc:2272] T d4932af0fd1f4f8097c506666a195b54 P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.091204  7578 tablet_replica.cc:333] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.092027  7578 raft_consensus.cc:2243] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.092561  7578 raft_consensus.cc:2272] T 1cbf5632da664f5c88b13382f86fbdfe P 005ae7a1e140481db6cc04faeb268d9c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.095645  7578 tablet_replica.cc:333] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.097997  7578 raft_consensus.cc:2243] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.098548  7578 raft_consensus.cc:2272] T 83dcd7668cd44a658ba674d10aa778d9 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.098703  8835 raft_consensus.cc:1275] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:41.100824 13511 consensus_queue.cc:1048] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:41.101353  7578 tablet_replica.cc:333] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.102191  7578 raft_consensus.cc:2243] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.102746  7578 raft_consensus.cc:2272] T 6cda6b7a1dd54b79a208e39c8a0de491 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.105898  7578 tablet_replica.cc:333] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.106629  7578 raft_consensus.cc:2243] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.110090  7578 raft_consensus.cc:2272] T 23ed5434fbd54337b1b9a26153e96d0e P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.113754  7578 tablet_replica.cc:333] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
W20260709 12:11:41.114686  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:41.115316  7578 raft_consensus.cc:2243] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.116098  7578 raft_consensus.cc:2272] T a9173a010c254f6b9fac3f924e38f957 P 005ae7a1e140481db6cc04faeb268d9c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.128644  8832 raft_consensus.cc:1275] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:41.130300 13511 consensus_queue.cc:1048] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:41.134217  7578 tablet_replica.cc:333] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.136099  7578 raft_consensus.cc:2243] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:41.137151  7578 raft_consensus.cc:2272] T a047cca1ee434f14ac79b5f67b7aac73 P 005ae7a1e140481db6cc04faeb268d9c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.139837  7578 tablet_replica.cc:333] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.140563  7578 raft_consensus.cc:2243] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:41.141381  9518 raft_consensus.cc:1275] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:41.141585  7578 raft_consensus.cc:2272] T 5751232c878a452c84d5bd9127abfc1d P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.145646 13492 consensus_queue.cc:1048] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:41.146032  7578 tablet_replica.cc:333] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.147089  7578 raft_consensus.cc:2243] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.149220  7578 raft_consensus.cc:2272] T 93afd25256e34a3b902813af41f349c9 P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:41.187350  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:41.192121  7578 tablet_replica.cc:333] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.193503  7578 raft_consensus.cc:2243] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:41.194633  7578 raft_consensus.cc:2272] T 4ce14b8d8c8a43d48b1570f033c4e64f P 005ae7a1e140481db6cc04faeb268d9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.195113  8653 catalog_manager.cc:5697] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: config changed from index 6 to 7, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:41.197834  7578 tablet_replica.cc:333] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
W20260709 12:11:41.201530  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.210124  7578 raft_consensus.cc:2243] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:41.230479  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:41.248592  8875 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba96dc62a22549a6ab209325db961b36. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:41.251008  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:41.265728  8655 catalog_manager.cc:5697] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 13 to 14, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 14 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.270853  8655 catalog_manager.cc:5697] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 11 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 12 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.282258  7578 raft_consensus.cc:2272] T 63977b2ac46b48f0ba26c573aeeb69fc P 005ae7a1e140481db6cc04faeb268d9c [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:41.281440  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:41.273466  8655 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 6 to 7, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 7 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:41.289058  8872 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:41.305758  8832 raft_consensus.cc:1275] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:41.311851 13524 consensus_queue.cc:1048] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:41.293390  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:41.320662  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.339805  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.359205  7578 tablet_replica.cc:333] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.360016  7578 raft_consensus.cc:2243] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:41.365839  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.368831  7578 raft_consensus.cc:2272] T 1af6a99f3fc34f97a6aead96582b77eb P 005ae7a1e140481db6cc04faeb268d9c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.374457  8830 raft_consensus.cc:1275] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:41.377230 13514 consensus_queue.cc:1048] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.391374  7578 tablet_replica.cc:333] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c: stopping tablet replica
I20260709 12:11:41.392326  7578 raft_consensus.cc:2243] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:11:41.392822  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.395228  7578 raft_consensus.cc:2272] T 6ff15d7fa845498ba3ccd1874ce63ad6 P 005ae7a1e140481db6cc04faeb268d9c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.402091  8902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56294
I20260709 12:11:41.402747  8902 raft_consensus.cc:606] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:11:41.406867  8902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56294
I20260709 12:11:41.407457  8902 raft_consensus.cc:606] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Received request to transfer leadership
W20260709 12:11:41.410904  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:41.412982  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 63389.4us
W20260709 12:11:41.441844  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:41.445112  8832 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:41.448030 13487 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:41.471597  8906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "61fbd5afaa194845917d5b1b04571378"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56294
I20260709 12:11:41.473016  8906 raft_consensus.cc:606] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Received request to transfer leadership
W20260709 12:11:41.490337  8706 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:11:41.490826  8706 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ba96dc62a22549a6ab209325db961b36 already in progress
W20260709 12:11:41.491119  8706 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ba96dc62a22549a6ab209325db961b36 already in progress
I20260709 12:11:41.519207 13490 raft_consensus.cc:993] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: : Instructing follower fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:41.519780 13490 raft_consensus.cc:1081] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Signalling peer fd116b86a1e4445c994a361f776beba1 to start an election
I20260709 12:11:41.525139  8830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36"
dest_uuid: "fd116b86a1e4445c994a361f776beba1"
 from {username='slave'} at 127.0.0.1:52186
I20260709 12:11:41.526719  8830 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:41.527128  8830 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:41.556257  8830 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:41.566358  8830 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:41.567636  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:41.568353  8906 raft_consensus.cc:3055] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:41.568656  8906 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:41.569460  8906 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:41.571084  8906 raft_consensus.cc:3060] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:41.571817  8798 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:41.583774  8906 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 8.
I20260709 12:11:41.585311  8799 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:41.586174 13492 raft_consensus.cc:2804] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:41.586875 13492 raft_consensus.cc:697] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:41.587950 13492 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:41.627959  8655 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 7 to 8, leader changed from 61fbd5afaa194845917d5b1b04571378 (127.7.102.131) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 8 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:41.768730  8726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.903160 13487 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:41.903740 13487 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:41.907760  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:41.917378  8872 leader_election.cc:336] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:41.917886  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:41.923583 13514 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.923341 13487 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:11:41.979100  8801 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899): Couldn't send request to peer eaa6fbd6102948888c362ff1ea0b32e8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba96dc62a22549a6ab209325db961b36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:42.009739 13501 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.010840 13501 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.013176 13501 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.015353  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:42.016047  8903 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:42.016757 13487 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.017328 13487 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.018215  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:42.019433 13501 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.022087  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:11:42.022356  9487 leader_election.cc:336] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:42.023231 13501 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.023726 13501 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:42.024895  8872 leader_election.cc:336] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:42.025354  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:42.019479 13487 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.026180 13490 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.038492 13493 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.040915 13493 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.043143 13493 leader_election.cc:290] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.045854  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:11:42.050064  8798 leader_election.cc:336] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:11:42.050493  8798 leader_election.cc:304] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:42.051185 13488 raft_consensus.cc:2749] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.053471  8903 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:42.073311 13501 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.070182  7578 connection.cc:466] server connection from 127.0.0.1:43816 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43816 (request call id 2594) could send its response
I20260709 12:11:42.087390 13487 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.088181 13487 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.093677 13501 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.093801  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:42.094527  8832 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:42.095371  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:42.095944  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.097792 13490 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.097579 13498 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:42.098251 13490 raft_consensus.cc:493] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.098831 13490 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.105204  8903 raft_consensus.cc:3060] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:42.108603  8872 leader_election.cc:336] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.111990 13487 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:42.120702  9487 connection.cc:573] client connection to 127.7.102.129:39957 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:11:42.144672 13490 raft_consensus.cc:515] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.153947  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe90059a90047969b785a597928a512" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:42.154614  8832 raft_consensus.cc:3060] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.160835  8903 raft_consensus.cc:2468] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:42.163228  9488 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:42.166388 13501 raft_consensus.cc:2804] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.160136 13490 leader_election.cc:290] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.166971 13501 raft_consensus.cc:697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:42.181196  8832 raft_consensus.cc:2468] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:42.187870 13501 consensus_queue.cc:237] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.186844  8874 leader_election.cc:304] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.202634 13446 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.203258 13446 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.204420 13487 raft_consensus.cc:2804] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.204969 13487 raft_consensus.cc:697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:42.205464 13446 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:11:42.213384  8872 leader_election.cc:336] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.221776  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:42.222684  8902 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:42.225426  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:11:42.241109 13525 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.241639 13525 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.242028 13525 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.205862 13487 consensus_queue.cc:237] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:42.267180  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 65016.3us
W20260709 12:11:42.297359  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 97035.6us
I20260709 12:11:42.295490  8655 catalog_manager.cc:5697] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 12 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 13 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.290612 13488 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:42.298959  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 73655.9us
I20260709 12:11:42.300304 13446 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.325152 13446 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.327699 13446 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.304909 13488 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.338495  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:42.349236  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:42.349937  8830 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 9.
W20260709 12:11:42.351069  9487 leader_election.cc:336] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.311018 13487 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
W20260709 12:11:42.363404  9487 leader_election.cc:336] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.365157  9487 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.366698 13488 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.364020 13487 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.357204 13525 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.369498 13487 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.369877 13525 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.408560  8656 catalog_manager.cc:5697] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 12 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 13 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:42.425374  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 71220.8us
W20260709 12:11:42.467075  9487 leader_election.cc:336] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.482769  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 43782.4us
I20260709 12:11:42.489482 13549 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.490603 13549 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.491729 13498 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.492730 13498 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.493660 13549 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.497319  8832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:42.498406  8832 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:42.499835  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
I20260709 12:11:42.501039  8903 raft_consensus.cc:3060] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.525190  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:42.526232  9518 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 9.
I20260709 12:11:42.528661 13555 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.529618 13555 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.532312 13555 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:11:42.534783 13556 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.541641 13514 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.499847 13498 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:42.550359 13514 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.552929 13556 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.555615 13556 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.563002  8874 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.564229  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:11:42.543708  8798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 334 similar messages]
I20260709 12:11:42.565176 13490 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.565771 13490 raft_consensus.cc:493] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.567972 13555 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.568622 13555 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.569273 13555 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.569363 13514 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.568288 13490 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.585268 13555 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.587668 13555 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:42.565510  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 57565.2us
I20260709 12:11:42.591367 13490 raft_consensus.cc:515] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.593099  8903 raft_consensus.cc:2468] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 13.
I20260709 12:11:42.596758 13490 leader_election.cc:290] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.603466  9488 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c
W20260709 12:11:42.596540  8798 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.621184 13524 raft_consensus.cc:2804] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.622330 13524 raft_consensus.cc:697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:42.623786 13524 consensus_queue.cc:237] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.627944  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:42.619907  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:42.633440  9487 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.634121  9487 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.628762  8834 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
I20260709 12:11:42.636714  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:42.637434  8830 raft_consensus.cc:3060] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.642480 13478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35706 (request call id 931) took 4496 ms. Trace:
I20260709 12:11:42.643049 13478 rpcz_store.cc:276] 0709 12:11:38.153248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.153375 (+   127us) service_pool.cc:224] Handling call
0709 12:11:38.291318 (+137943us) ts_tablet_manager.cc:934] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
0709 12:11:42.642176 (+4350858us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44680,"tablet-copy.queue_time_us":119991,"thread_start_us":71794,"threads_started":2}
I20260709 12:11:42.647354  8834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
W20260709 12:11:42.648453  9487 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.652614  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.656549 13554 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.657024 13554 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.657449 13554 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.667598  9489 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:42.668890 13525 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:42.668908  8801 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:42.671114 13561 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.671586 13561 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.672024 13561 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:42.679019  8798 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.679795  8798 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.651079  9487 connection.cc:466] server connection from 127.0.0.1:35706 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35706 (request call id 931) could send its response
I20260709 12:11:42.691006  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:42.703776  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:42.707391  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4932af0fd1f4f8097c506666a195b54" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:42.751293  8902 raft_consensus.cc:2393] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:42.711459 13561 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.712105  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:42.717756 13498 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.756937 13498 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.757776  8826 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa6fbd6102948888c362ff1ea0b32e8 in current term 10: Already voted for candidate fd116b86a1e4445c994a361f776beba1 in this term.
I20260709 12:11:42.759552 13498 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.734432 13550 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.760655 13550 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.761869  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:42.762187  8902 raft_consensus.cc:1275] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:42.763222 13550 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.764016  8835 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:42.766283  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:11:42.767689  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:42.768677 13555 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.741581  8832 raft_consensus.cc:1275] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:42.769452 13555 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.771536 13555 raft_consensus.cc:493] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.772030 13555 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.771654 13552 consensus_queue.cc:1048] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.774907  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:42.775563  9521 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 6.
I20260709 12:11:42.777137  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:11:42.778452  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.779793 13498 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:42.780246 13498 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 005ae7a1e140481db6cc04faeb268d9c)
I20260709 12:11:42.780741 13498 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.784726 13561 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.785779  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:42.786577  9521 raft_consensus.cc:2393] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 10: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:42.786897 13524 consensus_queue.cc:1048] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:42.704437  8830 raft_consensus.cc:2468] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
I20260709 12:11:42.700551 13554 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.794387  8874 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.794726  8905 raft_consensus.cc:2393] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 13: Already voted for candidate 61fbd5afaa194845917d5b1b04571378 in this term.
I20260709 12:11:42.795326 13514 raft_consensus.cc:2804] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.795864 13514 raft_consensus.cc:697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:42.796870 13554 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.797703  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:42.797838 13514 consensus_queue.cc:237] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:11:42.828594  8798 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.804107 13555 raft_consensus.cc:515] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:42.824944  8830 raft_consensus.cc:3060] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.831138 13555 leader_election.cc:290] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:42.831796  9518 raft_consensus.cc:2393] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd116b86a1e4445c994a361f776beba1 in current term 12: Already voted for candidate eaa6fbd6102948888c362ff1ea0b32e8 in this term.
I20260709 12:11:42.835611  8801 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:42.835963  8833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a047cca1ee434f14ac79b5f67b7aac73" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:42.836705  8833 raft_consensus.cc:3060] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:42.845654  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:42.846355  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:42.846794  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:42.829398  8798 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.860323  8798 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.863240  8798 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:42.866137 13561 raft_consensus.cc:2749] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.862731  8833 raft_consensus.cc:2468] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:11:42.861228 13498 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.868547 13569 log.cc:927] Time spent T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:42.870049 13498 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:11:42.865094  8830 raft_consensus.cc:2468] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
W20260709 12:11:42.860493  9487 leader_election.cc:336] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.873318  9489 leader_election.cc:304] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:42.863898  8656 catalog_manager.cc:5697] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 12 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 13 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.874109  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff15d7fa845498ba3ccd1874ce63ad6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:11:42.874913 13563 raft_consensus.cc:2749] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.875433  9518 raft_consensus.cc:3060] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:42.876202  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 60628.5us
I20260709 12:11:42.877617  8799 leader_election.cc:304] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:42.877617  8874 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:42.880331 13487 raft_consensus.cc:2804] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.881017 13487 raft_consensus.cc:697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:42.881440 13563 raft_consensus.cc:2749] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.882431  8872 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.895057 13524 raft_consensus.cc:2804] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.882002 13487 consensus_queue.cc:237] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:42.913144  8799 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:42.914687 13561 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.923128  8798 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:42.907455 13524 raft_consensus.cc:697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:42.926865 13524 consensus_queue.cc:237] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.928213  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:42.930898  9518 raft_consensus.cc:2468] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd116b86a1e4445c994a361f776beba1 in term 7.
I20260709 12:11:42.940560  8801 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:42.941977 13563 raft_consensus.cc:2804] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:42.942898 13563 raft_consensus.cc:697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Becoming Leader. State: Replica: fd116b86a1e4445c994a361f776beba1, State: Running, Role: LEADER
I20260709 12:11:42.944111 13563 consensus_queue.cc:237] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:42.942266  8872 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.950519  8872 leader_election.cc:336] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:42.951514  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:43.001573 13514 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.002238 13514 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:43.005753  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:43.004364 13514 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:43.008999  8872 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:43.012392  8830 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 12.
W20260709 12:11:43.009960  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.022038  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:43.022975 13552 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.023382 13552 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.023729 13552 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.037344 13552 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:43.039541 13552 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:43.041992  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
W20260709 12:11:43.044723  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:43.014230 13563 raft_consensus.cc:493] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.045258  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.058588  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.063340 13563 raft_consensus.cc:515] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:43.069031  8830 raft_consensus.cc:3060] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.071623  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.072909  8656 catalog_manager.cc:5697] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 reported cstate change: term changed from 6 to 7, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to fd116b86a1e4445c994a361f776beba1 (127.7.102.130). New cstate: current_term: 7 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.083613  8653 catalog_manager.cc:5697] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 11 to 12, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 12 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.090021  8903 raft_consensus.cc:1275] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:43.092075 13556 consensus_queue.cc:1048] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:43.106318 13563 leader_election.cc:290] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:11:43.109843  8830 raft_consensus.cc:2468] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 13.
W20260709 12:11:43.112494  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52837.2us
W20260709 12:11:43.113168  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.113731  8872 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:43.116783  8798 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:11:43.127871  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.128499  8872 leader_election.cc:336] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:43.129082  8874 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:43.130142 13487 raft_consensus.cc:2804] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.130733 13487 raft_consensus.cc:697] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:11:43.131830 13487 consensus_queue.cc:237] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:11:43.133148  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9af31792ab541fbb5b308c83cf60c08" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:11:43.138547  8655 catalog_manager.cc:5697] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 12 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 13 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.140415  8655 catalog_manager.cc:5697] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 12 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 13 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.146401  8799 leader_election.cc:304] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:11:43.149260 13563 raft_consensus.cc:2749] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:43.155995  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.164359  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.232757  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.250005  7578 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8781)
I20260709 12:11:43.248555  8655 catalog_manager.cc:5697] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 11 to 13, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 13 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.275981  8830 raft_consensus.cc:1275] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:43.277792 13490 consensus_queue.cc:1048] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:43.298938  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.310539  8834 raft_consensus.cc:1275] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:43.312180 13490 consensus_queue.cc:1048] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:43.326376  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.363013  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.365135  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:43.378113  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:43.381506  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.383097  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.384174  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.406760  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.413662  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:43.420285  8830 raft_consensus.cc:1275] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:43.422976 13555 consensus_queue.cc:1048] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:43.426196  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:43.438396  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.449880  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:43.515010  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.536341  9521 raft_consensus.cc:1275] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:43.538371 13488 consensus_queue.cc:1048] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:43.595639  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.642797 13584 ts_tablet_manager.cc:933] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Initiating tablet copy from peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:11:43.645861  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.655019  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:43.662180 13584 tablet_copy_client.cc:323] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.102.130:34317
I20260709 12:11:43.664820  8844 tablet_copy_service.cc:140] P fd116b86a1e4445c994a361f776beba1: Received BeginTabletCopySession request for tablet ba96dc62a22549a6ab209325db961b36 from peer eaa6fbd6102948888c362ff1ea0b32e8 ({username='slave'} at 127.0.0.1:35550)
I20260709 12:11:43.665560  8844 tablet_copy_service.cc:161] P fd116b86a1e4445c994a361f776beba1: Beginning new tablet copy session on tablet ba96dc62a22549a6ab209325db961b36 from peer eaa6fbd6102948888c362ff1ea0b32e8 at {username='slave'} at 127.0.0.1:35550: session id = eaa6fbd6102948888c362ff1ea0b32e8-ba96dc62a22549a6ab209325db961b36
I20260709 12:11:43.678459  8830 raft_consensus.cc:1275] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.680193 13490 consensus_queue.cc:1048] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:43.688572  8844 tablet_copy_source_session.cc:215] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:43.693198 13584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba96dc62a22549a6ab209325db961b36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:43.764501  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.756476 13584 tablet_copy_client.cc:806] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:43.769165 13584 tablet_copy_client.cc:670] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Starting download of 1 WAL segments...
W20260709 12:11:43.772464  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:43.774693 13584 tablet_copy_client.cc:538] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:11:43.802165  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:43.808209 13584 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap starting.
W20260709 12:11:43.834076  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.915083  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.917564  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:43.958634 13584 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:43.960139 13584 tablet_bootstrap.cc:492] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Bootstrap complete.
I20260709 12:11:43.961079 13584 ts_tablet_manager.cc:1403] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent bootstrapping tablet: real 0.157s	user 0.042s	sys 0.017s
I20260709 12:11:43.964910 13584 raft_consensus.cc:359] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
W20260709 12:11:43.973803  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.985023  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:43.985531  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:43.974023 13584 raft_consensus.cc:740] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Initialized, Role: LEARNER
I20260709 12:11:44.004803 13584 consensus_queue.cc:260] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: NON_VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: true } }
I20260709 12:11:44.035458 13584 ts_tablet_manager.cc:1434] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:11:44.037503  8844 tablet_copy_service.cc:342] P fd116b86a1e4445c994a361f776beba1: Request end of tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-ba96dc62a22549a6ab209325db961b36 received from {username='slave'} at 127.0.0.1:35550
I20260709 12:11:44.038110  8844 tablet_copy_service.cc:434] P fd116b86a1e4445c994a361f776beba1: ending tablet copy session eaa6fbd6102948888c362ff1ea0b32e8-ba96dc62a22549a6ab209325db961b36 on tablet ba96dc62a22549a6ab209325db961b36 with peer eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:11:44.041903  9521 raft_consensus.cc:1217] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEARNER]: Deduplicated request from leader. Original: 7.6->[8.7-8.7]   Dedup: 8.7->[]
W20260709 12:11:44.065416  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:44.089311  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:44.090600  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:44.250555  7578 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8781)
I20260709 12:11:44.447713 13524 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.448343 13524 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:44.461470  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1" is_pre_election: true
I20260709 12:11:44.462278  8830 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
I20260709 12:11:44.464888  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 
I20260709 12:11:44.465847 13556 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.466305 13556 raft_consensus.cc:493] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.466710 13556 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:44.473189  9487 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:44.475183 13524 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:44.522814 13556 raft_consensus.cc:515] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:44.547569 13556 leader_election.cc:290] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Requested vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:11:44.550532  8830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883fe3a6d9a747ed8f95a683702eb669" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd116b86a1e4445c994a361f776beba1"
I20260709 12:11:44.553822  8830 raft_consensus.cc:3060] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.563257 13561 raft_consensus.cc:1064] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: attempting to promote NON_VOTER eaa6fbd6102948888c362ff1ea0b32e8 to VOTER
I20260709 12:11:44.567162 13561 consensus_queue.cc:237] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:11:44.570235  9487 leader_election.cc:336] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:11:44.578799  8830 raft_consensus.cc:2468] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
I20260709 12:11:44.580287  9489 leader_election.cc:304] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c
I20260709 12:11:44.581442 13556 raft_consensus.cc:2804] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:44.581971 13556 raft_consensus.cc:697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:11:44.583248 13556 consensus_queue.cc:237] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:11:44.616115  9521 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEARNER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:44.625290  8903 raft_consensus.cc:1275] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Refusing update from remote peer fd116b86a1e4445c994a361f776beba1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:44.626622 13563 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:44.630736  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:44.642215 13561 consensus_queue.cc:1048] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:44.642383  8655 catalog_manager.cc:5697] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 9 to 11, leader changed from 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 11 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:44.724759 13563 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 5 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:44.729982  9521 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
I20260709 12:11:44.808354  8653 catalog_manager.cc:5697] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 reported cstate change: config changed from index 5 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "fd116b86a1e4445c994a361f776beba1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:44.823238  8903 raft_consensus.cc:2955] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } } }
W20260709 12:11:44.952791  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.088894  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.195825  8826 raft_consensus.cc:1275] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:45.199014 13598 consensus_queue.cc:1048] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:45.202030  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:45.251134  7578 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:45.267607  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:45.289979  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.334349  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.386708  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.405149  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.476964  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.483908  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.494082  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:45.542169  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.611769  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.721616  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.730970  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.749645  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.760185  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.819231  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.823860  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.827565  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.828755  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:45.865127  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.876603  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.876824  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:45.892405  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.909281  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:45.915989  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.042812  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:46.048525  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:46.055301  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:46.055917  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.097239  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:46.157034  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:46.157595  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.238065  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 101780us
W20260709 12:11:46.244318  8875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 104084us
W20260709 12:11:46.251621  7578 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:46.288579  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:46.289621  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.310418  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 69987.1us
W20260709 12:11:46.399372  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.400714  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.403692  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.419473  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.484678  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.495075  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.544349  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:46.711123  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:46.744046  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:46.807186  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:46.859524  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:46.986183  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:47.252414  7578 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:47.517546  9487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 490 similar messages]
W20260709 12:11:47.525539  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.526439  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:47.557947  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:47.605149  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:47.643966  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:47.683393  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:47.747854  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:47.770884  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:47.819927  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:47.986012  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.062214  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.096223  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.118263  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.166925  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.188555  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.194059  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.195155  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.226646  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.233192  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.252925  7578 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:48.303362  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.320556  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.344113  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.367902  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.473918  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.476393  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.487658  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.546712  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.592309  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.605381  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.613024  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.646589  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.659696  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.695298  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.703969  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:48.731719  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:48.802305  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.835886  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.873822  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:48.896358  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:49.023422  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:49.048352  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.070050  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:49.107468  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:49.110419  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:49.118229  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:49.202633  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:49.253525  7578 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:49.388571  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:49.485958  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:49.875798  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.963617  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.040518  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:50.128151  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.157469  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.246562  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:50.254055  7578 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:50.303318  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.419903  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.443138  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:50.511643  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.512319  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.547801  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.660534  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.666973  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.683104  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.721943  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.756155  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.793308  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.795576  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:50.797477  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.797744  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.837702  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.844798  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:50.953069  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.040833  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.076515  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.091573  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.097348  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.129127  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.143595  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.180220  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.186196  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.217988  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.250262  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.254590  7578 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:51.258773  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.309055  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.310405  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.349224  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.374886  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:51.488372  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:51.593454  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.605252  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:51.634064  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:51.743225  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.780783  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.900033  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:51.907224  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:52.062551  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:52.086828  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 53322.8us
W20260709 12:11:52.219692  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.255121  7578 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:52.524484  8872 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 475 similar messages]
W20260709 12:11:52.824857  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 275167us
W20260709 12:11:52.885538  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:52.941329  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:52.967875  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:53.064266  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.174002  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.232615  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.233208  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.256022  7578 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:53.325848  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.327059  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.382155  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.389401  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.406234  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.408406  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.409073  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.409938  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.410743  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.424700  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.443158  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.492329  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.521987  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.529035  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.575470  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.599828  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.611369  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.635330  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.722395  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.744406  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.751798  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:53.756388  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.789681  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.791772  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.863451  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.865183  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.913697  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:53.939378  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.987052  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:53.993013  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.067801  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.070326  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:54.256564  7578 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:54.289350  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.316473  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.348898  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.441766  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.483283  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:54.532442  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:54.690986  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:54.740773  8801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:32899, user_credentials={real_user=slave}} blocked reactor thread for 58647.7us
W20260709 12:11:54.958778  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:55.210471  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.257119  7578 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:55.352213  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:55.444196  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.500259  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:55.549189  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 55187.5us
W20260709 12:11:55.612663  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.646629  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.679260  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.680015  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.702178  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.708884  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.740476  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.776047  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.782925  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.796221  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:55.815490  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.866420  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.873766  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:55.884605  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:55.894834  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.061430  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.062290  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.079262  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.107203  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:56.118230  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.139321  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.146498  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.168615  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.170917  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.202961  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.225229  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.235322  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.257740  7578 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:56.375051  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.395642  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.407114  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.493538  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.523758  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.532596  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:56.565840  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.638013  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.716606  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:56.826514  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:56.863965  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:57.013000  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:57.053705  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:57.100956  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:57.108690  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:57.258277  7578 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:57.285650  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:57.435875  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 81425.6us
W20260709 12:11:57.455240  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:57.478864  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:57.527792  8872 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260709 12:11:57.982082  9489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 201214us
W20260709 12:11:58.029237  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 48856.6us
W20260709 12:11:58.033584  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.040313  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.111763  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.159416  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:58.162359  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.168892  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.246450  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.258843  7578 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:58.276525  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.332716  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.342329  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.353958  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.357877  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.420531  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.425232  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.451610  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.457841  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.458465  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.470983  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.521092  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.536037  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.645891  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:58.651475  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.668618  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.680035  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.719233  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.727353  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.740980  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.768365  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.800159  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:58.802753  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.804255  8930 debug-util.cc:398] Leaking SignalData structure 0x7b08003486c0 after lost signal to thread 7581
W20260709 12:11:58.805706  8930 debug-util.cc:398] Leaking SignalData structure 0x7b080016d1e0 after lost signal to thread 8692
W20260709 12:11:58.807055  8930 debug-util.cc:398] Leaking SignalData structure 0x7b0800329400 after lost signal to thread 8859
W20260709 12:11:58.808156  8930 debug-util.cc:398] Leaking SignalData structure 0x7b0800307900 after lost signal to thread 8933
W20260709 12:11:58.812549  8930 debug-util.cc:398] Leaking SignalData structure 0x7b08003454e0 after lost signal to thread 9549
W20260709 12:11:58.943245  7583 debug-util.cc:398] Leaking SignalData structure 0x7b080038c080 after lost signal to thread 9489
W20260709 12:11:58.949601  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:58.995332  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.037279  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.037942  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:59.105772  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:59.127346  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.147959  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:59.179976  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.203449  9488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 54365.1us
W20260709 12:11:59.251549  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.259502  7578 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 8781)
W20260709 12:11:59.332569  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:59.372112  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.455050  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.519053  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:11:59.557791  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.708771  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.709272  8798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 59770.4us
W20260709 12:11:59.859760  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:11:59.912192  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:11:59.982259  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:00.259994  7578 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 8781)
W20260709 12:12:00.259789  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:00.450443  8798 consensus_peers.cc:597] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:00.572558  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.661387  8798 consensus_peers.cc:597] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.688709  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.736469  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.783417  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.788424  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.813118  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.853929  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:00.885262  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.895480  8798 consensus_peers.cc:597] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.946169  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.971318  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.997267  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:00.998018  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.036580  8798 consensus_peers.cc:597] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.050117  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.081396  8798 consensus_peers.cc:597] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.096041  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.117053  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.140019  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.141860  8798 consensus_peers.cc:597] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.153735  8798 consensus_peers.cc:597] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.184036  8798 consensus_peers.cc:597] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.261782  8798 consensus_peers.cc:597] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:01.339057  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:01.343715  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.443642  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:01.449357  7578 tablet_server.cc:196] TabletServer@127.7.102.129:0 shutdown complete.
W20260709 12:12:01.499006  8798 consensus_peers.cc:597] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.519490  8798 consensus_peers.cc:597] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:01.536408  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:01.580855  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:01.655198  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:01.664510  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:01.686720  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:01.816167  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.834750  8798 consensus_peers.cc:597] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:01.862345  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:01.887953  7578 tablet_server.cc:179] TabletServer@127.7.102.130:0 shutting down...
W20260709 12:12:01.896842  8874 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:01.928316  9489 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:01.933930  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:01.935609  9489 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:01.940441  9489 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:01.982216  8874 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:01.996429  8874 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.005414  8874 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.014544  9489 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.090061  9489 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.096148  9489 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.114403  8798 consensus_peers.cc:597] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:02.129030  8798 consensus_peers.cc:597] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:02.120461  8874 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.143188  8874 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.148146  8874 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.166805  8874 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.168008  8874 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.177513  8874 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.190111  8798 consensus_peers.cc:597] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:02.194756  8799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:39537, user_credentials={real_user=slave}} blocked reactor thread for 88204us
W20260709 12:12:02.201628  8874 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.206947  8874 consensus_peers.cc:597] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.207710  8874 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.209141  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:02.221022  9489 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.223502  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:02.258196  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:12:02.262212  8874 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.277472  7578 tablet_replica.cc:333] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.281917  7578 raft_consensus.cc:2243] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.283452  7578 raft_consensus.cc:2272] T 6479206f1d4545ec83633cfa7a99b648 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.298306  7578 tablet_replica.cc:333] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.299403  7578 raft_consensus.cc:2243] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.309289  7578 raft_consensus.cc:2272] T 2947e409c3964d228748bbb8d2e40832 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.312574  7578 tablet_replica.cc:333] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.313625  7578 raft_consensus.cc:2243] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.314325  7578 raft_consensus.cc:2272] T a342b86867884bfaa83a903e1502daaa P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.317744  7578 tablet_replica.cc:333] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.326572  7578 raft_consensus.cc:2243] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.328929  7578 raft_consensus.cc:2272] T 10825d3a2b3b4d21bb372d5172d112eb P fd116b86a1e4445c994a361f776beba1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.332355  7578 tablet_replica.cc:333] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:02.336548  8874 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.340071  7578 raft_consensus.cc:2243] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.344983  7578 raft_consensus.cc:2272] T 93fd9eae511442cda809efae9c60a8dd P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.348464  7578 tablet_replica.cc:333] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.360973  7578 raft_consensus.cc:2243] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.361764  7578 raft_consensus.cc:2272] T 0982edf61b2c41e6b7c3414f279d4f31 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.387768  7578 tablet_replica.cc:333] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:02.390008  9489 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.395267  9489 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.396764  7578 raft_consensus.cc:2243] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.400555  7578 raft_consensus.cc:2272] T efe90059a90047969b785a597928a512 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.408082  7578 tablet_replica.cc:333] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.409137  7578 raft_consensus.cc:2243] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.418926  7578 raft_consensus.cc:2272] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:02.424088  8874 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.425017  7578 tablet_replica.cc:333] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.433418  7578 raft_consensus.cc:2243] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.434337  7578 raft_consensus.cc:2272] T 98ff6a40f13a4be9b4a05ca797f8fd52 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.437608  7578 tablet_replica.cc:333] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.438555  7578 raft_consensus.cc:2243] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.439872  7578 raft_consensus.cc:2272] T 67e3054fb6044180b7de9b761b2ea05b P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.447937  7578 tablet_replica.cc:333] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.452382  7578 raft_consensus.cc:2243] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:02.454443  8874 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.461697  8874 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.463057  7578 raft_consensus.cc:2272] T 12a516db16ef4c1bae0d02a9c8d29be4 P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.466325  7578 tablet_replica.cc:333] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:02.470094  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:02.475327  7578 raft_consensus.cc:2243] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:02.476876  9489 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.497176  7578 raft_consensus.cc:2272] T d9af31792ab541fbb5b308c83cf60c08 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.500087  7578 tablet_replica.cc:333] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.501039  7578 raft_consensus.cc:2243] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:02.477406  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:02.501775  7578 raft_consensus.cc:2272] T d412a1e35a1a4f75b3628a5642ddd121 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:02.517735  9489 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.509255  7578 tablet_replica.cc:333] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.533656  7578 raft_consensus.cc:2243] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.534608  7578 raft_consensus.cc:2272] T 78cfd04e1cc248b9b904175f207f3f40 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.538197  7578 tablet_replica.cc:333] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:02.538993  8798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 506 similar messages]
I20260709 12:12:02.539463  7578 raft_consensus.cc:2243] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.540227  7578 raft_consensus.cc:2272] T 4f78b2d2f5154e388ca8e35799e1afeb P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.544546  7578 tablet_replica.cc:333] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:02.552085  9489 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.560217  7578 raft_consensus.cc:2243] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:12:02.561019  9489 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.562449  7578 raft_consensus.cc:2272] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.570348  7578 tablet_replica.cc:333] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.578068  7578 raft_consensus.cc:2243] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.586025  7578 raft_consensus.cc:2272] T 69ecd2fc45134ac8a031c2a6f90284d7 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.590837  7578 tablet_replica.cc:333] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.591832  7578 raft_consensus.cc:2243] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:12:02.596454  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:02.610265  7578 raft_consensus.cc:2272] T d0e4c6e5758d4fb18617b5b7c30cd334 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:02.615969  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:02.618710  7578 tablet_replica.cc:333] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.629515  7578 raft_consensus.cc:2243] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.632323  7578 raft_consensus.cc:2272] T e45c621a9c684915a4c110e0801e4efa P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.635807  7578 tablet_replica.cc:333] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.636874  7578 raft_consensus.cc:2243] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.638106  7578 raft_consensus.cc:2272] T 0dd6228ae6144924a1ddc7362f86742d P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.641285  7578 tablet_replica.cc:333] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.660260  7578 raft_consensus.cc:2243] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.661890  7578 raft_consensus.cc:2272] T 2ea14ea70b8b462ca548019b513f4211 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.669586  7578 tablet_replica.cc:333] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.672493  7578 raft_consensus.cc:2243] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.697062  7578 raft_consensus.cc:2272] T ba96dc62a22549a6ab209325db961b36 P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.700737  7578 tablet_replica.cc:333] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.701772  7578 raft_consensus.cc:2243] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.763696  7578 raft_consensus.cc:2272] T 83dcd7668cd44a658ba674d10aa778d9 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.770191  7578 tablet_replica.cc:333] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.773808  7578 raft_consensus.cc:2243] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.780182  7578 raft_consensus.cc:2272] T 6cda6b7a1dd54b79a208e39c8a0de491 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.816092  7578 tablet_replica.cc:333] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.821046  7578 raft_consensus.cc:2243] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.842237  7578 raft_consensus.cc:2272] T 56a6b1a7ca5440f18f286ddd5e44afce P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.853801  7578 tablet_replica.cc:333] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.864457 13684 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:02.868940 13684 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:02.877655  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:02.887394 13684 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:02.890669  7578 raft_consensus.cc:2243] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:02.909047  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:02.921742  7578 raft_consensus.cc:2272] T 5f3efa45bd1e40c79e9873e78f82e8e6 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:02.932219  7578 tablet_replica.cc:333] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:02.978152  7578 raft_consensus.cc:2243] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:02.959138  8799 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:02.981580 13650 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.008200 13686 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:02.980433  7578 raft_consensus.cc:2272] T 412fc8b910864ab39eda6a2eaa63b886 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.009258 13686 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.023129 13684 raft_consensus.cc:493] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.024133 13684 raft_consensus.cc:515] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.040292 13684 leader_election.cc:290] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:03.041152  8798 leader_election.cc:336] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.043322  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:03.043648 13686 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.059028 13686 raft_consensus.cc:493] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.059871 13686 raft_consensus.cc:515] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.064780  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.066437  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431583fc4c754d42936c71ee0279ae80" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.068555  7578 tablet_replica.cc:333] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.069846 13686 leader_election.cc:290] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:03.074254  8798 leader_election.cc:336] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.077028  7578 raft_consensus.cc:2243] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.082590  7578 raft_consensus.cc:2272] T ec2ab93c6c3448edaa2bb2569cfd970b P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.086831  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b5e15f0c384f1e8ed394830c71cd90" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.089044  8799 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:03.090428  8799 leader_election.cc:304] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:03.091611  7578 tablet_replica.cc:333] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.092779 13686 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:03.092887  7578 raft_consensus.cc:2243] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.093909 13686 raft_consensus.cc:2749] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:03.095299  7578 raft_consensus.cc:2272] T d70cbe0e284f4df0aca5c9f02140ce70 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.091663  8799 leader_election.cc:304] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:03.097783 13650 raft_consensus.cc:2749] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.098670  7578 tablet_replica.cc:333] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.099833  7578 raft_consensus.cc:2243] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.101305  7578 raft_consensus.cc:2272] T f12377056e86440fb6f80fe02bb59fe1 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.105295  7578 tablet_replica.cc:333] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.107093  7578 raft_consensus.cc:2243] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.108036  7578 raft_consensus.cc:2272] T 883fe3a6d9a747ed8f95a683702eb669 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.111917  7578 tablet_replica.cc:333] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.113219  7578 raft_consensus.cc:2243] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.114250  7578 raft_consensus.cc:2272] T d4932af0fd1f4f8097c506666a195b54 P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.118774  7578 tablet_replica.cc:333] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.119982  7578 raft_consensus.cc:2243] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.122212  7578 raft_consensus.cc:2272] T 1cbf5632da664f5c88b13382f86fbdfe P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.127665  7578 tablet_replica.cc:333] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.132073  7578 raft_consensus.cc:2243] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:03.132990  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.134456  7578 raft_consensus.cc:2272] T 431583fc4c754d42936c71ee0279ae80 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.138492  7578 tablet_replica.cc:333] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.139590  7578 raft_consensus.cc:2243] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:03.140261 13650 raft_consensus.cc:670] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:12:03.145483  7578 raft_consensus.cc:2272] T 4c57fe22a6bf47dca31c488f82e72a1f P fd116b86a1e4445c994a361f776beba1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.152354  7578 tablet_replica.cc:333] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.169570  7578 raft_consensus.cc:2243] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.171545  7578 raft_consensus.cc:2272] T cac426ada8f6447ebc8beff698a38039 P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.175455  7578 tablet_replica.cc:333] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.193457  7578 raft_consensus.cc:2243] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.194761  7578 raft_consensus.cc:2272] T 92b5e15f0c384f1e8ed394830c71cd90 P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.196460 13650 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.197140 13650 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.198660  7578 tablet_replica.cc:333] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.199874  7578 raft_consensus.cc:2243] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.200377  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.200810 13650 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.209522  7578 raft_consensus.cc:2272] T 73c6f055a4f7416ab87d6ba45b619ef8 P fd116b86a1e4445c994a361f776beba1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.204305  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7127014b11f244fc9da3cde4600ec6a6" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:03.211477  8801 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:03.213095 13650 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:03.220080  7578 tablet_replica.cc:333] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
W20260709 12:12:03.220861  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.221360  7578 raft_consensus.cc:2243] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.223405  7578 raft_consensus.cc:2272] T 16a04653cca743d0966d20df2225c35d P fd116b86a1e4445c994a361f776beba1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.227443 13650 raft_consensus.cc:493] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.238818 13650 raft_consensus.cc:515] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.243233  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93afd25256e34a3b902813af41f349c9" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.248525 13650 leader_election.cc:290] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:03.251832  8798 leader_election.cc:336] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.252327  8798 leader_election.cc:304] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:03.254480 13650 raft_consensus.cc:2749] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:03.255262  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.262363 13650 raft_consensus.cc:493] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.263120 13650 raft_consensus.cc:515] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.267036  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5751232c878a452c84d5bd9127abfc1d" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:12:03.267805  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.272037  8798 leader_election.cc:336] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.272482  8798 leader_election.cc:304] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:03.273372 13684 raft_consensus.cc:2749] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.280329 13650 leader_election.cc:290] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:03.281848  7578 tablet_replica.cc:333] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.283826  7578 raft_consensus.cc:2243] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.288688  7578 raft_consensus.cc:2272] T 23ed5434fbd54337b1b9a26153e96d0e P fd116b86a1e4445c994a361f776beba1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.301371  7578 tablet_replica.cc:333] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.304888  7578 raft_consensus.cc:2243] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.305989  7578 raft_consensus.cc:2272] T 63977b2ac46b48f0ba26c573aeeb69fc P fd116b86a1e4445c994a361f776beba1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.315241  7578 tablet_replica.cc:333] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.318302  7578 raft_consensus.cc:2243] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.327772  7578 raft_consensus.cc:2272] T 6ff15d7fa845498ba3ccd1874ce63ad6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.331118 13650 raft_consensus.cc:493] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:03.331776 13650 raft_consensus.cc:515] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.335726  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6a99f3fc34f97a6aead96582b77eb" candidate_uuid: "fd116b86a1e4445c994a361f776beba1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
W20260709 12:12:03.344410  8798 leader_election.cc:336] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.345371 13650 leader_election.cc:290] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:03.346055  8799 leader_election.cc:304] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd116b86a1e4445c994a361f776beba1; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:03.347822 13650 raft_consensus.cc:2749] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:03.349584  7578 tablet_replica.cc:333] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.350626  7578 raft_consensus.cc:2243] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.351478  7578 raft_consensus.cc:2272] T a047cca1ee434f14ac79b5f67b7aac73 P fd116b86a1e4445c994a361f776beba1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.355165  7578 tablet_replica.cc:333] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.356242  7578 raft_consensus.cc:2243] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.357071  7578 raft_consensus.cc:2272] T 7127014b11f244fc9da3cde4600ec6a6 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.361814  7578 tablet_replica.cc:333] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.362890  7578 raft_consensus.cc:2243] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.364850  7578 raft_consensus.cc:2272] T 5751232c878a452c84d5bd9127abfc1d P fd116b86a1e4445c994a361f776beba1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.368827  7578 tablet_replica.cc:333] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.369635  7578 raft_consensus.cc:2243] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.370612  7578 raft_consensus.cc:2272] T 93afd25256e34a3b902813af41f349c9 P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.377667  7578 tablet_replica.cc:333] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.378475  7578 raft_consensus.cc:2243] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.380124  7578 raft_consensus.cc:2272] T 01a81765aa0b4241bacb910d72fb71cb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.383649  7578 tablet_replica.cc:333] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.384449  7578 raft_consensus.cc:2243] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.391892  7578 raft_consensus.cc:2272] T 59b21cd8e1b445658842748734f3cc01 P fd116b86a1e4445c994a361f776beba1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.395633  7578 tablet_replica.cc:333] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1: stopping tablet replica
I20260709 12:12:03.396473  7578 raft_consensus.cc:2243] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.397511  7578 raft_consensus.cc:2272] T 1af6a99f3fc34f97a6aead96582b77eb P fd116b86a1e4445c994a361f776beba1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:03.405185  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.423583  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.555063  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.558252  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.565608  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.571390  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.573200  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.578159 13668 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.578861 13668 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.581277 13668 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:03.583168  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:03.597959 13677 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.599470 13677 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.598670 13687 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.600662 13687 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.603145 13687 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:03.605319 13677 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:03.623893  8874 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:03.628561  9489 leader_election.cc:336] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.630527  9489 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:03.629840  8872 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:03.629411  8874 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.631206 13668 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.633203 13668 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:03.639971  9487 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.641160 13668 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:03.641711  8872 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.646065 13669 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.648594 13690 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:03.649914  8872 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.652478  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.653306 13690 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:03.654503  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:03.666324  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:03.673693  9489 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.675128  9489 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:03.676211  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.677443 13669 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:03.704291  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.721625 13677 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.722378 13677 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.728426  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:12:03.730567  8874 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.730882 13677 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.731154  8874 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.732395 13677 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:03.737993 13677 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.738719 13677 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.741201 13677 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:03.746960  8874 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:03.754465  8872 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:03.788995  8872 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.789574  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.793277 13690 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.793955 13690 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.799288  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:03.799961  9522 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 15.
I20260709 12:12:03.800822 13687 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.801442 13687 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.803591 13687 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.804076 13690 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.806346  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:03.807757 13677 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:03.808956  8874 leader_election.cc:336] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.812767  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:12:03.818087  8874 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.818385 13690 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.818699  8874 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.822642 13687 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.819413 13690 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.823633 13690 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.849581 13669 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.850473 13669 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.856891 13669 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:03.863294  9489 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:03.892920  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:03.906008 13687 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.907012 13687 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:03.926602 13690 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:03.952677  8874 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.933184 13687 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:03.940498  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:03.953626 13689 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.978435 13689 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.954650 13690 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:12:03.930011  9487 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:03.981586  9487 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:03.961254  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10825d3a2b3b4d21bb372d5172d112eb" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:12:03.984040 13669 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.983851  9522 raft_consensus.cc:3060] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.982767  9487 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 52833us
I20260709 12:12:03.992748 13682 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:03.982292 13689 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:03.993721 13682 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:03.999053 13682 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:04.235869  9522 raft_consensus.cc:2468] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 16.
I20260709 12:12:04.287637  8903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:04.288470  8903 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 10.
W20260709 12:12:04.294783  8874 connection.cc:769] client connection to 127.7.102.130:34317 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:04.295400  8874 leader_election.cc:336] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:04.310941  8872 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.311502  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.312580 13689 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.314733 13677 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.315315 13677 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.319319 13677 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:04.337920 13693 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.338917 13693 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:04.347010 13693 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:04.347514 13689 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.353166 13689 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:04.356109 13689 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:04.371786  8872 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:04.372561  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:04.374305  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:04.375022  9522 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:12:04.376820  8875 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.377511  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:04.378185 13690 raft_consensus.cc:2804] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.378360  9516 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:12:04.378859 13690 raft_consensus.cc:697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 16 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:12:04.380141 13690 consensus_queue.cc:237] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:04.393106  8874 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.393803  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.394958 13689 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:04.395485  8874 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:04.373605  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:04.398268  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:04.399904  8875 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:12:04.401259 13689 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:04.401695 13689 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.402099 13689 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:04.408241  9489 connection.cc:769] client connection to 127.7.102.130:34317 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:12:04.412374 13689 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:04.425765  8874 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:04.426657  8874 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.426561  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8"
I20260709 12:12:04.427366  9516 raft_consensus.cc:3060] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:04.427668  8874 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.430424 13689 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:12:04.432092  8872 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.432606  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.433413 13690 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:04.434633  8872 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.435079  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.435882 13690 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.437489 13682 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.438242 13682 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.441362 13682 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:04.437520  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:04.443820  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:04.452915  8874 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:04.454651  9489 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.443251  9516 raft_consensus.cc:2468] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 11.
I20260709 12:12:04.456934  8875 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.458082 13690 raft_consensus.cc:2804] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:04.458647 13690 raft_consensus.cc:697] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Becoming Leader. State: Replica: 61fbd5afaa194845917d5b1b04571378, State: Running, Role: LEADER
I20260709 12:12:04.459645 13690 consensus_queue.cc:237] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.465476  8905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:04.466327  8905 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
I20260709 12:12:04.468086 13695 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.468880 13695 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.476240 13689 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.479278 13695 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:04.475801  8655 catalog_manager.cc:5697] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 15 to 16, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 16 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:04.480917  9487 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.477944 13689 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:04.484269  9487 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.485898 13689 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:04.491526 13695 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.492285 13695 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.495249 13695 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:12:04.492771 13682 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:04.488731  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:04.500698 13690 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.501363 13690 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:12:04.511691  9489 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.512773 13690 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:04.510108  8874 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:04.516716  8872 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.519454  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:04.516510  8874 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.521013  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:04.527793 13690 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.528045  8901 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 11.
W20260709 12:12:04.523386  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:04.522488  9489 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.529670  9488 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 
I20260709 12:12:04.530467 13668 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.530817 13668 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.531193 13668 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.532226  9489 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:04.532927  9489 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:04.533574  9489 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.541644 13668 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:04.542915  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:04.553453  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378"
W20260709 12:12:04.553682  9487 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:04.547513  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:04.554250  8901 raft_consensus.cc:3060] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.550114  8874 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.554297  9487 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.556818 13695 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:04.559376  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:04.562511  8872 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.563023  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:04.563190  9489 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.563942 13690 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.564785 13668 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Requested vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:04.568734 13690 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.569330 13690 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:04.571841 13690 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:04.574137  8901 raft_consensus.cc:2468] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 12.
I20260709 12:12:04.577817  9488 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: fd116b86a1e4445c994a361f776beba1
W20260709 12:12:04.578127  9487 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.585413  9487 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:04.580864  8874 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:04.581591 13668 raft_consensus.cc:2804] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:12:04.584897  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:04.589257 13668 raft_consensus.cc:697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Becoming Leader. State: Replica: eaa6fbd6102948888c362ff1ea0b32e8, State: Running, Role: LEADER
I20260709 12:12:04.589500 13695 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:12:04.592887  8872 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:04.593509  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:04.593502 13668 consensus_queue.cc:237] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:04.594755 13690 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:04.624761  9489 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.625699  8656 catalog_manager.cc:5697] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 reported cstate change: term changed from 11 to 12, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132). New cstate: current_term: 12 leader_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.638509  8655 catalog_manager.cc:5697] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 reported cstate change: term changed from 10 to 11, leader changed from fd116b86a1e4445c994a361f776beba1 (127.7.102.130) to 61fbd5afaa194845917d5b1b04571378 (127.7.102.131). New cstate: current_term: 11 leader_uuid: "61fbd5afaa194845917d5b1b04571378" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:04.667358  8874 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:04.776778  8874 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.800212  9521 raft_consensus.cc:1275] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:04.801422 13689 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:04.802050 13689 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:12:04.802577  8874 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:04.803258  8874 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.811866 13693 consensus_queue.cc:1048] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:06.131237  8930 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6760 after lost signal to thread 7581
W20260709 12:12:06.132891  8930 debug-util.cc:398] Leaking SignalData structure 0x7b0800355fe0 after lost signal to thread 8692
W20260709 12:12:06.138126  8930 debug-util.cc:398] Leaking SignalData structure 0x7b080035f320 after lost signal to thread 8933
W20260709 12:12:06.169121  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08002802e0 after lost signal to thread 7581
W20260709 12:12:06.213447  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800255020 after lost signal to thread 8692
W20260709 12:12:06.214433  8689 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad080 after lost signal to thread 8859
W20260709 12:12:06.216100  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800034420 after lost signal to thread 8933
W20260709 12:12:06.332609  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800331500 after lost signal to thread 9549
W20260709 12:12:06.336069  7578 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8856)
I20260709 12:12:06.337050 13705 raft_consensus.cc:493] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.264271 13703 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.343664 13705 raft_consensus.cc:515] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.343763 13703 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.346741 13705 leader_election.cc:290] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.347005 13703 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.350067 13689 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.368829 13708 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:06.369710 13708 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.372874 13708 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:06.379020 13687 raft_consensus.cc:493] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.379581 13687 raft_consensus.cc:515] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.380595 13689 raft_consensus.cc:493] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.381467 13689 raft_consensus.cc:515] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.382135 13687 leader_election.cc:290] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.384209 13689 leader_election.cc:290] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:12:06.374200  8874 leader_election.cc:336] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.376374 13705 raft_consensus.cc:493] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
W20260709 12:12:06.386214  8874 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.387076  8874 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.387650  8874 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.388187  8874 consensus_peers.cc:597] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.388561  8874 consensus_peers.cc:597] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.388942  8874 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.389290  8874 consensus_peers.cc:597] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.389750  8874 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.390226  8874 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.390618  8874 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.391003  8874 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.391391  8874 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.391769  8874 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.392165  8874 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.392351 13712 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:06.392942 13712 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.377802 13711 raft_consensus.cc:493] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.330857 13707 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.395740 13707 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.395514 13711 raft_consensus.cc:515] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.378332 13709 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.397274 13709 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.397850 13707 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.399807 13709 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.400923 13709 raft_consensus.cc:493] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.401770 13709 raft_consensus.cc:515] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.386298 13705 raft_consensus.cc:515] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.404604 13709 leader_election.cc:290] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.406329 13705 leader_election.cc:290] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.408551 13689 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.385842 13703 raft_consensus.cc:493] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.409580 13689 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.412479 13689 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.402634 13711 leader_election.cc:290] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.415871 13711 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.416685 13711 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.419000 13711 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.420056 13689 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.420572 13689 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.422600 13689 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.423117 13689 raft_consensus.cc:493] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.423623 13689 raft_consensus.cc:515] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.409770 13703 raft_consensus.cc:515] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:06.423630  8874 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.448961  8874 leader_election.cc:336] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.449455  8874 leader_election.cc:336] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.430209 13710 raft_consensus.cc:493] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.450282  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12377056e86440fb6f80fe02bb59fe1" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.450549 13710 raft_consensus.cc:515] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.430692  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cb41ea20c4484bfefd8f68fcdc475" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:06.436239  8907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9173a010c254f6b9fac3f924e38f957" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:06.394918 13712 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:06.442025 13687 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.453083 13710 leader_election.cc:290] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.452994 13687 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.455112 13703 leader_election.cc:290] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.445853 13709 raft_consensus.cc:493] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:06.446457  8930 debug-util.cc:398] Leaking SignalData structure 0x7b0800311260 after lost signal to thread 9549
W20260709 12:12:06.449970  8874 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.455281 13687 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.445245 13707 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:12:06.461018  8874 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.461287 13707 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.464254 13707 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:12:06.467178  8874 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.475360  8874 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.449901 13689 leader_election.cc:290] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.476868 13709 raft_consensus.cc:515] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.481043 13709 leader_election.cc:290] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.485191  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7cbe23065834283bc7d53543908a219" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.486668  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d58802311724215aa71fccdaeca35f7" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.487387  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57327b790014487690d5754a4e058fae" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.489252  8906 raft_consensus.cc:1275] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Refusing update from remote peer eaa6fbd6102948888c362ff1ea0b32e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:06.489058  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cfd04e1cc248b9b904175f207f3f40" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.495568  9522 raft_consensus.cc:1275] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Refusing update from remote peer 61fbd5afaa194845917d5b1b04571378: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:06.497210  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c6f055a4f7416ab87d6ba45b619ef8" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.500272 13712 consensus_queue.cc:1048] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:06.508863 13704 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:12:06.478820  8874 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.509794 13704 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:06.509824  8872 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.514875  8872 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.526831 13707 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:06.528497  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:06.512161  8874 leader_election.cc:336] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.538151  8874 leader_election.cc:336] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.538836  8874 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.539454  8874 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.530539 13704 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.516613  8875 leader_election.cc:304] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.541849 13707 raft_consensus.cc:2749] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.544479  8875 leader_election.cc:304] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:06.545202  9487 leader_election.cc:336] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.545426 13707 raft_consensus.cc:2749] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.546665 13709 consensus_queue.cc:1048] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:06.547653  8875 leader_election.cc:304] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.552548 13687 raft_consensus.cc:493] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eaa6fbd6102948888c362ff1ea0b32e8)
I20260709 12:12:06.553651 13687 raft_consensus.cc:515] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.554735 13689 raft_consensus.cc:2749] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:06.554971  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d20759d6564b039af8cca0f84b0eb5" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.555750 13687 leader_election.cc:290] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
W20260709 12:12:06.555866  8874 leader_election.cc:336] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.556717 13712 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.557255 13712 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.557968  9487 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:06.559774 13712 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.560359 13712 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:06.560792  8872 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.564073  9524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0982edf61b2c41e6b7c3414f279d4f31" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.564621 13712 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.565426  9522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b21cd8e1b445658842748734f3cc01" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.568097  9521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
W20260709 12:12:06.569183  9487 leader_election.cc:336] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:06.569222  9489 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.578776  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:06.578811  9521 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 8.
I20260709 12:12:06.571025  9516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e4c6e5758d4fb18617b5b7c30cd334" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.573382 13709 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.574800  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2ab93c6c3448edaa2bb2569cfd970b" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.580727 13709 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.582181 13716 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.583992 13709 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:06.585337  8875 leader_election.cc:304] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.586189  9518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:06.586079 13712 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.586862  9518 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:12:06.588166 13709 raft_consensus.cc:2749] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:06.588617 13712 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:06.577142  8874 leader_election.cc:336] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.589319  8875 leader_election.cc:304] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.589677  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a04653cca743d0966d20df2225c35d" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:06.590226 13709 raft_consensus.cc:2749] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:06.591524  8875 leader_election.cc:304] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.577713  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.592319 13709 raft_consensus.cc:2749] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.601635 13709 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:06.602869  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:06.604353  8872 leader_election.cc:336] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:06.594345  9487 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:06.599282  9489 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.593178  8875 leader_election.cc:304] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: eaa6fbd6102948888c362ff1ea0b32e8, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:06.607543  9489 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.608054  9489 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.609426 13709 raft_consensus.cc:2749] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:06.608449  9489 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.611565  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:06.612299  9487 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.613301  8872 leader_election.cc:304] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:06.614359 13709 raft_consensus.cc:2749] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:12:06.615187  9489 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.615737  9489 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.616080  8872 leader_election.cc:336] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:06.606559  8874 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.616375  9489 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.619527  8872 leader_election.cc:304] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:06.619714  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.620492 13707 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
W20260709 12:12:06.621421  9489 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.621263 13707 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.621869  9489 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.622102 13709 raft_consensus.cc:2749] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:06.622915  9489 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.623291  9489 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.623782 13707 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:06.620563 13716 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.625021 13708 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:06.630468  8874 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:06.628201  8872 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.631752  8872 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.633080 13708 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:06.642230 13687 raft_consensus.cc:2749] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:06.647040  8872 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.656394  8872 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.661772 13707 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:06.662940  8872 leader_election.cc:336] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.663542  8872 leader_election.cc:304] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:06.664309 13707 raft_consensus.cc:2749] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:06.666698  8872 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.667160  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.674094 13707 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.679908 13707 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.680433 13707 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:06.682557 13707 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:06.683602  8872 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.684055  8872 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.684795 13707 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:06.685694  8872 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.686110  8872 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:06.691648  8874 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.692351 13707 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:06.693406  8872 leader_election.cc:336] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.693899  8872 leader_election.cc:304] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, eaa6fbd6102948888c362ff1ea0b32e8
I20260709 12:12:06.694602 13707 raft_consensus.cc:2749] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:06.695544  8872 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.696026  8872 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.696784 13707 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:06.697652  8872 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.698077  8872 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.698778 13707 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:06.718647  8872 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.719208  8872 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:06.720328  8872 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.720809  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.721103 13707 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.721519 13709 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:06.731384  8872 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:06.731963  8872 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.732949 13709 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.779276 13708 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:06.780082 13708 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:06.813903 13708 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
W20260709 12:12:06.817538  9487 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:06.833415  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:06.840267  8874 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.842973  9489 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:06.847769  9489 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:06.850315 13712 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:12:06.852777  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:06.892391  9489 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.953703  9489 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.984301  9489 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:07.169957  9489 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:07.292961  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.343289  7578 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8856)
W20260709 12:12:07.374799  8872 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.405946  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.423035  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.425022  9546 debug-util.cc:398] Leaking SignalData structure 0x7b0800351540 after lost signal to thread 7581
W20260709 12:12:07.426223  9546 debug-util.cc:398] Leaking SignalData structure 0x7b0800288a40 after lost signal to thread 8692
W20260709 12:12:07.427551  9546 debug-util.cc:398] Leaking SignalData structure 0x7b0800260920 after lost signal to thread 8933
W20260709 12:12:07.428790  9546 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd460 after lost signal to thread 9549
W20260709 12:12:07.489341  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.540773  9487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111) [suppressed 545 similar messages]
W20260709 12:12:07.546895  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.663367  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.673609  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:07.798417  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.804857  8872 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:07.805527  8872 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.825197  8872 consensus_peers.cc:597] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.857872  8872 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.888291  8874 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.896416  8872 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:07.999377  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.028841  8874 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.051674  8872 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.072405  8872 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.118196  8872 consensus_peers.cc:597] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.205499  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.211467  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:08.212270  8874 consensus_peers.cc:597] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.215863  8874 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.238526  8872 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:08.265903  8874 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.276484  8874 consensus_peers.cc:597] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.292837  8874 consensus_peers.cc:597] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:08.327843 13687 raft_consensus.cc:493] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.328434 13687 raft_consensus.cc:515] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:08.352839 13687 leader_election.cc:290] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:08.356959  8872 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:08.374203  8874 leader_election.cc:336] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:08.385488  8874 leader_election.cc:304] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:08.389813  8872 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:08.390774  8872 consensus_peers.cc:597] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:08.391402 13728 raft_consensus.cc:2749] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:08.429380  8874 consensus_peers.cc:597] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.454612  8872 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:08.472987  9489 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.485363  8874 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.491626  8874 consensus_peers.cc:597] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.502997  8874 consensus_peers.cc:597] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.508152  8872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:39957, user_credentials={real_user=slave}} blocked reactor thread for 47943.2us
W20260709 12:12:08.537567  8872 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:08.549144  9489 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.575637  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:08.595404  8874 consensus_peers.cc:597] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.613606  8872 consensus_peers.cc:597] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:12:08.615821 13727 raft_consensus.cc:493] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.618628 13727 raft_consensus.cc:515] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:08.621097 13727 leader_election.cc:290] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:08.633332  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:08.635095  8874 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:08.685899  9489 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.696923  8872 leader_election.cc:336] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:08.701853  8872 leader_election.cc:304] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:08.703958 13729 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.712842 13729 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:08.717224 13729 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:08.718515  8906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba96dc62a22549a6ab209325db961b36" candidate_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61fbd5afaa194845917d5b1b04571378" is_pre_election: true
I20260709 12:12:08.719264  8906 raft_consensus.cc:2468] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa6fbd6102948888c362ff1ea0b32e8 in term 8.
W20260709 12:12:08.726022  9489 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:08.729450 13727 raft_consensus.cc:2749] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:08.739929  9487 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:08.768564  9489 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:08.769438  8874 consensus_peers.cc:597] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:08.777199 13727 raft_consensus.cc:493] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.790016 13727 raft_consensus.cc:515] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:08.777818  9489 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:08.798738 13729 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:08.806610 13727 leader_election.cc:290] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:08.815625 13728 raft_consensus.cc:493] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.816200 13728 raft_consensus.cc:515] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:08.819008 13728 leader_election.cc:290] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:08.820042  8874 consensus_peers.cc:597] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.835490  8872 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:08.841646  9489 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.873202  9489 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.880893  8874 leader_election.cc:336] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:08.877375  8872 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:08.882937 13727 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:08.888893 13727 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:08.893216  9520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cda6b7a1dd54b79a208e39c8a0de491" candidate_uuid: "61fbd5afaa194845917d5b1b04571378" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" is_pre_election: true
I20260709 12:12:08.893945  9520 raft_consensus.cc:2468] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61fbd5afaa194845917d5b1b04571378 in term 10.
I20260709 12:12:08.901077 13727 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), eaa6fbd6102948888c362ff1ea0b32e8 (127.7.102.132:32899)
I20260709 12:12:08.883513  8874 leader_election.cc:304] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:08.910779  8874 leader_election.cc:336] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:08.911229  8874 leader_election.cc:304] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:08.911969 13689 raft_consensus.cc:2749] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:08.919683 13728 raft_consensus.cc:2749] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:08.930900  9489 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.919694  8872 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:08.943914  8874 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:08.945282  8874 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378, eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:08.947486 13727 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:08.941969  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:08.961786  8874 consensus_peers.cc:597] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.968003  9489 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:09.016721 13727 raft_consensus.cc:493] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.017406 13727 raft_consensus.cc:515] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
W20260709 12:12:09.019057  8872 consensus_peers.cc:597] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:12:09.019840 13727 leader_election.cc:290] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.025081  8874 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:09.067668  8872 leader_election.cc:336] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.068289  8872 leader_election.cc:304] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.069120 13727 raft_consensus.cc:2749] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.069721 13728 raft_consensus.cc:493] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.070325 13728 raft_consensus.cc:515] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:09.072382 13728 leader_election.cc:290] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.078572  8874 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:09.097098  8874 consensus_peers.cc:597] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.112107  9489 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.126763  8872 leader_election.cc:336] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.127621  8872 leader_election.cc:304] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.128674 13727 raft_consensus.cc:2749] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.145797 13728 raft_consensus.cc:493] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.146432 13728 raft_consensus.cc:515] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:09.151389 13728 leader_election.cc:290] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.186003  8872 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:09.187667  8874 leader_election.cc:336] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:09.188179  8874 leader_election.cc:304] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.189054 13728 raft_consensus.cc:2749] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:09.190284  8874 consensus_peers.cc:597] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.220027  9489 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.223819  8872 consensus_peers.cc:597] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:09.231515  8874 consensus_peers.cc:597] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.251433  9489 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.275624  8874 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:09.362506 13729 raft_consensus.cc:493] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.363174 13729 raft_consensus.cc:515] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:09.370761  9487 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.372041 13729 leader_election.cc:290] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.377573  9489 leader_election.cc:336] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:09.378130  9489 leader_election.cc:304] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.379285 13729 raft_consensus.cc:2749] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.383004 13727 raft_consensus.cc:493] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.383566 13727 raft_consensus.cc:515] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:09.385707 13727 leader_election.cc:290] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.391741  8874 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:09.398864  8872 leader_election.cc:336] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.400573  8872 leader_election.cc:304] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.402779 13728 raft_consensus.cc:2749] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:09.434723  7578 tablet_server.cc:196] TabletServer@127.7.102.130:0 shutdown complete.
W20260709 12:12:09.448520  9489 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.451408  8872 consensus_peers.cc:597] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:09.488564  9489 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:09.520257  9487 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:09.531653  8874 consensus_peers.cc:597] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:09.604907 13728 raft_consensus.cc:493] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.605577 13728 raft_consensus.cc:515] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:09.614105 13728 leader_election.cc:290] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.617091  8874 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:09.620656  8872 leader_election.cc:336] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.621129  8872 leader_election.cc:304] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.621965 13728 raft_consensus.cc:2749] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:09.638928  9489 consensus_peers.cc:597] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:09.675501 13726 raft_consensus.cc:493] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.676100 13726 raft_consensus.cc:515] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:09.678506 13726 leader_election.cc:290] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957)
I20260709 12:12:09.683913  7578 tablet_server.cc:179] TabletServer@127.7.102.131:0 shutting down...
W20260709 12:12:09.691255  9487 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:09.695763  9489 leader_election.cc:336] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:09.696292  9489 leader_election.cc:304] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.698553 13729 raft_consensus.cc:493] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.700333 13729 raft_consensus.cc:515] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:09.704214 13731 raft_consensus.cc:2749] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:09.708974 13729 leader_election.cc:290] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
W20260709 12:12:09.710764  9487 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:09.729353  9488 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:09.743813  9489 leader_election.cc:336] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:09.744463  9489 leader_election.cc:304] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:09.750821 13726 raft_consensus.cc:2749] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:09.835143  8874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:34317, user_credentials={real_user=slave}} blocked reactor thread for 73481.5us
W20260709 12:12:09.865551  9488 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:09.873119  8872 consensus_peers.cc:597] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:09.883049  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:09.884383  9488 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:09.893013  9488 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.924966  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:09.926774  7578 tablet_replica.cc:333] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.927860  7578 raft_consensus.cc:2243] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.928745  7578 raft_consensus.cc:2272] T 6479206f1d4545ec83633cfa7a99b648 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.932709  7578 tablet_replica.cc:333] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
W20260709 12:12:09.932643  9488 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.933956  7578 raft_consensus.cc:2243] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.935137  7578 raft_consensus.cc:2272] T 10825d3a2b3b4d21bb372d5172d112eb P 61fbd5afaa194845917d5b1b04571378 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.937407 13735 raft_consensus.cc:493] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:09.937954  7578 tablet_replica.cc:333] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.937919 13735 raft_consensus.cc:515] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } }
I20260709 12:12:09.939097  7578 raft_consensus.cc:2243] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.940140 13735 leader_election.cc:290] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317)
I20260709 12:12:09.940696  7578 raft_consensus.cc:2272] T 2947e409c3964d228748bbb8d2e40832 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.943617  7578 tablet_replica.cc:333] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.944671  7578 raft_consensus.cc:2243] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:12:09.945662  8872 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:09.945904  7578 raft_consensus.cc:2272] T c18b8defabce4ce7a420d8548c885e28 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.947296  9488 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.949220  7578 tablet_replica.cc:333] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.949882  7578 raft_consensus.cc:2243] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.950708  7578 raft_consensus.cc:2272] T 0dd6228ae6144924a1ddc7362f86742d P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.953223  7578 tablet_replica.cc:333] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.953889  7578 raft_consensus.cc:2243] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.954629  7578 raft_consensus.cc:2272] T 0982edf61b2c41e6b7c3414f279d4f31 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.957489  7578 tablet_replica.cc:333] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.958196  7578 raft_consensus.cc:2243] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.958734  7578 raft_consensus.cc:2272] T 67e3054fb6044180b7de9b761b2ea05b P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.961356  7578 tablet_replica.cc:333] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.962313  7578 raft_consensus.cc:2243] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.963543  7578 raft_consensus.cc:2272] T 93fd9eae511442cda809efae9c60a8dd P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.966264  7578 tablet_replica.cc:333] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.966977  7578 raft_consensus.cc:2243] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.968343  7578 raft_consensus.cc:2272] T 12a516db16ef4c1bae0d02a9c8d29be4 P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.971242  7578 tablet_replica.cc:333] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.972002  7578 raft_consensus.cc:2243] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.972597  7578 raft_consensus.cc:2272] T a82912909b984cbb88197808b3d66347 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.975539  7578 tablet_replica.cc:333] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.976339  7578 raft_consensus.cc:2243] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.977612  7578 raft_consensus.cc:2272] T d9af31792ab541fbb5b308c83cf60c08 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.980944  7578 tablet_replica.cc:333] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.981735  7578 raft_consensus.cc:2243] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.983027  7578 raft_consensus.cc:2272] T 0a4cb41ea20c4484bfefd8f68fcdc475 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.985623  7578 tablet_replica.cc:333] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.986428  7578 raft_consensus.cc:2243] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.987466  7578 raft_consensus.cc:2272] T d412a1e35a1a4f75b3628a5642ddd121 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.995450  7578 tablet_replica.cc:333] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:09.996273  7578 raft_consensus.cc:2243] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.997026  7578 raft_consensus.cc:2272] T 78cfd04e1cc248b9b904175f207f3f40 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.999936  7578 tablet_replica.cc:333] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.000773  7578 raft_consensus.cc:2243] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.001446  7578 raft_consensus.cc:2272] T 2ea14ea70b8b462ca548019b513f4211 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.010856  8872 consensus_peers.cc:597] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:10.011952  7578 tablet_replica.cc:333] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.012853  7578 raft_consensus.cc:2243] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.013955  7578 raft_consensus.cc:2272] T ba96dc62a22549a6ab209325db961b36 P 61fbd5afaa194845917d5b1b04571378 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.016965  7578 tablet_replica.cc:333] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
W20260709 12:12:10.017253  9487 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:10.017778  7578 raft_consensus.cc:2243] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.018563  7578 raft_consensus.cc:2272] T 01a81765aa0b4241bacb910d72fb71cb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.021610  7578 tablet_replica.cc:333] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.022794  7578 raft_consensus.cc:2243] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.023383  7578 raft_consensus.cc:2272] T 59b21cd8e1b445658842748734f3cc01 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.026432  7578 tablet_replica.cc:333] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.027194  7578 raft_consensus.cc:2243] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.028226  7578 raft_consensus.cc:2272] T 1af6a99f3fc34f97a6aead96582b77eb P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.030042  9488 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.033941  9488 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.035372  8872 consensus_peers.cc:597] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:10.037418  7578 tablet_replica.cc:333] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.038285  7578 raft_consensus.cc:2243] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.039085  7578 raft_consensus.cc:2272] T f12377056e86440fb6f80fe02bb59fe1 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.042069  7578 tablet_replica.cc:333] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.042953  7578 raft_consensus.cc:2243] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.043552  7578 raft_consensus.cc:2272] T 412fc8b910864ab39eda6a2eaa63b886 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.046504  7578 tablet_replica.cc:333] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.047245  7578 raft_consensus.cc:2243] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.047924  7578 raft_consensus.cc:2272] T d70cbe0e284f4df0aca5c9f02140ce70 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.048256  9488 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.050690  7578 tablet_replica.cc:333] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.051599  7578 raft_consensus.cc:2243] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.052237  7578 raft_consensus.cc:2272] T ec2ab93c6c3448edaa2bb2569cfd970b P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.063572  7578 tablet_replica.cc:333] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.064472  7578 raft_consensus.cc:2243] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.066462  7578 raft_consensus.cc:2272] T 56a6b1a7ca5440f18f286ddd5e44afce P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.069106  9488 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.069342  7578 tablet_replica.cc:333] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.070251  7578 raft_consensus.cc:2243] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.071204  7578 raft_consensus.cc:2272] T 5f3efa45bd1e40c79e9873e78f82e8e6 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.074128  7578 tablet_replica.cc:333] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.075258  7578 raft_consensus.cc:2243] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.076344  7578 raft_consensus.cc:2272] T 92b5e15f0c384f1e8ed394830c71cd90 P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.082245  7578 tablet_replica.cc:333] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.083024  7578 raft_consensus.cc:2243] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.083992  7578 raft_consensus.cc:2272] T 16a04653cca743d0966d20df2225c35d P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.088208  7578 tablet_replica.cc:333] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.089033  7578 raft_consensus.cc:2243] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.089699  7578 raft_consensus.cc:2272] T 73c6f055a4f7416ab87d6ba45b619ef8 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.092360  7578 tablet_replica.cc:333] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.093158  7578 raft_consensus.cc:2243] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.094210  7578 raft_consensus.cc:2272] T 57327b790014487690d5754a4e058fae P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.097000  7578 tablet_replica.cc:333] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.097880  7578 raft_consensus.cc:2243] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.098526  7578 raft_consensus.cc:2272] T 9c4b3d74e26942a59cf5bdf2c24fcf1a P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.101378  7578 tablet_replica.cc:333] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.102118  7578 raft_consensus.cc:2243] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.103631  7578 raft_consensus.cc:2272] T efe90059a90047969b785a597928a512 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.106534  7578 tablet_replica.cc:333] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.107249  7578 raft_consensus.cc:2243] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.108346  7578 raft_consensus.cc:2272] T a9173a010c254f6b9fac3f924e38f957 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.110347  9488 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.111217  7578 tablet_replica.cc:333] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.112039  7578 raft_consensus.cc:2243] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.112929  7578 raft_consensus.cc:2272] T 23ed5434fbd54337b1b9a26153e96d0e P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.115600  7578 tablet_replica.cc:333] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.116765  7578 raft_consensus.cc:2243] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.117539  7578 raft_consensus.cc:2272] T 3d58802311724215aa71fccdaeca35f7 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.120483  7578 tablet_replica.cc:333] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.125393  7578 raft_consensus.cc:2243] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.128122  7578 raft_consensus.cc:2272] T e45c621a9c684915a4c110e0801e4efa P 61fbd5afaa194845917d5b1b04571378 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.131145  7578 tablet_replica.cc:333] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.131937  7578 raft_consensus.cc:2243] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.132495  7578 raft_consensus.cc:2272] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.135246  7578 tablet_replica.cc:333] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.136065  7578 raft_consensus.cc:2243] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.137245  7578 raft_consensus.cc:2272] T d4932af0fd1f4f8097c506666a195b54 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.140275  7578 tablet_replica.cc:333] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.141165  7578 raft_consensus.cc:2243] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.141819  7578 raft_consensus.cc:2272] T cfd13939e80e4c668025684b9dbc3f54 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.144788  7578 tablet_replica.cc:333] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.145502  7578 raft_consensus.cc:2243] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.146088  7578 raft_consensus.cc:2272] T cac426ada8f6447ebc8beff698a38039 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.148520  7578 tablet_replica.cc:333] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.151314  7578 raft_consensus.cc:2243] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.152904  7578 raft_consensus.cc:2272] T 4c57fe22a6bf47dca31c488f82e72a1f P 61fbd5afaa194845917d5b1b04571378 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.154693  9487 consensus_peers.cc:597] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:10.157370  7578 tablet_replica.cc:333] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.158200  7578 raft_consensus.cc:2243] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.158808  7578 raft_consensus.cc:2272] T 83dcd7668cd44a658ba674d10aa778d9 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.161693  7578 tablet_replica.cc:333] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.163309  7578 raft_consensus.cc:2243] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.164605  7578 raft_consensus.cc:2272] T 6cda6b7a1dd54b79a208e39c8a0de491 P 61fbd5afaa194845917d5b1b04571378 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.169658  7578 tablet_replica.cc:333] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.170506  7578 raft_consensus.cc:2243] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.171747  7578 raft_consensus.cc:2272] T 431583fc4c754d42936c71ee0279ae80 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.174876  7578 tablet_replica.cc:333] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.175673  7578 raft_consensus.cc:2243] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.176496  7578 raft_consensus.cc:2272] T d7cbe23065834283bc7d53543908a219 P 61fbd5afaa194845917d5b1b04571378 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.179961  7578 tablet_replica.cc:333] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.181594  7578 raft_consensus.cc:2243] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.183902  7578 raft_consensus.cc:2272] T 93afd25256e34a3b902813af41f349c9 P 61fbd5afaa194845917d5b1b04571378 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.188608  7578 tablet_replica.cc:333] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
W20260709 12:12:10.190225  9488 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.189436  7578 raft_consensus.cc:2243] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.199031  7578 raft_consensus.cc:2272] T 4ce14b8d8c8a43d48b1570f033c4e64f P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.202414  7578 tablet_replica.cc:333] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.203234  7578 raft_consensus.cc:2243] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.204058  7578 raft_consensus.cc:2272] T 36d20759d6564b039af8cca0f84b0eb5 P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.207458  7578 tablet_replica.cc:333] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.208145  7578 raft_consensus.cc:2243] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.209025  7578 raft_consensus.cc:2272] T d0e4c6e5758d4fb18617b5b7c30cd334 P 61fbd5afaa194845917d5b1b04571378 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.211825  7578 tablet_replica.cc:333] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.212584  7578 raft_consensus.cc:2243] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.213574  7578 raft_consensus.cc:2272] T 7127014b11f244fc9da3cde4600ec6a6 P 61fbd5afaa194845917d5b1b04571378 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.216733  7578 tablet_replica.cc:333] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378: stopping tablet replica
I20260709 12:12:10.217425  7578 raft_consensus.cc:2243] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:12:10.218205  9488 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.218896  7578 raft_consensus.cc:2272] T 5751232c878a452c84d5bd9127abfc1d P 61fbd5afaa194845917d5b1b04571378 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.236096  9488 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Couldn't send request to peer 61fbd5afaa194845917d5b1b04571378. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.258375  9487 consensus_peers.cc:597] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:10.349412  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.395067  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.482829  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.498307  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.599735  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.600241  8875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.622083 13729 raft_consensus.cc:493] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:10.622879 13729 raft_consensus.cc:515] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:10.636829  9488 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:10.638140 13729 leader_election.cc:290] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:10.649461  9489 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:10.649917  9489 leader_election.cc:304] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:10.652068  9487 consensus_peers.cc:597] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:10.650681 13739 raft_consensus.cc:2749] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:10.656754  9487 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:10.658805  9487 leader_election.cc:336] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:10.674652  9487 consensus_peers.cc:597] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:10.696338  9487 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:10.751739  9487 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:10.783766  8872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.803493  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.874291  8873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.890750  9489 consensus_peers.cc:597] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.943078  9487 consensus_peers.cc:597] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:10.964150  8874 leader_election.cc:336] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 12:12:10.964705  8874 leader_election.cc:304] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61fbd5afaa194845917d5b1b04571378; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
W20260709 12:12:10.965232  8874 raft_consensus.cc:2686] T 1cbf5632da664f5c88b13382f86fbdfe P 61fbd5afaa194845917d5b1b04571378: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:10.982102 13739 raft_consensus.cc:493] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:10.982777 13739 raft_consensus.cc:515] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:10.985397 13739 leader_election.cc:290] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:10.990746  9488 leader_election.cc:336] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
W20260709 12:12:10.991360  9487 leader_election.cc:336] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:10.991899  9487 leader_election.cc:304] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:10.992687 13739 raft_consensus.cc:2749] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:11.041247 13739 raft_consensus.cc:493] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.041829 13739 raft_consensus.cc:515] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.043923 13739 leader_election.cc:290] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.048870  9489 leader_election.cc:336] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:11.049387  9488 leader_election.cc:336] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
I20260709 12:12:11.049808  9488 leader_election.cc:304] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:11.050453 13739 raft_consensus.cc:2749] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.203754 13739 raft_consensus.cc:493] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.204304 13739 raft_consensus.cc:515] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.207126 13739 leader_election.cc:290] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.211243  9488 leader_election.cc:336] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
W20260709 12:12:11.211802  9487 leader_election.cc:336] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:11.212212  9487 leader_election.cc:304] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:11.212869 13739 raft_consensus.cc:2749] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:11.222834 13738 raft_consensus.cc:493] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.223402 13738 raft_consensus.cc:515] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.225469 13738 leader_election.cc:290] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.230069  9487 leader_election.cc:336] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
W20260709 12:12:11.230646  9488 leader_election.cc:336] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
I20260709 12:12:11.231058  9488 leader_election.cc:304] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:11.231705 13738 raft_consensus.cc:2749] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:11.281577  9489 consensus_peers.cc:597] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.335793  9489 consensus_peers.cc:597] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.349484  9489 consensus_peers.cc:597] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.369524  9489 consensus_peers.cc:597] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.370257  9489 consensus_peers.cc:597] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:11.372403 13738 raft_consensus.cc:493] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.372937 13738 raft_consensus.cc:515] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.374872 13738 leader_election.cc:290] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.378822  9488 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
W20260709 12:12:11.386431  9489 leader_election.cc:336] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:11.387151  9489 leader_election.cc:304] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:11.387881 13738 raft_consensus.cc:2749] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:11.424121 13738 raft_consensus.cc:493] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.424773 13738 raft_consensus.cc:515] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.428947 13738 leader_election.cc:290] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.432857  9489 leader_election.cc:336] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
W20260709 12:12:11.434331  9488 leader_election.cc:336] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
I20260709 12:12:11.434723  9488 leader_election.cc:304] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 61fbd5afaa194845917d5b1b04571378, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:11.435405 13738 raft_consensus.cc:2749] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:12:11.509953  9489 consensus_peers.cc:597] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.513515  9487 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:11.524766  9489 consensus_peers.cc:597] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.540359  8689 debug-util.cc:398] Leaking SignalData structure 0x7b080032bd80 after lost signal to thread 7581
W20260709 12:12:11.541623  8689 debug-util.cc:398] Leaking SignalData structure 0x7b080034cb40 after lost signal to thread 8692
W20260709 12:12:11.543025  8689 debug-util.cc:398] Leaking SignalData structure 0x7b0800215fe0 after lost signal to thread 9549
I20260709 12:12:11.557330 13739 raft_consensus.cc:493] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61fbd5afaa194845917d5b1b04571378)
I20260709 12:12:11.558032 13739 raft_consensus.cc:515] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
I20260709 12:12:11.560514 13739 leader_election.cc:290] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
W20260709 12:12:11.567466  9488 leader_election.cc:336] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
W20260709 12:12:11.571367  9487 leader_election.cc:336] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:11.572001  9487 leader_election.cc:304] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, 61fbd5afaa194845917d5b1b04571378
I20260709 12:12:11.572901 13739 raft_consensus.cc:2749] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.621919  7578 tablet_server.cc:196] TabletServer@127.7.102.131:0 shutdown complete.
W20260709 12:12:11.640112  9489 consensus_peers.cc:597] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.735368  9489 consensus_peers.cc:597] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:11.760021 13739 raft_consensus.cc:493] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd116b86a1e4445c994a361f776beba1)
I20260709 12:12:11.760898 13739 raft_consensus.cc:515] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "005ae7a1e140481db6cc04faeb268d9c" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 39957 } } peers { permanent_uuid: "fd116b86a1e4445c994a361f776beba1" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 34317 } } peers { permanent_uuid: "61fbd5afaa194845917d5b1b04571378" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 39537 } attrs { replace: true } } peers { permanent_uuid: "eaa6fbd6102948888c362ff1ea0b32e8" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 32899 } attrs { promote: false } }
W20260709 12:12:11.772409  9487 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111)
I20260709 12:12:11.774852 13739 leader_election.cc:290] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957), fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317), 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537)
I20260709 12:12:11.779928  7578 tablet_server.cc:179] TabletServer@127.7.102.132:0 shutting down...
W20260709 12:12:11.780329  9489 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111)
I20260709 12:12:11.781883  9489 leader_election.cc:304] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eaa6fbd6102948888c362ff1ea0b32e8; no voters: 005ae7a1e140481db6cc04faeb268d9c, fd116b86a1e4445c994a361f776beba1
I20260709 12:12:11.782708 13738 raft_consensus.cc:2749] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:11.794708  9488 leader_election.cc:336] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61fbd5afaa194845917d5b1b04571378 (127.7.102.131:39537): Network error: Client connection negotiation failed: client connection to 127.7.102.131:39537: connect: Connection refused (error 111)
W20260709 12:12:11.803766  9489 consensus_peers.cc:597] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:11.810590  9489 consensus_peers.cc:597] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:11.883936  7578 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:11.884971  7578 tablet_replica.cc:333] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.885931  7578 raft_consensus.cc:2243] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.886737  7578 raft_consensus.cc:2272] T ba96dc62a22549a6ab209325db961b36 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.889957  7578 tablet_replica.cc:333] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.890887  7578 raft_consensus.cc:2243] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.891609  7578 raft_consensus.cc:2272] T 6cda6b7a1dd54b79a208e39c8a0de491 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.894634  7578 tablet_replica.cc:333] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.895500  7578 raft_consensus.cc:2243] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.896167  7578 raft_consensus.cc:2272] T 0a4cb41ea20c4484bfefd8f68fcdc475 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.899048  7578 tablet_replica.cc:333] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.899976  7578 raft_consensus.cc:2243] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.901278  7578 raft_consensus.cc:2272] T 4f78b2d2f5154e388ca8e35799e1afeb P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.904325  7578 tablet_replica.cc:333] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.905908  7578 raft_consensus.cc:2243] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.906669  7578 raft_consensus.cc:2272] T 16a04653cca743d0966d20df2225c35d P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.909703  7578 tablet_replica.cc:333] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.910600  7578 raft_consensus.cc:2243] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.911348  7578 raft_consensus.cc:2272] T c18b8defabce4ce7a420d8548c885e28 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.914454  7578 tablet_replica.cc:333] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.915349  7578 raft_consensus.cc:2243] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.916543  7578 raft_consensus.cc:2272] T 0982edf61b2c41e6b7c3414f279d4f31 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.919827  7578 tablet_replica.cc:333] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.920696  7578 raft_consensus.cc:2243] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.921344  7578 raft_consensus.cc:2272] T 6ff15d7fa845498ba3ccd1874ce63ad6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.924651  7578 tablet_replica.cc:333] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.925693  7578 raft_consensus.cc:2243] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.926965  7578 raft_consensus.cc:2272] T d7cbe23065834283bc7d53543908a219 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.930365  7578 tablet_replica.cc:333] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.931293  7578 raft_consensus.cc:2243] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.931998  7578 raft_consensus.cc:2272] T a9173a010c254f6b9fac3f924e38f957 P eaa6fbd6102948888c362ff1ea0b32e8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.935459  7578 tablet_replica.cc:333] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.936532  7578 raft_consensus.cc:2243] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.937919  7578 raft_consensus.cc:2272] T e45c621a9c684915a4c110e0801e4efa P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:11.940068  9487 consensus_peers.cc:597] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer 005ae7a1e140481db6cc04faeb268d9c (127.7.102.129:39957): Couldn't send request to peer 005ae7a1e140481db6cc04faeb268d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.129:39957: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:11.943434  7578 tablet_replica.cc:333] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.944414  7578 raft_consensus.cc:2243] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.945598  7578 raft_consensus.cc:2272] T cfd13939e80e4c668025684b9dbc3f54 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.948697  7578 tablet_replica.cc:333] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.949554  7578 raft_consensus.cc:2243] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.950266  7578 raft_consensus.cc:2272] T 69ecd2fc45134ac8a031c2a6f90284d7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.953461  7578 tablet_replica.cc:333] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.954291  7578 raft_consensus.cc:2243] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.955622  7578 raft_consensus.cc:2272] T 36d20759d6564b039af8cca0f84b0eb5 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.958676  7578 tablet_replica.cc:333] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
W20260709 12:12:11.958922  9489 consensus_peers.cc:597] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 -> Peer fd116b86a1e4445c994a361f776beba1 (127.7.102.130:34317): Couldn't send request to peer fd116b86a1e4445c994a361f776beba1. Status: Network error: Client connection negotiation failed: client connection to 127.7.102.130:34317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.961211  7578 raft_consensus.cc:2243] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.962494  7578 raft_consensus.cc:2272] T 59b21cd8e1b445658842748734f3cc01 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.965956  7578 tablet_replica.cc:333] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.966894  7578 raft_consensus.cc:2243] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.968058  7578 raft_consensus.cc:2272] T a047cca1ee434f14ac79b5f67b7aac73 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.971035  7578 tablet_replica.cc:333] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.971853  7578 raft_consensus.cc:2243] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.972692  7578 raft_consensus.cc:2272] T 7127014b11f244fc9da3cde4600ec6a6 P eaa6fbd6102948888c362ff1ea0b32e8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.975718  7578 tablet_replica.cc:333] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.976564  7578 raft_consensus.cc:2243] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.977811  7578 raft_consensus.cc:2272] T 98ff6a40f13a4be9b4a05ca797f8fd52 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.981076  7578 tablet_replica.cc:333] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.982046  7578 raft_consensus.cc:2243] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.982690  7578 raft_consensus.cc:2272] T 10825d3a2b3b4d21bb372d5172d112eb P eaa6fbd6102948888c362ff1ea0b32e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.985666  7578 tablet_replica.cc:333] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.986642  7578 raft_consensus.cc:2243] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.988303  7578 raft_consensus.cc:2272] T d0e4c6e5758d4fb18617b5b7c30cd334 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.991552  7578 tablet_replica.cc:333] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.992446  7578 raft_consensus.cc:2243] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.993646  7578 raft_consensus.cc:2272] T 3d58802311724215aa71fccdaeca35f7 P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.996497  7578 tablet_replica.cc:333] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:11.997335  7578 raft_consensus.cc:2243] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.997910  7578 raft_consensus.cc:2272] T 13bb8ebab2aa4ea6b0a85f0aac706c35 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.000851  7578 tablet_replica.cc:333] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.001704  7578 raft_consensus.cc:2243] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.002863  7578 raft_consensus.cc:2272] T 73c6f055a4f7416ab87d6ba45b619ef8 P eaa6fbd6102948888c362ff1ea0b32e8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.005874  7578 tablet_replica.cc:333] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.006752  7578 raft_consensus.cc:2243] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.007953  7578 raft_consensus.cc:2272] T ec2ab93c6c3448edaa2bb2569cfd970b P eaa6fbd6102948888c362ff1ea0b32e8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.011276  7578 tablet_replica.cc:333] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.012153  7578 raft_consensus.cc:2243] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.013365  7578 raft_consensus.cc:2272] T f12377056e86440fb6f80fe02bb59fe1 P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.016372  7578 tablet_replica.cc:333] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.017216  7578 raft_consensus.cc:2243] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.020161  7578 raft_consensus.cc:2272] T a82912909b984cbb88197808b3d66347 P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.023164  7578 tablet_replica.cc:333] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.023977  7578 raft_consensus.cc:2243] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.025158  7578 raft_consensus.cc:2272] T 78cfd04e1cc248b9b904175f207f3f40 P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.028059  7578 tablet_replica.cc:333] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.028957  7578 raft_consensus.cc:2243] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.029832  7578 raft_consensus.cc:2272] T 4ce14b8d8c8a43d48b1570f033c4e64f P eaa6fbd6102948888c362ff1ea0b32e8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.033066  7578 tablet_replica.cc:333] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.033824  7578 raft_consensus.cc:2243] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.035043  7578 raft_consensus.cc:2272] T 63977b2ac46b48f0ba26c573aeeb69fc P eaa6fbd6102948888c362ff1ea0b32e8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.037961  7578 tablet_replica.cc:333] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.038717  7578 raft_consensus.cc:2243] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.040122  7578 raft_consensus.cc:2272] T 57327b790014487690d5754a4e058fae P eaa6fbd6102948888c362ff1ea0b32e8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.043242  7578 tablet_replica.cc:333] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.043988  7578 raft_consensus.cc:2243] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.045142  7578 raft_consensus.cc:2272] T a342b86867884bfaa83a903e1502daaa P eaa6fbd6102948888c362ff1ea0b32e8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.047919  7578 tablet_replica.cc:333] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8: stopping tablet replica
I20260709 12:12:12.048596  7578 raft_consensus.cc:2243] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.049917  7578 raft_consensus.cc:2272] T 883fe3a6d9a747ed8f95a683702eb669 P eaa6fbd6102948888c362ff1ea0b32e8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.474917  7578 tablet_server.cc:196] TabletServer@127.7.102.132:0 shutdown complete.
I20260709 12:12:12.547235  7578 master.cc:562] Master@127.7.102.190:46065 shutting down...
W20260709 12:12:12.596618  8706 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:12:12.597091  8706 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:12.597324  8706 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:12:12.601022  7578 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.601640  7578 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.601956  7578 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11a02b83f2af4df69b08a1f984747bcd: stopping tablet replica
I20260709 12:12:12.754415  7578 master.cc:584] Master@127.7.102.190:46065 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (175574 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:12:12.861033  7578 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.102.190:35547
I20260709 12:12:12.862236  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:12.869266 13747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:12.869362 13746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:12.869567 13749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:12.895884  7578 server_base.cc:1061] running on GCE node
I20260709 12:12:12.899375  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:12.899597  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:12.899817  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783599132899802 us; error 0 us; skew 500 ppm
I20260709 12:12:12.900576  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:12.903992  7578 webserver.cc:533] Webserver started at http://127.7.102.190:46095/ using document root <none> and password file <none>
I20260709 12:12:12.904620  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:12.904888  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:12.905223  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:12.906692  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/master-0-root/instance:
uuid: "801713bd61dd4918a2db2d1c1a92af72"
format_stamp: "Formatted at 2026-07-09 12:12:12 on dist-test-slave-p7fg"
I20260709 12:12:12.911957  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:12:12.916113 13755 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:12.917259  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:12.917649  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/master-0-root
uuid: "801713bd61dd4918a2db2d1c1a92af72"
format_stamp: "Formatted at 2026-07-09 12:12:12 on dist-test-slave-p7fg"
I20260709 12:12:12.918053  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:12.937374  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:12.938817  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:12.987704  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.190:35547
I20260709 12:12:12.987840 13806 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.190:35547 every 8 connection(s)
I20260709 12:12:12.993034 13807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.005527 13807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Bootstrap starting.
I20260709 12:12:13.010984 13807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.016206 13807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: No bootstrap required, opened a new log
I20260709 12:12:13.018698 13807 raft_consensus.cc:359] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER }
I20260709 12:12:13.019263 13807 raft_consensus.cc:385] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.019505 13807 raft_consensus.cc:740] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801713bd61dd4918a2db2d1c1a92af72, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.020256 13807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER }
I20260709 12:12:13.020924 13807 raft_consensus.cc:399] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:13.021180 13807 raft_consensus.cc:493] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:13.021493 13807 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.026180 13807 raft_consensus.cc:515] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER }
I20260709 12:12:13.026787 13807 leader_election.cc:304] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 801713bd61dd4918a2db2d1c1a92af72; no voters: 
I20260709 12:12:13.028249 13807 leader_election.cc:290] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:13.028919 13810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.030608 13810 raft_consensus.cc:697] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [term 1 LEADER]: Becoming Leader. State: Replica: 801713bd61dd4918a2db2d1c1a92af72, State: Running, Role: LEADER
I20260709 12:12:13.031590 13807 sys_catalog.cc:565] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:13.031454 13810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER }
I20260709 12:12:13.039636 13812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 801713bd61dd4918a2db2d1c1a92af72. Latest consensus state: current_term: 1 leader_uuid: "801713bd61dd4918a2db2d1c1a92af72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER } }
I20260709 12:12:13.039512 13811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "801713bd61dd4918a2db2d1c1a92af72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801713bd61dd4918a2db2d1c1a92af72" member_type: VOTER } }
I20260709 12:12:13.040292 13812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:13.040334 13811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:13.042910 13820 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:13.048465 13820 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:13.049886  7578 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:13.059303 13820 catalog_manager.cc:1383] Generated new cluster ID: a6345b078de149ec874b40eb97a093b1
I20260709 12:12:13.059685 13820 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:13.076007 13820 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:13.077461 13820 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:13.093721 13820 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Generated new TSK 0
I20260709 12:12:13.094419 13820 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:13.117306  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:13.125419 13828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.127254 13829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.130146 13831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:13.130409  7578 server_base.cc:1061] running on GCE node
I20260709 12:12:13.133028  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:13.133432  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:13.133616  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783599133133598 us; error 0 us; skew 500 ppm
I20260709 12:12:13.134243  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:13.137424  7578 webserver.cc:533] Webserver started at http://127.7.102.129:46833/ using document root <none> and password file <none>
I20260709 12:12:13.138033  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:13.138266  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:13.138572  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:13.140002  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/instance:
uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.145313  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:12:13.149269 13836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.150393  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:12:13.150719  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.151062  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:13.160956  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:13.162348  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:13.164165  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:13.167001  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:13.167255  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.167524  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:13.167712  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.217762  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.129:45927
I20260709 12:12:13.217880 13898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.129:45927 every 8 connection(s)
I20260709 12:12:13.224128  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:13.232064 13903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.233613 13904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.236902 13906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:13.237077  7578 server_base.cc:1061] running on GCE node
I20260709 12:12:13.240703  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:13.240983  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:13.241179  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783599133241164 us; error 0 us; skew 500 ppm
I20260709 12:12:13.241698 13899 heartbeater.cc:344] Connected to a master server at 127.7.102.190:35547
I20260709 12:12:13.241814  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:13.242286 13899 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:13.243432 13899 heartbeater.cc:507] Master 127.7.102.190:35547 requested a full tablet report, sending...
I20260709 12:12:13.245428  7578 webserver.cc:533] Webserver started at http://127.7.102.130:40959/ using document root <none> and password file <none>
I20260709 12:12:13.246060  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:13.245931 13772 ts_manager.cc:194] Registered new tserver with Master: 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:13.246455  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:13.246822  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:13.248317 13772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38470
I20260709 12:12:13.248322  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/instance:
uuid: "33ef851003ef478cac1897bfee45a8f2"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.253756  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:12:13.257887 13911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.258875  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:12:13.259219  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
uuid: "33ef851003ef478cac1897bfee45a8f2"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.259554  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:13.272101  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:13.273581  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:13.275310  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:13.277992  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:13.278244  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.278498  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:13.278676  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.326785  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.130:41801
I20260709 12:12:13.326906 13973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.130:41801 every 8 connection(s)
I20260709 12:12:13.332264  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:13.343071 13977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.346526 13978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:13.349298 13974 heartbeater.cc:344] Connected to a master server at 127.7.102.190:35547
I20260709 12:12:13.349833 13974 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:13.350059  7578 server_base.cc:1061] running on GCE node
W20260709 12:12:13.350188 13980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:13.350878 13974 heartbeater.cc:507] Master 127.7.102.190:35547 requested a full tablet report, sending...
I20260709 12:12:13.351384  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:13.351660  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:13.351889  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783599133351869 us; error 0 us; skew 500 ppm
I20260709 12:12:13.352703  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:13.353423 13772 ts_manager.cc:194] Registered new tserver with Master: 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:13.355207 13772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38478
I20260709 12:12:13.355686  7578 webserver.cc:533] Webserver started at http://127.7.102.131:42029/ using document root <none> and password file <none>
I20260709 12:12:13.356393  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:13.356685  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:13.357007  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:13.358330  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/instance:
uuid: "4c9b84be2fea4f7094b49292ec17dabe"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.363441  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:12:13.367332 13985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.368278  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:12:13.368573  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
uuid: "4c9b84be2fea4f7094b49292ec17dabe"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.368928  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:13.389585  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:13.390893  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:13.392452  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:13.394876  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:13.395108  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.395372  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:13.395545  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.443989  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.131:36455
I20260709 12:12:13.444147 14047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.131:36455 every 8 connection(s)
I20260709 12:12:13.449395  7578 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:13.458905 14051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.459674 14052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:13.464808 14054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:13.465147 14048 heartbeater.cc:344] Connected to a master server at 127.7.102.190:35547
I20260709 12:12:13.465726 14048 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:13.465718  7578 server_base.cc:1061] running on GCE node
I20260709 12:12:13.467157  7578 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:13.467160 14048 heartbeater.cc:507] Master 127.7.102.190:35547 requested a full tablet report, sending...
W20260709 12:12:13.467528  7578 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:13.467835  7578 hybrid_clock.cc:648] HybridClock initialized: now 1783599133467815 us; error 0 us; skew 500 ppm
I20260709 12:12:13.468518  7578 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:13.469990 13772 ts_manager.cc:194] Registered new tserver with Master: 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:13.471961 13772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38490
I20260709 12:12:13.473268  7578 webserver.cc:533] Webserver started at http://127.7.102.132:38579/ using document root <none> and password file <none>
I20260709 12:12:13.473917  7578 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:13.474141  7578 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:13.474434  7578 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:13.475664  7578 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-3-root/instance:
uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.480486  7578 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:12:13.484254 14059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.485347  7578 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:12:13.485803  7578 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
format_stamp: "Formatted at 2026-07-09 12:12:13 on dist-test-slave-p7fg"
I20260709 12:12:13.486172  7578 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzeBMzo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895902579-7578-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:13.521545  7578 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:13.522910  7578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:13.524358  7578 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:13.526983  7578 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:13.527252  7578 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.527540  7578 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:13.527751  7578 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:13.585644  7578 rpc_server.cc:307] RPC server started. Bound to: 127.7.102.132:34469
I20260709 12:12:13.585767 14121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.102.132:34469 every 8 connection(s)
I20260709 12:12:13.603174 14122 heartbeater.cc:344] Connected to a master server at 127.7.102.190:35547
I20260709 12:12:13.603668 14122 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:13.604692 14122 heartbeater.cc:507] Master 127.7.102.190:35547 requested a full tablet report, sending...
I20260709 12:12:13.606969 13772 ts_manager.cc:194] Registered new tserver with Master: f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:13.607650  7578 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018151607s
I20260709 12:12:13.609124 13772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38496
I20260709 12:12:13.640187 13772 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38506:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:12:13.918017 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 608ec46055a04e7d9feb7162d37e3fec (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:13.919795 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ec46055a04e7d9feb7162d37e3fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.922565 14012 tablet_service.cc:1511] Processing CreateTablet for tablet dcf784ecd514417286b3130eab79f085 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:13.924276 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf784ecd514417286b3130eab79f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.927022 13864 tablet_service.cc:1511] Processing CreateTablet for tablet 608ec46055a04e7d9feb7162d37e3fec (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:13.930145 13863 tablet_service.cc:1511] Processing CreateTablet for tablet dcf784ecd514417286b3130eab79f085 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:13.928568 13864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ec46055a04e7d9feb7162d37e3fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.935847 14011 tablet_service.cc:1511] Processing CreateTablet for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:13.936480 13862 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea7290d3204b53837a7521af690e79 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:13.937690 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.938151 13862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea7290d3204b53837a7521af690e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.941031 14010 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9db182bf36444d875b066aec0dd8b8 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:13.942597 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9db182bf36444d875b066aec0dd8b8 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:13.942727 14010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9db182bf36444d875b066aec0dd8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.944108 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9db182bf36444d875b066aec0dd8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.945164 13863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf784ecd514417286b3130eab79f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.948277 14009 tablet_service.cc:1511] Processing CreateTablet for tablet c436335260f04d91845c11162c70c7f1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:13.950055 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c436335260f04d91845c11162c70c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.950549 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 123e199d60f94411b09c3e9ba4ca38fe (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:13.952066 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123e199d60f94411b09c3e9ba4ca38fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.957659 14008 tablet_service.cc:1511] Processing CreateTablet for tablet 94d5a4389d98450b8318ec8f281182ad (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:13.958526 13859 tablet_service.cc:1511] Processing CreateTablet for tablet c436335260f04d91845c11162c70c7f1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:13.959378 14008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d5a4389d98450b8318ec8f281182ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.960005 13859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c436335260f04d91845c11162c70c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.964111 14007 tablet_service.cc:1511] Processing CreateTablet for tablet d00fe8bc507b4059ad259285c1183c92 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:13.965881 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00fe8bc507b4059ad259285c1183c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.971387 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 0f30b80997e84e0aac7842adc7ae98b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:13.967048 13858 tablet_service.cc:1511] Processing CreateTablet for tablet d00fe8bc507b4059ad259285c1183c92 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:13.980340 14086 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea7290d3204b53837a7521af690e79 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:13.980597 14087 tablet_service.cc:1511] Processing CreateTablet for tablet 608ec46055a04e7d9feb7162d37e3fec (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:13.985648 14085 tablet_service.cc:1511] Processing CreateTablet for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:13.982093 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea7290d3204b53837a7521af690e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.987171 14082 tablet_service.cc:1511] Processing CreateTablet for tablet 94d5a4389d98450b8318ec8f281182ad (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:13.982278 14084 tablet_service.cc:1511] Processing CreateTablet for tablet 123e199d60f94411b09c3e9ba4ca38fe (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:13.989277 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 0f30b80997e84e0aac7842adc7ae98b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:13.983477 14083 tablet_service.cc:1511] Processing CreateTablet for tablet c436335260f04d91845c11162c70c7f1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:13.990849 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f30b80997e84e0aac7842adc7ae98b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.993705 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c436335260f04d91845c11162c70c7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:13.996842 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f30b80997e84e0aac7842adc7ae98b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.021709 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d5a4389d98450b8318ec8f281182ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.023725 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.021710 13858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00fe8bc507b4059ad259285c1183c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.030114 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608ec46055a04e7d9feb7162d37e3fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.030467 14080 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb862f5cd014dafaac3c52063ea45d9 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:14.032143 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb862f5cd014dafaac3c52063ea45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.033073 14084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123e199d60f94411b09c3e9ba4ca38fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:14.045295 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:14.049635 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb862f5cd014dafaac3c52063ea45d9 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:14.053769 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb862f5cd014dafaac3c52063ea45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.110510 14143 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:14.067494 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb862f5cd014dafaac3c52063ea45d9 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:14.122807 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb862f5cd014dafaac3c52063ea45d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.122498 13938 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea7290d3204b53837a7521af690e79 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:14.126423 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 82ef392070824cb5a20c5ecebb1b0ce7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:14.130219 13937 tablet_service.cc:1511] Processing CreateTablet for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:14.132153 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 82ef392070824cb5a20c5ecebb1b0ce7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:14.133777 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ef392070824cb5a20c5ecebb1b0ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.133620 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 4c9db182bf36444d875b066aec0dd8b8 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:14.139170 13934 tablet_service.cc:1511] Processing CreateTablet for tablet 94d5a4389d98450b8318ec8f281182ad (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:14.143187 13933 tablet_service.cc:1511] Processing CreateTablet for tablet d00fe8bc507b4059ad259285c1183c92 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:14.145924 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 123e199d60f94411b09c3e9ba4ca38fe (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:14.149529 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 5563bcf555d04206a7dd0106f28be38c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:14.151467 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5563bcf555d04206a7dd0106f28be38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.154552 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 0f30b80997e84e0aac7842adc7ae98b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:14.158723 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 82ef392070824cb5a20c5ecebb1b0ce7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:14.162076 14005 tablet_service.cc:1511] Processing CreateTablet for tablet 5563bcf555d04206a7dd0106f28be38c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:14.165539 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed16159ff574584ad17638f2083106f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:14.167510 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed16159ff574584ad17638f2083106f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.119925 13939 tablet_service.cc:1511] Processing CreateTablet for tablet dcf784ecd514417286b3130eab79f085 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:14.171533 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 1213da0dbe3d443f90796ab3861aeaee (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:14.172127 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 5563bcf555d04206a7dd0106f28be38c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:14.173195 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea7290d3204b53837a7521af690e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.174077 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ef392070824cb5a20c5ecebb1b0ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.177064 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ded665a2ee4f6abfcc6b7b67c0b68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.128543 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ef392070824cb5a20c5ecebb1b0ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.183669 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1213da0dbe3d443f90796ab3861aeaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.186623 13933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00fe8bc507b4059ad259285c1183c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.187930 13934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d5a4389d98450b8318ec8f281182ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.192981 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5563bcf555d04206a7dd0106f28be38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.165555 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed16159ff574584ad17638f2083106f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:14.197676 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f30b80997e84e0aac7842adc7ae98b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.251364 13899 heartbeater.cc:499] Master 127.7.102.190:35547 was elected leader, sending a full tablet report...
I20260709 12:12:14.242542 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 1213da0dbe3d443f90796ab3861aeaee (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:14.253681 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1213da0dbe3d443f90796ab3861aeaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.261838 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed16159ff574584ad17638f2083106f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.273258 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c9db182bf36444d875b066aec0dd8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.275324 13939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf784ecd514417286b3130eab79f085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.276996 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5563bcf555d04206a7dd0106f28be38c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.278625 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123e199d60f94411b09c3e9ba4ca38fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.278965 14082 tablet_service.cc:1511] Processing CreateTablet for tablet 1213da0dbe3d443f90796ab3861aeaee (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:14.282717 14007 tablet_service.cc:1511] Processing CreateTablet for tablet b91647541d8445a9bb817662fd2837e3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:14.301882 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1213da0dbe3d443f90796ab3861aeaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.305505 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91647541d8445a9bb817662fd2837e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.333987 14142 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:14.334779 14087 tablet_service.cc:1511] Processing CreateTablet for tablet b91647541d8445a9bb817662fd2837e3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:14.336333 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91647541d8445a9bb817662fd2837e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.336606 14144 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:14.345511 14142 tablet_bootstrap.cc:654] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.358219 13974 heartbeater.cc:499] Master 127.7.102.190:35547 was elected leader, sending a full tablet report...
I20260709 12:12:14.356426 13862 tablet_service.cc:1511] Processing CreateTablet for tablet 8856b5d7dc044dd8a605f2fd9aebb785 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:14.361213 13862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8856b5d7dc044dd8a605f2fd9aebb785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.363147 14012 tablet_service.cc:1511] Processing CreateTablet for tablet 8856b5d7dc044dd8a605f2fd9aebb785 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:14.364485 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8856b5d7dc044dd8a605f2fd9aebb785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.370404 14083 tablet_service.cc:1511] Processing CreateTablet for tablet f903e94ec2ba4603b5cf9a666701027c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:14.371794 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f903e94ec2ba4603b5cf9a666701027c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.375012 13863 tablet_service.cc:1511] Processing CreateTablet for tablet f903e94ec2ba4603b5cf9a666701027c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:14.375623 14143 tablet_bootstrap.cc:654] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.376421 13863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f903e94ec2ba4603b5cf9a666701027c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.380595 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed16159ff574584ad17638f2083106f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:14.388743 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8d848744b04edc98cec359ea13cace (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:14.391789 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8d848744b04edc98cec359ea13cace (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:14.402737 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed16159ff574584ad17638f2083106f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.403709 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8d848744b04edc98cec359ea13cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.402725 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8d848744b04edc98cec359ea13cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.475517 14048 heartbeater.cc:499] Master 127.7.102.190:35547 was elected leader, sending a full tablet report...
I20260709 12:12:14.496733 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8d848744b04edc98cec359ea13cace (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:14.498348 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8d848744b04edc98cec359ea13cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.504354 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 630f59ad7c7240e99c3f7dba05fa3eb1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:14.505857 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630f59ad7c7240e99c3f7dba05fa3eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.507323 13934 tablet_service.cc:1511] Processing CreateTablet for tablet b91647541d8445a9bb817662fd2837e3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:14.513759 13934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91647541d8445a9bb817662fd2837e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.533358 14144 tablet_bootstrap.cc:654] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.533018 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 630f59ad7c7240e99c3f7dba05fa3eb1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:14.534637 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630f59ad7c7240e99c3f7dba05fa3eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.533406 14146 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:14.512565 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 8856b5d7dc044dd8a605f2fd9aebb785 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:14.545836 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8856b5d7dc044dd8a605f2fd9aebb785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.570127 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 9419dc9ec23f4da88393bda7056bff9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:14.571827 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9419dc9ec23f4da88393bda7056bff9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.590301 13938 tablet_service.cc:1511] Processing CreateTablet for tablet f903e94ec2ba4603b5cf9a666701027c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:14.591945 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f903e94ec2ba4603b5cf9a666701027c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.601794 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 630f59ad7c7240e99c3f7dba05fa3eb1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:14.603349 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630f59ad7c7240e99c3f7dba05fa3eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.612998 14122 heartbeater.cc:499] Master 127.7.102.190:35547 was elected leader, sending a full tablet report...
I20260709 12:12:14.614933 14144 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:14.615535 14144 ts_tablet_manager.cc:1403] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.279s	user 0.000s	sys 0.016s
I20260709 12:12:14.629042 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 9419dc9ec23f4da88393bda7056bff9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:14.630581 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9419dc9ec23f4da88393bda7056bff9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.633822 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 9419dc9ec23f4da88393bda7056bff9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:14.635288 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9419dc9ec23f4da88393bda7056bff9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.639286 14143 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:14.639940 14143 ts_tablet_manager.cc:1403] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.530s	user 0.018s	sys 0.018s
I20260709 12:12:14.639843 14081 tablet_service.cc:1511] Processing CreateTablet for tablet b770dc00e1f8499d88d9fe1d5650d32c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:14.641671 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770dc00e1f8499d88d9fe1d5650d32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.643059 14146 tablet_bootstrap.cc:700] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Time spent opening tablet: real 0.103s	user 0.000s	sys 0.005s
I20260709 12:12:14.643826 14146 tablet_bootstrap.cc:654] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.643388 14144 raft_consensus.cc:359] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:14.644308 14144 raft_consensus.cc:385] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.647449 14143 raft_consensus.cc:359] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:14.648288 13860 tablet_service.cc:1511] Processing CreateTablet for tablet b770dc00e1f8499d88d9fe1d5650d32c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:14.666507 14143 raft_consensus.cc:385] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.666977 14143 raft_consensus.cc:740] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.667412 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770dc00e1f8499d88d9fe1d5650d32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.668008 14143 consensus_queue.cc:260] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:14.666532 14144 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.655014 13936 tablet_service.cc:1511] Processing CreateTablet for tablet b770dc00e1f8499d88d9fe1d5650d32c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:14.670542 14144 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:14.656935 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 9af4ae64d1de450c8bd0508dadc3e2b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:14.671885 13935 tablet_service.cc:1511] Processing CreateTablet for tablet f415f012981848b3aedcb29bc5e00e4b (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:14.676844 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af4ae64d1de450c8bd0508dadc3e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.677326 14142 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:14.677968 14142 ts_tablet_manager.cc:1403] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.344s	user 0.021s	sys 0.009s
I20260709 12:12:14.671921 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770dc00e1f8499d88d9fe1d5650d32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.682677 14142 raft_consensus.cc:359] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:14.683472 14142 raft_consensus.cc:385] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.683809 14142 raft_consensus.cc:740] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.661298 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 9af4ae64d1de450c8bd0508dadc3e2b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:14.664175 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 9af4ae64d1de450c8bd0508dadc3e2b1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:14.686088 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af4ae64d1de450c8bd0508dadc3e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.694285 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af4ae64d1de450c8bd0508dadc3e2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.697412 14012 tablet_service.cc:1511] Processing CreateTablet for tablet f415f012981848b3aedcb29bc5e00e4b (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:14.699779 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f415f012981848b3aedcb29bc5e00e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.699908 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f415f012981848b3aedcb29bc5e00e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.737541 14082 tablet_service.cc:1511] Processing CreateTablet for tablet f415f012981848b3aedcb29bc5e00e4b (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:14.723803 14142 consensus_queue.cc:260] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:14.739951 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f415f012981848b3aedcb29bc5e00e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.765990 14150 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.766753 14150 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:14.771607 14144 ts_tablet_manager.cc:1434] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.008s
I20260709 12:12:14.784498 14143 ts_tablet_manager.cc:1434] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.010s
I20260709 12:12:14.785758 14143 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:14.789058 14150 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:14.803767 14144 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:14.814457 14142 ts_tablet_manager.cc:1434] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.002s
I20260709 12:12:14.815903 14142 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:14.789254 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 0dca4cb3ff414e5dbd73d3036d22ef61 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:14.817530 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dca4cb3ff414e5dbd73d3036d22ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.836699 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 8256693c278a41308741e7b9c2f033a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:14.838323 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8256693c278a41308741e7b9c2f033a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:14.841429 14123 tablet.cc:2406] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:14.830922 13938 tablet_service.cc:1511] Processing CreateTablet for tablet 0dca4cb3ff414e5dbd73d3036d22ef61 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:14.846072 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dca4cb3ff414e5dbd73d3036d22ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.850524 14012 tablet_service.cc:1511] Processing CreateTablet for tablet 0dca4cb3ff414e5dbd73d3036d22ef61 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:14.852126 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dca4cb3ff414e5dbd73d3036d22ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.853567 14146 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:14.854235 14146 ts_tablet_manager.cc:1403] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.321s	user 0.019s	sys 0.021s
I20260709 12:12:14.864952 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:14.867206 13989 leader_election.cc:343] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.867702 14143 tablet_bootstrap.cc:654] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.865051 14144 tablet_bootstrap.cc:654] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.883549 14142 tablet_bootstrap.cc:654] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.883380 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 8256693c278a41308741e7b9c2f033a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:14.884846 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8256693c278a41308741e7b9c2f033a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.888242 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:14.890341 13988 leader_election.cc:343] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.890833 13988 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:14.892100 14150 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.900882 14006 tablet_service.cc:1511] Processing CreateTablet for tablet dcab28297ec5466180129cc4860d9838 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:14.901988 14085 tablet_service.cc:1511] Processing CreateTablet for tablet dcab28297ec5466180129cc4860d9838 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:14.903432 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcab28297ec5466180129cc4860d9838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.903834 13861 tablet_service.cc:1511] Processing CreateTablet for tablet dcab28297ec5466180129cc4860d9838 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:14.905314 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcab28297ec5466180129cc4860d9838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.906179 13936 tablet_service.cc:1511] Processing CreateTablet for tablet fe541614d477406f98fbe7ccaecdba91 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:14.907586 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe541614d477406f98fbe7ccaecdba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.907299 14007 tablet_service.cc:1511] Processing CreateTablet for tablet fe541614d477406f98fbe7ccaecdba91 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:14.902482 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcab28297ec5466180129cc4860d9838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.909389 14083 tablet_service.cc:1511] Processing CreateTablet for tablet fe541614d477406f98fbe7ccaecdba91 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:14.913645 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe541614d477406f98fbe7ccaecdba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.917133 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe541614d477406f98fbe7ccaecdba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.917604 14146 raft_consensus.cc:359] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.918498 14146 raft_consensus.cc:385] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.918852 14146 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.924713 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 8256693c278a41308741e7b9c2f033a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:14.926318 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8256693c278a41308741e7b9c2f033a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.919689 14146 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.943809 14142 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:14.943550 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 2c47dd7750a84d98a2f83efe24a70125 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:14.944474 14142 ts_tablet_manager.cc:1403] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.004s
I20260709 12:12:14.945011 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c47dd7750a84d98a2f83efe24a70125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.949180 14142 raft_consensus.cc:359] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:14.955108 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 2c47dd7750a84d98a2f83efe24a70125 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:14.956712 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c47dd7750a84d98a2f83efe24a70125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.953982 14142 raft_consensus.cc:385] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.964498 14142 raft_consensus.cc:740] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.965927 14144 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:14.966544 14144 ts_tablet_manager.cc:1403] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.009s
I20260709 12:12:14.971778 14142 consensus_queue.cc:260] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:14.978502 14142 ts_tablet_manager.cc:1434] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:12:14.979599 14142 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:14.980993 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 2c47dd7750a84d98a2f83efe24a70125 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:14.983633 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c47dd7750a84d98a2f83efe24a70125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.972412 14143 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:14.986202 14143 ts_tablet_manager.cc:1403] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.201s	user 0.007s	sys 0.008s
I20260709 12:12:14.970008 14144 raft_consensus.cc:359] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.987001 14144 raft_consensus.cc:385] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.987341 14144 raft_consensus.cc:740] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.989818 14143 raft_consensus.cc:359] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.992448 14143 raft_consensus.cc:385] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.992944 14143 raft_consensus.cc:740] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.993902 14143 consensus_queue.cc:260] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.996284 14143 ts_tablet_manager.cc:1434] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.005s
I20260709 12:12:14.991655 14082 tablet_service.cc:1511] Processing CreateTablet for tablet 02548a2cbee943cba6dc06896b099e46 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:14.997435 14143 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:14.997473 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02548a2cbee943cba6dc06896b099e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:14.992439 14144 consensus_queue.cc:260] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:14.999076 14152 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.999624 14152 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:15.013281 14152 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.020681 14142 tablet_bootstrap.cc:654] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.039705 14012 tablet_service.cc:1511] Processing CreateTablet for tablet 2f077c5104b446b1a849137d25615c4c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:15.041292 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f077c5104b446b1a849137d25615c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.040879 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 02548a2cbee943cba6dc06896b099e46 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:15.041684 14144 ts_tablet_manager.cc:1434] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.075s	user 0.002s	sys 0.007s
I20260709 12:12:15.042510 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02548a2cbee943cba6dc06896b099e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.041706 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 2f077c5104b446b1a849137d25615c4c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:15.042994 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 02548a2cbee943cba6dc06896b099e46 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:15.044143 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f077c5104b446b1a849137d25615c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.044591 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02548a2cbee943cba6dc06896b099e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.048031 14143 tablet_bootstrap.cc:654] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.064685 14144 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:15.078539 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 2f077c5104b446b1a849137d25615c4c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:15.080247 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f077c5104b446b1a849137d25615c4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:15.078922 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:15.081986 14146 ts_tablet_manager.cc:1434] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.227s	user 0.025s	sys 0.013s
I20260709 12:12:15.083382 14146 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:15.088505 14144 tablet_bootstrap.cc:654] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.115566 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 92cd840410aa4879adecc48dc70d6cb2 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:15.115943 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 92cd840410aa4879adecc48dc70d6cb2 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:15.117228 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cd840410aa4879adecc48dc70d6cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.117475 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cd840410aa4879adecc48dc70d6cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.129561 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.130545 14083 tablet_service.cc:1511] Processing CreateTablet for tablet 92cd840410aa4879adecc48dc70d6cb2 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:12:15.131480 13840 leader_election.cc:343] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.132206 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cd840410aa4879adecc48dc70d6cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.135092 14142 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:15.135769 14142 ts_tablet_manager.cc:1403] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.017s
I20260709 12:12:15.141458 13860 tablet_service.cc:1511] Processing CreateTablet for tablet c212f97a40314d1dbb07943ef4722563 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:15.142923 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212f97a40314d1dbb07943ef4722563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.144582 14149 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.145239 14149 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:15.149669 13938 tablet_service.cc:1511] Processing CreateTablet for tablet c212f97a40314d1dbb07943ef4722563 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:15.151070 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212f97a40314d1dbb07943ef4722563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.150771 14142 raft_consensus.cc:359] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.151741 14142 raft_consensus.cc:385] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.152123 14142 raft_consensus.cc:740] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.154917 14149 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:15.155225 14007 tablet_service.cc:1511] Processing CreateTablet for tablet c212f97a40314d1dbb07943ef4722563 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:15.157166 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212f97a40314d1dbb07943ef4722563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.144707 14146 tablet_bootstrap.cc:654] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.185359 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 1e33c688f7fe4e14be9fa7c1247d22ba (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:15.187321 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e33c688f7fe4e14be9fa7c1247d22ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.190145 14143 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:15.190779 14143 ts_tablet_manager.cc:1403] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.194s	user 0.026s	sys 0.011s
I20260709 12:12:15.198231 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 1e33c688f7fe4e14be9fa7c1247d22ba (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:15.199712 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e33c688f7fe4e14be9fa7c1247d22ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.199945 14143 raft_consensus.cc:359] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.201284 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7cfd49af7649a6b615a1ca594b2c67 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:15.201951 14143 raft_consensus.cc:385] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.207880 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 1e33c688f7fe4e14be9fa7c1247d22ba (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:15.208923 14083 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7cfd49af7649a6b615a1ca594b2c67 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:15.215966 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7cfd49af7649a6b615a1ca594b2c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.204295 14142 consensus_queue.cc:260] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.209792 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7cfd49af7649a6b615a1ca594b2c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.209996 14160 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.218391 14160 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.205713 14143 raft_consensus.cc:740] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.230398 14149 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.222903 14160 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.237233 14149 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.237895 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7cfd49af7649a6b615a1ca594b2c67 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:15.243355 14143 consensus_queue.cc:260] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.265559 14142 ts_tablet_manager.cc:1434] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.005s
I20260709 12:12:15.266152 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e33c688f7fe4e14be9fa7c1247d22ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.244177 14149 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:15.280352 14144 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:15.292690 14144 ts_tablet_manager.cc:1403] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.228s	user 0.010s	sys 0.012s
I20260709 12:12:15.300473 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:15.301424 14097 raft_consensus.cc:2468] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:15.304831 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7cfd49af7649a6b615a1ca594b2c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.309589 14142 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:15.313357 13837 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:15.315435 14152 raft_consensus.cc:2804] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.315852 14152 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.315655 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:15.316356 14152 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.317811 14082 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd49a6d68614f9a9a7d20bf06695f9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:15.318111 13938 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd49a6d68614f9a9a7d20bf06695f9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:15.319633 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd49a6d68614f9a9a7d20bf06695f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.320019 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd49a6d68614f9a9a7d20bf06695f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.317811 13855 tablet_service.cc:1511] Processing CreateTablet for tablet b2e14a4c4c894f76b64a895bf9dd7faa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:15.322446 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e14a4c4c894f76b64a895bf9dd7faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.333110 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.333943 14144 raft_consensus.cc:359] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.334767 14144 raft_consensus.cc:385] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.335135 14144 raft_consensus.cc:740] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.336109 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:15.338060 14063 leader_election.cc:343] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.349916 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 8c774f66b196446f9e30b948a1733adc (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:15.351480 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c774f66b196446f9e30b948a1733adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.363389 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 8c774f66b196446f9e30b948a1733adc (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:15.373231 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c774f66b196446f9e30b948a1733adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.374043 14143 ts_tablet_manager.cc:1434] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.183s	user 0.011s	sys 0.015s
I20260709 12:12:15.374220 13935 tablet_service.cc:1511] Processing CreateTablet for tablet b2e14a4c4c894f76b64a895bf9dd7faa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:15.375849 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e14a4c4c894f76b64a895bf9dd7faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.376211 14012 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd49a6d68614f9a9a7d20bf06695f9e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:12:15.367566 14063 leader_election.cc:343] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.384714 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 0f350f91cb624fb09ebaf23027f592f5 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:15.389312 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd49a6d68614f9a9a7d20bf06695f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.386201 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f350f91cb624fb09ebaf23027f592f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.394028 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 8c774f66b196446f9e30b948a1733adc (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:15.397109 14143 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:15.401201 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c774f66b196446f9e30b948a1733adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.356914 14144 consensus_queue.cc:260] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.406057 14144 ts_tablet_manager.cc:1434] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 12:12:15.413120 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4bab4e93e2433da0f22757b2011ccf (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:15.414650 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4bab4e93e2433da0f22757b2011ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.414768 14146 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:15.415449 14146 ts_tablet_manager.cc:1403] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.332s	user 0.005s	sys 0.016s
I20260709 12:12:15.427042 14150 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.427762 14150 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.429783 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 0f350f91cb624fb09ebaf23027f592f5 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:15.430351 14150 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:15.433898 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f350f91cb624fb09ebaf23027f592f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.446760 14150 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.448694 14150 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.449620 14146 raft_consensus.cc:359] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.450538 14146 raft_consensus.cc:385] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.450865 14146 raft_consensus.cc:740] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.451768 14146 consensus_queue.cc:260] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.453392 14144 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:15.458375 14007 tablet_service.cc:1511] Processing CreateTablet for tablet b2e14a4c4c894f76b64a895bf9dd7faa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:15.460076 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e14a4c4c894f76b64a895bf9dd7faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.455097 14173 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.464483 14173 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.481930 14152 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:15.482728 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.483378 13874 raft_consensus.cc:2393] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:15.461902 14150 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:15.484898 14063 leader_election.cc:343] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.488147 14142 tablet_bootstrap.cc:654] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.494066 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:15.495062 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:15.496088 13912 leader_election.cc:343] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:15.496753 13840 leader_election.cc:343] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.500039 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4bab4e93e2433da0f22757b2011ccf (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:15.501358 14152 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.501650 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4bab4e93e2433da0f22757b2011ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.502104 14152 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.502714 14152 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:15.505578 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.497464 14173 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:15.509130 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 0f350f91cb624fb09ebaf23027f592f5 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:15.510558 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f350f91cb624fb09ebaf23027f592f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.516765 14176 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.518064 14176 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:15.521139 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:15.523941 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:15.513655 14146 ts_tablet_manager.cc:1434] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 12:12:15.529172 14152 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:15.525460 14143 tablet_bootstrap.cc:654] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.535833 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.540508 14062 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:15.541441 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:15.542289 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4bab4e93e2433da0f22757b2011ccf (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:15.542737 14173 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.543924 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4bab4e93e2433da0f22757b2011ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.545954 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:15.547171 13840 leader_election.cc:343] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:15.547760 13988 leader_election.cc:343] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:15.549225 13988 leader_election.cc:343] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.553556 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:15.555383 14061 leader_election.cc:343] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.558447 14160 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.572764 14160 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.577903 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:15.578800 14095 raft_consensus.cc:2468] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:15.580292 13912 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:15.559527 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:15.560938 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:15.584434 13840 leader_election.cc:343] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.561583 14176 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:15.564222 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 10e5c0206d594f77b1c65f9d7e8584c3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:15.565696 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 10e5c0206d594f77b1c65f9d7e8584c3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:15.566514 14144 tablet_bootstrap.cc:654] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.587590 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e5c0206d594f77b1c65f9d7e8584c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:15.589185 13837 leader_election.cc:343] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.576381 14160 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.597739 14160 raft_consensus.cc:2804] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.598388 14160 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.598932 14160 raft_consensus.cc:3060] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.589679 13837 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:15.601774 14176 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.594125 14061 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:15.601795 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:15.602886 14149 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:15.604256 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 49080.6us
I20260709 12:12:15.611469 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e5c0206d594f77b1c65f9d7e8584c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.613196 14082 tablet_service.cc:1511] Processing CreateTablet for tablet da5bbcf898854fcc96d091127ac642f7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:15.629232 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5bbcf898854fcc96d091127ac642f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:15.635916 13838 leader_election.cc:343] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.636829 13838 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:15.638129 14176 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.643067 14146 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:15.645318 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:15.645707 13989 leader_election.cc:343] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.646502 13989 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:15.646991 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:15.648859 14061 leader_election.cc:343] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.649574 14061 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:15.650732 14149 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.651363 13857 tablet_service.cc:1511] Processing CreateTablet for tablet da5bbcf898854fcc96d091127ac642f7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:15.651515 14150 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:15.658406 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 78188.8us
I20260709 12:12:15.685736 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5bbcf898854fcc96d091127ac642f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.718613 14142 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:15.719431 14142 ts_tablet_manager.cc:1403] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.410s	user 0.033s	sys 0.045s
I20260709 12:12:15.723580 14144 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:15.724339 14144 ts_tablet_manager.cc:1403] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.271s	user 0.054s	sys 0.029s
I20260709 12:12:15.726794 14173 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.728284 13936 tablet_service.cc:1511] Processing CreateTablet for tablet da5bbcf898854fcc96d091127ac642f7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:15.729732 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5bbcf898854fcc96d091127ac642f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.736935 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:12:15.704427 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 58791.2us
I20260709 12:12:15.738343 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e6426591bd40bcac05d7dc8b5bef57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.738476 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:15.738901 13913 leader_election.cc:343] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.739420 13913 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:15.740823 14181 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.741122 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:15.741609 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:15.742981 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e6426591bd40bcac05d7dc8b5bef57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.743520 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e6426591bd40bcac05d7dc8b5bef57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:15.750398 13986 leader_election.cc:343] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.751082 13986 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:15.752120 14150 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:15.753090 13913 leader_election.cc:343] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.756019 14146 tablet_bootstrap.cc:654] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.762689 14097 raft_consensus.cc:2468] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:15.762555 14160 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.765846 14143 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:15.770264 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 744458046f6a4a1ab713dbb3659c7803 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:15.770748 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 744458046f6a4a1ab713dbb3659c7803 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:15.777036 13837 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:15.777668 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744458046f6a4a1ab713dbb3659c7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.777426 14144 raft_consensus.cc:359] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.778362 14144 raft_consensus.cc:385] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.778434 14176 raft_consensus.cc:2804] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.778826 14144 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.779105 14176 raft_consensus.cc:697] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:15.776687 14143 ts_tablet_manager.cc:1403] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.380s	user 0.026s	sys 0.027s
I20260709 12:12:15.780052 14176 consensus_queue.cc:237] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:15.780157 14144 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.774622 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 744458046f6a4a1ab713dbb3659c7803 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:15.786253 14144 ts_tablet_manager.cc:1434] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:12:15.786815 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 10e5c0206d594f77b1c65f9d7e8584c3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:15.787809 14144 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:15.786311 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744458046f6a4a1ab713dbb3659c7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.793814 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e5c0206d594f77b1c65f9d7e8584c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.793596 14142 raft_consensus.cc:359] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.803387 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744458046f6a4a1ab713dbb3659c7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.812228 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:15.813299 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:15.814385 14097 raft_consensus.cc:3060] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:15.814420 13913 leader_election.cc:343] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.798316 14142 raft_consensus.cc:385] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.819303 14142 raft_consensus.cc:740] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.821280 14160 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.825533 13855 tablet_service.cc:1511] Processing CreateTablet for tablet d9646480a7ea4c26ad61c0bd8dc866a0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:15.827322 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9646480a7ea4c26ad61c0bd8dc866a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.833127 14142 consensus_queue.cc:260] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.834291 14143 raft_consensus.cc:359] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:15.835194 14143 raft_consensus.cc:385] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.835568 13771 catalog_manager.cc:5697] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.842346 14142 ts_tablet_manager.cc:1434] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.004s
I20260709 12:12:15.835556 14143 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.843539 14142 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:15.844066 14143 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:15.847767 13935 tablet_service.cc:1511] Processing CreateTablet for tablet d9646480a7ea4c26ad61c0bd8dc866a0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:15.849272 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9646480a7ea4c26ad61c0bd8dc866a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.860188 14007 tablet_service.cc:1511] Processing CreateTablet for tablet d9646480a7ea4c26ad61c0bd8dc866a0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:15.862033 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9646480a7ea4c26ad61c0bd8dc866a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.863895 14143 ts_tablet_manager.cc:1434] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.083s	user 0.018s	sys 0.000s
I20260709 12:12:15.874845 14097 raft_consensus.cc:2468] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:15.875946 14144 tablet_bootstrap.cc:654] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.876371 13912 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:15.881667 14143 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:15.881816 14160 raft_consensus.cc:2804] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.882524 14160 raft_consensus.cc:697] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:15.883869 14160 consensus_queue.cc:237] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.906563 14142 tablet_bootstrap.cc:654] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.898162 14150 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.909073 14150 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.909767 13770 catalog_manager.cc:5697] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.911352 14150 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.916610 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:15.914880 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:15.918475 13986 leader_election.cc:343] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.918475 13949 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:15.920687 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:15.921017 14143 tablet_bootstrap.cc:654] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.922212 14150 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.922608 14150 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.922976 14150 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.942966 14150 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:15.943293 13855 tablet_service.cc:1511] Processing CreateTablet for tablet dbcdeeb9235d42a3b84c08ec08333ad1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:15.945039 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbcdeeb9235d42a3b84c08ec08333ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.946333 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:15.953464 13949 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.962716 13931 tablet_service.cc:1511] Processing CreateTablet for tablet dbcdeeb9235d42a3b84c08ec08333ad1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:15.964784 14146 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:15.965947 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbcdeeb9235d42a3b84c08ec08333ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.968920 14146 ts_tablet_manager.cc:1403] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.351s	user 0.019s	sys 0.006s
I20260709 12:12:15.973116 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:15.975567 13986 leader_election.cc:343] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.976666 14150 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:15.977360 14082 tablet_service.cc:1511] Processing CreateTablet for tablet dbcdeeb9235d42a3b84c08ec08333ad1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:15.978960 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbcdeeb9235d42a3b84c08ec08333ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.980683 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 9e77febf4abc4228b32c2e9fba94574e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:15.982808 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e77febf4abc4228b32c2e9fba94574e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.994818 14143 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:15.995402 14143 ts_tablet_manager.cc:1403] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.114s	user 0.005s	sys 0.021s
I20260709 12:12:15.996236 14142 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:15.997561 14142 ts_tablet_manager.cc:1403] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.003s
I20260709 12:12:15.999107 14143 raft_consensus.cc:359] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:15.999341 14146 raft_consensus.cc:359] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.000029 14143 raft_consensus.cc:385] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.000140 14146 raft_consensus.cc:385] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.000432 14143 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.000588 14146 raft_consensus.cc:740] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.001413 14143 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.001482 14146 consensus_queue.cc:260] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.004386 14146 ts_tablet_manager.cc:1434] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:12:16.005767 14146 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:16.012398 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 9e77febf4abc4228b32c2e9fba94574e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:16.004290 14143 ts_tablet_manager.cc:1434] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:12:16.014633 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e77febf4abc4228b32c2e9fba94574e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.016842 13949 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:16.023375 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:16.017673 14144 tablet_bootstrap.cc:492] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.024447 14144 ts_tablet_manager.cc:1403] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.007s
I20260709 12:12:16.025600 13935 tablet_service.cc:1511] Processing CreateTablet for tablet bbd1ba95f0984c21adf769032d2facd7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:16.027063 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd1ba95f0984c21adf769032d2facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.002516 14142 raft_consensus.cc:359] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.017329 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 9e77febf4abc4228b32c2e9fba94574e (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:16.036978 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e77febf4abc4228b32c2e9fba94574e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.033099 14142 raft_consensus.cc:385] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.037469 14142 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.038242 14150 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.038354 14142 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.038985 14144 raft_consensus.cc:359] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.040663 14144 raft_consensus.cc:385] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.041214 14143 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:16.041636 14173 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.042150 14173 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.041087 14144 raft_consensus.cc:740] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.045985 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.046556 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:16.047780 14062 leader_election.cc:343] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:16.048995 14063 leader_election.cc:343] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.049707 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:16.044498 14173 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.050971 14149 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.036919 14146 tablet_bootstrap.cc:654] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.052754 14142 ts_tablet_manager.cc:1434] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.005s
I20260709 12:12:16.053908 14142 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:16.044098 14144 consensus_queue.cc:260] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.064371 14007 tablet_service.cc:1511] Processing CreateTablet for tablet bbd1ba95f0984c21adf769032d2facd7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:16.066448 14176 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.067109 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd1ba95f0984c21adf769032d2facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.066987 14176 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.069226 14176 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:16.070956 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.071671 14022 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:16.073046 13838 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:16.075080 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:16.076656 13837 leader_election.cc:343] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.077656 14176 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.078080 14176 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.078420 14176 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.078727 14143 tablet_bootstrap.cc:654] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.081157 14079 tablet_service.cc:1511] Processing CreateTablet for tablet bbd1ba95f0984c21adf769032d2facd7 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:16.082636 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd1ba95f0984c21adf769032d2facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.091792 14142 tablet_bootstrap.cc:654] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:16.107159 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:16.119531 14150 raft_consensus.cc:697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:16.120759 14150 consensus_queue.cc:237] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.119573 14144 ts_tablet_manager.cc:1434] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.009s
I20260709 12:12:16.123631 14144 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:16.127079 14176 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.131698 14146 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:16.148181 14146 ts_tablet_manager.cc:1403] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.003s
I20260709 12:12:16.149363 14176 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:16.132010 14143 tablet_bootstrap.cc:492] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:16.151533 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:16.152068 14143 ts_tablet_manager.cc:1403] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.004s
W20260709 12:12:16.153144 13837 leader_election.cc:343] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.151542 13772 catalog_manager.cc:5697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.154387 14146 raft_consensus.cc:359] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.155246 14146 raft_consensus.cc:385] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.155546 14146 raft_consensus.cc:740] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.155831 14143 raft_consensus.cc:359] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.157070 14143 raft_consensus.cc:385] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.139354 14144 tablet_bootstrap.cc:654] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.157545 14143 raft_consensus.cc:740] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.159035 14143 consensus_queue.cc:260] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.144433 14079 tablet_service.cc:1511] Processing CreateTablet for tablet e6db04338ea848b182d7538561667571 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:16.145892 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 67a590283c194e508b8eaab0070f9c01 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:16.151986 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:16.164211 14022 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.164685 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a590283c194e508b8eaab0070f9c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.134913 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 67a590283c194e508b8eaab0070f9c01 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:16.167860 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a590283c194e508b8eaab0070f9c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.134109 14142 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:16.173360 14142 ts_tablet_manager.cc:1403] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.002s
I20260709 12:12:16.176954 14022 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:16.177557 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6db04338ea848b182d7538561667571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.178356 13838 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:16.179562 14176 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.180274 14176 raft_consensus.cc:697] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:16.181638 14176 consensus_queue.cc:237] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.183661 14142 raft_consensus.cc:359] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.184581 14142 raft_consensus.cc:385] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.185009 14142 raft_consensus.cc:740] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.185940 14142 consensus_queue.cc:260] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.188745 14142 ts_tablet_manager.cc:1434] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:12:16.189918 14142 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:16.156502 14146 consensus_queue.cc:260] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.143970 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 67a590283c194e508b8eaab0070f9c01 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:16.193393 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a590283c194e508b8eaab0070f9c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.193691 14146 ts_tablet_manager.cc:1434] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:12:16.195502 14143 ts_tablet_manager.cc:1434] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:12:16.196700 14143 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:16.198881 14144 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.199524 14144 ts_tablet_manager.cc:1403] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.003s
I20260709 12:12:16.202790 14144 raft_consensus.cc:359] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.203569 14144 raft_consensus.cc:385] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.203871 14144 raft_consensus.cc:740] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.204432 14146 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:16.205984 14143 tablet_bootstrap.cc:654] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.210908 14179 consensus_queue.cc:1048] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.216698 13860 tablet_service.cc:1511] Processing CreateTablet for tablet e6db04338ea848b182d7538561667571 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:16.218530 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6db04338ea848b182d7538561667571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.220288 14160 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.220952 14160 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.221249 14144 consensus_queue.cc:260] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.225317 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:16.226022 14096 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:16.226722 14144 ts_tablet_manager.cc:1434] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:12:16.227864 14144 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:16.231513 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.232268 14022 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:16.219841 14146 tablet_bootstrap.cc:654] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.251133 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 1030856707044fac9c27c8699f2e770c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:16.236904 14160 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:16.256484 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 1030856707044fac9c27c8699f2e770c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:16.247385 13913 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:16.257805 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1030856707044fac9c27c8699f2e770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.263767 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1030856707044fac9c27c8699f2e770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.264778 14149 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.265314 14149 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.268821 14160 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.269541 14160 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.269987 14160 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.272542 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.273154 14149 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.273499 14022 raft_consensus.cc:2393] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:16.274911 13931 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e25fe9f77426fa4a403ff3ebbdf29 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:16.275552 14006 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e25fe9f77426fa4a403ff3ebbdf29 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:16.276496 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e25fe9f77426fa4a403ff3ebbdf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.277325 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e25fe9f77426fa4a403ff3ebbdf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.283494 14144 tablet_bootstrap.cc:654] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.283389 13935 tablet_service.cc:1511] Processing CreateTablet for tablet e6db04338ea848b182d7538561667571 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:16.274945 14149 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.284770 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.281934 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 1030856707044fac9c27c8699f2e770c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:16.293583 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6db04338ea848b182d7538561667571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.292481 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1030856707044fac9c27c8699f2e770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.293517 13772 catalog_manager.cc:5697] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.302934 14062 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:16.305560 14173 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.295229 14149 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.317924 14082 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e25fe9f77426fa4a403ff3ebbdf29 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:16.318588 14149 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.319145 14142 tablet_bootstrap.cc:654] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.319561 14082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e25fe9f77426fa4a403ff3ebbdf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.320967 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.321496 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.322223 13873 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
W20260709 12:12:16.322623 14061 leader_election.cc:343] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.322609 14160 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.322646 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 2e383edb46924bb08f4ffe03e4a9ecf3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:16.323719 14062 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:16.324800 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e383edb46924bb08f4ffe03e4a9ecf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.325134 14149 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.325614 14149 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.325969 14149 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:16.331802 13913 consensus_peers.cc:597] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 -> Peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Couldn't send request to peer 4c9b84be2fea4f7094b49292ec17dabe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.331984 14143 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:16.337812 14143 ts_tablet_manager.cc:1403] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.141s	user 0.067s	sys 0.018s
I20260709 12:12:16.331916 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 2e383edb46924bb08f4ffe03e4a9ecf3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:16.339489 14173 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.340083 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e383edb46924bb08f4ffe03e4a9ecf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.341177 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 2e383edb46924bb08f4ffe03e4a9ecf3 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:16.342528 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e383edb46924bb08f4ffe03e4a9ecf3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:16.364073 13840 consensus_peers.cc:597] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.364091 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:16.365073 14022 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.366714 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5506586a24f8084e47741b1525e94 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:16.368301 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5506586a24f8084e47741b1525e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.375542 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5506586a24f8084e47741b1525e94 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:16.377143 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5506586a24f8084e47741b1525e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.383739 14144 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.384341 14144 ts_tablet_manager.cc:1403] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.009s
I20260709 12:12:16.388084 14144 raft_consensus.cc:359] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.389189 14144 raft_consensus.cc:385] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.389482 14144 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.390388 14144 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.379961 14143 raft_consensus.cc:359] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.392602 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5506586a24f8084e47741b1525e94 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:16.393239 14143 raft_consensus.cc:385] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.393582 14150 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.393776 14143 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.394178 14150 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.394716 14143 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.396821 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5506586a24f8084e47741b1525e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.393306 14176 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.398443 14176 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.400511 14144 ts_tablet_manager.cc:1434] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:12:16.396523 14150 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.380281 14160 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:16.402066 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb75018f45482792118f2733509fd0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:16.402307 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:16.403437 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb75018f45482792118f2733509fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.404175 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.404958 14023 raft_consensus.cc:2468] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
W20260709 12:12:16.405970 13840 leader_election.cc:343] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.392479 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:16.407058 14097 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.407334 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.407548 14176 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:16.409413 13873 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:16.410503 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:16.408066 13838 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:16.412405 13989 leader_election.cc:343] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.411484 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 040f8a0271784f748abc1ed10f9440a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:16.414093 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040f8a0271784f748abc1ed10f9440a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.414279 14176 raft_consensus.cc:2804] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.414702 14176 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.415022 14176 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.414093 13988 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:16.417443 14022 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:16.418186 14150 raft_consensus.cc:2804] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.418740 13913 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:16.419755 14160 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.420243 14160 raft_consensus.cc:697] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:16.421185 14160 consensus_queue.cc:237] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.418641 14150 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.411756 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb75018f45482792118f2733509fd0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:16.425079 14150 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.426024 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb75018f45482792118f2733509fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.430276 14144 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:16.407148 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 040f8a0271784f748abc1ed10f9440a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:16.433957 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040f8a0271784f748abc1ed10f9440a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.418507 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb75018f45482792118f2733509fd0 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:16.437295 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb75018f45482792118f2733509fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.461198 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 040f8a0271784f748abc1ed10f9440a1 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:16.463232 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040f8a0271784f748abc1ed10f9440a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.463259 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 37b8bed45862453fa77c3294a4231b24 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:16.467557 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b8bed45862453fa77c3294a4231b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.470007 14181 consensus_queue.cc:1048] T 82ef392070824cb5a20c5ecebb1b0ce7 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.488886 14181 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.489639 14181 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:16.507306 13757 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 44548.3us
I20260709 12:12:16.508477 14142 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:16.509347 14142 ts_tablet_manager.cc:1403] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.002s
I20260709 12:12:16.510911 14097 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
W20260709 12:12:16.513190 13756 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 48130.4us
I20260709 12:12:16.508278 13772 catalog_manager.cc:5697] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.516527 14144 tablet_bootstrap.cc:654] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.471441 14143 ts_tablet_manager.cc:1434] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.004s
I20260709 12:12:16.518065 14143 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:16.519927 14149 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.521107 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:16.522274 14149 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:16.522801 13912 leader_election.cc:343] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.523705 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:16.526815 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:16.527784 13873 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.527453 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 37b8bed45862453fa77c3294a4231b24 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:12:16.529440 14061 leader_election.cc:343] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.529867 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b8bed45862453fa77c3294a4231b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.565322 14146 tablet_bootstrap.cc:492] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:16.566215 14146 ts_tablet_manager.cc:1403] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.362s	user 0.032s	sys 0.007s
I20260709 12:12:16.571080 14195 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.571767 14195 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.578588 14142 raft_consensus.cc:359] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.579453 14142 raft_consensus.cc:385] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.579774 14142 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.580387 14195 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.573849 14181 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.581648 14196 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.582180 14196 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.584383 14196 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.595582 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:16.605301 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 37b8bed45862453fa77c3294a4231b24 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:16.607221 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b8bed45862453fa77c3294a4231b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.580621 14142 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.616683 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 93543c2dbfd24b67ace7fa568ca3371f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:16.622952 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93543c2dbfd24b67ace7fa568ca3371f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:16.625944 13989 leader_election.cc:343] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.636551 14143 tablet_bootstrap.cc:654] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.637531 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 93543c2dbfd24b67ace7fa568ca3371f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:16.642248 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93543c2dbfd24b67ace7fa568ca3371f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.651135 14179 consensus_queue.cc:1048] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.653932 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:16.655700 14144 tablet_bootstrap.cc:492] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.656304 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 93543c2dbfd24b67ace7fa568ca3371f (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:16.657789 14176 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.658490 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93543c2dbfd24b67ace7fa568ca3371f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.660023 14176 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:16.656322 14144 ts_tablet_manager.cc:1403] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.226s	user 0.025s	sys 0.026s
I20260709 12:12:16.664642 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:16.666622 13840 leader_election.cc:343] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.656221 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccd00234165409b8ef52c632801c99c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:16.667656 14146 raft_consensus.cc:359] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.668671 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccd00234165409b8ef52c632801c99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.668969 14146 raft_consensus.cc:385] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.669399 14146 raft_consensus.cc:740] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.670328 14144 raft_consensus.cc:359] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.671852 14144 raft_consensus.cc:385] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.672598 14144 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.681241 14144 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.688330 14150 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:16.696913 13989 leader_election.cc:343] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.690976 14150 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.705067 14144 ts_tablet_manager.cc:1434] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.004s
I20260709 12:12:16.707296 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.711510 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:16.712232 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.714529 14144 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
W20260709 12:12:16.715272 13989 leader_election.cc:343] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.718664 13873 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:16.721737 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccd00234165409b8ef52c632801c99c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:16.730984 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccd00234165409b8ef52c632801c99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.732031 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccd00234165409b8ef52c632801c99c (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:16.733613 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccd00234165409b8ef52c632801c99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.714583 14150 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:12:16.731014 14062 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:16.741330 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:16.743813 13873 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.744416 14144 tablet_bootstrap.cc:654] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.744830 14149 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.745395 14149 raft_consensus.cc:697] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:16.746344 14149 consensus_queue.cc:237] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.748198 14142 ts_tablet_manager.cc:1434] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.238s	user 0.020s	sys 0.024s
I20260709 12:12:16.742875 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:16.761056 14022 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.762012 14142 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
W20260709 12:12:16.749718 13988 leader_election.cc:343] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.755262 14143 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:16.763540 14143 ts_tablet_manager.cc:1403] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.246s	user 0.007s	sys 0.017s
I20260709 12:12:16.763064 13988 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:16.765441 13988 leader_election.cc:343] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.765986 13988 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:16.766721 14195 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.767462 14195 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.774855 14144 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.782245 14144 ts_tablet_manager.cc:1403] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.014s
I20260709 12:12:16.766851 14143 raft_consensus.cc:359] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.784561 14143 raft_consensus.cc:385] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.785081 14143 raft_consensus.cc:740] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.785971 14143 consensus_queue.cc:260] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.788157 14144 raft_consensus.cc:359] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.788990 14144 raft_consensus.cc:385] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.789276 14144 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.790126 14144 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.708600 14146 consensus_queue.cc:260] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.801990 13771 catalog_manager.cc:5697] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.802062 14144 ts_tablet_manager.cc:1434] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
W20260709 12:12:16.806268 13986 consensus_peers.cc:597] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe -> Peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Couldn't send request to peer f808da6a0c774bf4aa2e0ad137d6a74e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.806768 14144 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:16.816789 14146 ts_tablet_manager.cc:1434] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.250s	user 0.012s	sys 0.000s
I20260709 12:12:16.818212 14143 ts_tablet_manager.cc:1434] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.004s
I20260709 12:12:16.818810 14142 tablet_bootstrap.cc:654] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.819123 14146 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:16.819341 14143 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:16.821146 14022 raft_consensus.cc:2468] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:16.799729 13873 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:16.823181 13838 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:16.825070 14179 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.825637 14179 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.826663 14146 tablet_bootstrap.cc:654] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.830523 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:16.831229 14097 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:16.832050 14144 tablet_bootstrap.cc:654] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.835122 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:16.836153 14224 raft_consensus.cc:2804] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.828380 14176 consensus_queue.cc:1048] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:12:16.843473 13837 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:16.844966 13840 leader_election.cc:343] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.846551 14216 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.847118 14216 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.847514 14216 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.849866 13988 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:16.836762 14179 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.851997 14223 raft_consensus.cc:2804] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.852352 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.852607 14223 raft_consensus.cc:697] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:16.853159 13873 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:16.853595 14223 consensus_queue.cc:237] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.861465 14160 consensus_queue.cc:1048] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.863742 14149 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.864485 14149 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.869706 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.873317 14143 tablet_bootstrap.cc:654] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.868098 14149 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.837175 14224 raft_consensus.cc:697] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:16.861506 13914 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:16.879899 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:16.880681 14023 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:16.881719 14160 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.882150 14160 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.882485 14160 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.874497 14196 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.885967 14196 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:16.876359 14062 leader_election.cc:343] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.875025 14216 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.897850 14142 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:16.898474 14142 ts_tablet_manager.cc:1403] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.027s
I20260709 12:12:16.900949 14146 tablet_bootstrap.cc:492] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:16.892498 14196 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.902612 14142 raft_consensus.cc:359] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.905843 14142 raft_consensus.cc:385] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.906260 14142 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.906463 14146 ts_tablet_manager.cc:1403] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.032s
I20260709 12:12:16.908696 14142 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.903153 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.914630 13873 raft_consensus.cc:2393] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:16.915246 14142 ts_tablet_manager.cc:1434] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:12:16.905143 14061 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:16.916296 14149 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.916898 14173 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.912312 14224 consensus_queue.cc:237] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:16.917398 14173 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:16.918206 14142 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:16.919634 14173 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:16.920449 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:16.920751 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:16.922519 14063 leader_election.cc:343] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.922736 13986 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:16.924438 14196 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.925282 14142 tablet_bootstrap.cc:654] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.916684 14149 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.932091 14149 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.937075 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:16.939165 14061 leader_election.cc:343] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.939692 14181 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.939807 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:16.940306 14181 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.940846 14173 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.941596 13768 catalog_manager.cc:5697] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.946928 14181 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.947289 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:16.949530 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:16.953262 13914 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:16.954598 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:16.954941 14181 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.956291 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:16.954886 14216 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:16.958745 14096 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:16.960572 13840 leader_election.cc:343] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.962786 13771 catalog_manager.cc:5697] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.968916 14181 consensus_queue.cc:1048] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.979344 14149 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:16.976328 14146 raft_consensus.cc:359] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.982942 14146 raft_consensus.cc:385] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.983407 14146 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.986372 14146 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:16.989660 14144 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:16.990373 14144 ts_tablet_manager.cc:1403] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.028s
I20260709 12:12:16.994938 14149 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:16.997150 14196 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.999636 14143 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:16.999325 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:17.000304 14143 ts_tablet_manager.cc:1403] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.181s	user 0.027s	sys 0.006s
W20260709 12:12:17.004827 14062 leader_election.cc:343] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.997431 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:17.005643 14023 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.004980 14144 raft_consensus.cc:359] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.006217 14144 raft_consensus.cc:385] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.006567 14144 raft_consensus.cc:740] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.007560 14143 raft_consensus.cc:359] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.009315 14143 raft_consensus.cc:385] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.007611 14144 consensus_queue.cc:260] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.010393 14143 raft_consensus.cc:740] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.012533 14144 ts_tablet_manager.cc:1434] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:12:17.015403 14144 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:17.016415 14143 consensus_queue.cc:260] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.019964 14142 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:17.020572 14142 ts_tablet_manager.cc:1403] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.019s
I20260709 12:12:17.019972 14143 ts_tablet_manager.cc:1434] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:12:17.022153 14146 ts_tablet_manager.cc:1434] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.005s
I20260709 12:12:17.022426 14143 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.023944 14142 raft_consensus.cc:359] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.024806 14142 raft_consensus.cc:385] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.025118 14142 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.026000 14142 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.037794 14143 tablet_bootstrap.cc:654] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.038635 14146 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.059700 14142 ts_tablet_manager.cc:1434] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:12:17.061246 14142 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:17.061543 14144 tablet_bootstrap.cc:654] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.060883 14160 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.064459 14160 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:17.066071 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:17.066788 13873 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.069247 14023 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:17.070842 14061 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:17.072221 14149 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.072755 14149 raft_consensus.cc:697] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:17.073523 14146 tablet_bootstrap.cc:654] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.073638 14149 consensus_queue.cc:237] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.069295 14096 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
W20260709 12:12:17.059382 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 69796.9us
I20260709 12:12:17.082415 13837 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:17.083781 14216 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.084283 14216 raft_consensus.cc:697] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:17.085211 14216 consensus_queue.cc:237] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.087177 13873 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:17.094524 14173 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.095325 14173 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.104971 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:17.107153 13912 leader_election.cc:343] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.111032 13914 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:17.113301 14160 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.114102 14160 raft_consensus.cc:697] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:17.115612 14142 tablet_bootstrap.cc:654] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.115326 14160 consensus_queue.cc:237] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.129009 14143 tablet_bootstrap.cc:492] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:17.136025 14143 ts_tablet_manager.cc:1403] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.114s	user 0.031s	sys 0.011s
I20260709 12:12:17.136621 13768 catalog_manager.cc:5697] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.139731 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.140542 14143 raft_consensus.cc:359] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.141782 14143 raft_consensus.cc:385] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.142089 14143 raft_consensus.cc:740] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
W20260709 12:12:17.143301 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:17.132822 14173 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.142877 14143 consensus_queue.cc:260] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.129088 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:17.144416 14063 leader_election.cc:343] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.147415 14143 ts_tablet_manager.cc:1434] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
W20260709 12:12:17.152603 14062 leader_election.cc:343] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.155187 14143 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.155107 14062 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:17.149905 14146 tablet_bootstrap.cc:492] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.156886 14173 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.157191 14146 ts_tablet_manager.cc:1403] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.011s
I20260709 12:12:17.157210 13769 catalog_manager.cc:5697] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.161723 14146 raft_consensus.cc:359] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.162467 14146 raft_consensus.cc:385] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.162750 14146 raft_consensus.cc:740] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.163499 14146 consensus_queue.cc:260] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.168145 14146 ts_tablet_manager.cc:1434] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:12:17.168848 14143 tablet_bootstrap.cc:654] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.169256 14146 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.172560 14144 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:17.173161 14144 ts_tablet_manager.cc:1403] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.158s	user 0.009s	sys 0.014s
I20260709 12:12:17.174623 13771 catalog_manager.cc:5697] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.176219 14144 raft_consensus.cc:359] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.177016 14144 raft_consensus.cc:385] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.177287 14144 raft_consensus.cc:740] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.178146 14144 consensus_queue.cc:260] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.178653 14146 tablet_bootstrap.cc:654] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.185850 14173 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.195616 14144 ts_tablet_manager.cc:1434] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:12:17.200261 14144 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:17.178716 14142 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:17.206611 14142 ts_tablet_manager.cc:1403] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.006s
I20260709 12:12:17.217267 14144 tablet_bootstrap.cc:654] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.219974 14142 raft_consensus.cc:359] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.221917 14142 raft_consensus.cc:385] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.222288 14142 raft_consensus.cc:740] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.227753 14142 consensus_queue.cc:260] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.229743 14142 ts_tablet_manager.cc:1434] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:12:17.226262 14146 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.230886 14146 ts_tablet_manager.cc:1403] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.062s	user 0.035s	sys 0.020s
I20260709 12:12:17.231199 14143 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:17.231477 14142 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:17.237252 14143 ts_tablet_manager.cc:1403] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.025s
I20260709 12:12:17.238593 14142 tablet_bootstrap.cc:654] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.241534 14143 raft_consensus.cc:359] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.243618 14143 raft_consensus.cc:385] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.243964 14143 raft_consensus.cc:740] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.244778 14143 consensus_queue.cc:260] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.244117 14146 raft_consensus.cc:359] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.247619 14146 raft_consensus.cc:385] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.247954 14146 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.249068 14146 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.250758 14144 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:17.251314 14144 ts_tablet_manager.cc:1403] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.002s
I20260709 12:12:17.263566 14146 ts_tablet_manager.cc:1434] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 12:12:17.263911 14149 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.265192 14146 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.275561 14146 tablet_bootstrap.cc:654] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.279539 14149 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.281163 14149 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.286741 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.286832 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.288079 13874 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:17.290243 14149 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.292482 14144 raft_consensus.cc:359] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.293535 14144 raft_consensus.cc:385] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.293286 14062 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:17.294034 14144 raft_consensus.cc:740] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.294757 14149 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.280400 14142 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:17.301134 14142 ts_tablet_manager.cc:1403] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.000s
I20260709 12:12:17.302983 14143 ts_tablet_manager.cc:1434] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.065s	user 0.028s	sys 0.023s
I20260709 12:12:17.304409 14143 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.303725 14144 consensus_queue.cc:260] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.311455 14144 ts_tablet_manager.cc:1434] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 12:12:17.312320 14144 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:17.316681 13949 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.319994 14146 tablet_bootstrap.cc:492] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.320227 14216 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.320833 14216 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.323987 14143 tablet_bootstrap.cc:654] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.324661 14173 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.325197 14173 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.324038 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.327443 14173 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:17.327632 13840 leader_election.cc:343] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.329166 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:17.329551 14142 raft_consensus.cc:359] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.330412 14142 raft_consensus.cc:385] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.330703 14142 raft_consensus.cc:740] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.329929 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:17.331297 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.331634 14021 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:17.331472 14216 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.332343 14146 ts_tablet_manager.cc:1403] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.009s
I20260709 12:12:17.333333 13838 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:17.330986 14061 leader_election.cc:343] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.335040 14216 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.335443 14146 raft_consensus.cc:359] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.336138 14146 raft_consensus.cc:385] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.335927 14142 consensus_queue.cc:260] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.336412 14146 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.335445 14216 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.337008 14195 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.337147 14146 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.337982 14195 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.339259 14149 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.342379 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.343318 13873 raft_consensus.cc:2468] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:17.346033 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.339422 14146 ts_tablet_manager.cc:1434] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:17.348228 13988 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:17.349233 14146 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.350193 14196 raft_consensus.cc:2804] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.350816 14196 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.351272 14196 raft_consensus.cc:3060] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.337064 14216 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.340615 14195 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:17.362406 14146 tablet_bootstrap.cc:654] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:17.362905 13986 leader_election.cc:343] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.339807 14142 ts_tablet_manager.cc:1434] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:12:17.370040 14142 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:17.381265 14160 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.381973 14160 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.384495 14160 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:17.389930 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.332069 14144 tablet_bootstrap.cc:654] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.388270 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.393110 14096 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:17.394981 14216 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.395592 13914 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:17.337270 14062 leader_election.cc:343] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.415652 14143 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:17.416307 14143 ts_tablet_manager.cc:1403] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.056s
I20260709 12:12:17.416186 14062 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:17.417374 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 84038.1us
I20260709 12:12:17.418123 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:17.418857 13948 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.419540 14143 raft_consensus.cc:359] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.420360 14143 raft_consensus.cc:385] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:17.420680 13840 consensus_peers.cc:597] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.420692 14143 raft_consensus.cc:740] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.421533 14195 consensus_queue.cc:1048] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.422174 14149 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.415721 14216 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.423135 14216 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.423630 14216 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.423965 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:17.424615 14023 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.427591 14216 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.427492 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:17.428540 13948 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:17.420814 14160 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.407255 14142 tablet_bootstrap.cc:654] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.430023 13840 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:17.412177 14196 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.431314 14216 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.421764 14143 consensus_queue.cc:260] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.428772 14021 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:17.427470 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.405906 13949 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.433208 13838 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:17.434034 13840 leader_election.cc:343] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.436347 14224 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.411676 14146 tablet_bootstrap.cc:492] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.442010 14224 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.442397 14146 ts_tablet_manager.cc:1403] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.025s
I20260709 12:12:17.442502 14224 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.443454 14160 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.441737 14023 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:17.446372 14195 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.446915 14195 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.448783 14144 tablet_bootstrap.cc:492] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:17.449730 14195 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:17.450063 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.450503 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:17.451836 13989 leader_election.cc:343] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:17.452484 13986 leader_election.cc:343] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.452564 14216 raft_consensus.cc:697] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:17.449417 14144 ts_tablet_manager.cc:1403] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.001s
I20260709 12:12:17.453425 13986 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:17.454970 14195 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.456801 14142 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:17.457366 14142 ts_tablet_manager.cc:1403] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 12:12:17.445854 14146 raft_consensus.cc:359] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.458762 14146 raft_consensus.cc:385] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.459115 14146 raft_consensus.cc:740] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.461908 14142 raft_consensus.cc:359] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.462668 14142 raft_consensus.cc:385] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.462954 14142 raft_consensus.cc:740] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.463896 14223 consensus_queue.cc:1048] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.464368 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:17.465161 13873 raft_consensus.cc:3060] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.465050 14142 consensus_queue.cc:260] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.468067 14142 ts_tablet_manager.cc:1434] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:12:17.448489 14143 ts_tablet_manager.cc:1434] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:12:17.469889 14196 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:17.463905 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:17.478653 13986 leader_election.cc:343] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.469425 14142 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:17.480077 14224 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.460557 14144 raft_consensus.cc:359] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.467576 14216 consensus_queue.cc:237] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.470371 14146 consensus_queue.cc:260] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.475673 14143 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.483134 14224 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.484011 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:17.485800 13840 leader_election.cc:343] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.480093 14179 consensus_queue.cc:1048] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.488719 14160 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.489346 14160 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.488876 14144 raft_consensus.cc:385] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.490106 14146 ts_tablet_manager.cc:1434] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 12:12:17.493242 14144 raft_consensus.cc:740] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.494510 14143 tablet_bootstrap.cc:654] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.494658 14144 consensus_queue.cc:260] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.495368 14146 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.497223 13873 raft_consensus.cc:2468] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:17.501348 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:17.502763 13913 leader_election.cc:343] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.503544 14160 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.506747 14143 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:17.507301 14143 ts_tablet_manager.cc:1403] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 12:12:17.510769 14143 raft_consensus.cc:359] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.511472 14143 raft_consensus.cc:385] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.511816 14146 tablet_bootstrap.cc:654] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.511932 14143 raft_consensus.cc:740] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.513171 14143 consensus_queue.cc:260] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.512032 14144 ts_tablet_manager.cc:1434] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 12:12:17.520319 14143 ts_tablet_manager.cc:1434] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:17.521785 14143 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.523460 14144 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:17.526718 13988 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:17.528513 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:17.541292 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.530043 14196 raft_consensus.cc:2804] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.543650 14196 raft_consensus.cc:697] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:17.544588 14196 consensus_queue.cc:237] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:17.544958 14261 consensus_queue.cc:1048] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.541365 14235 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.546010 14235 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.531672 14224 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.536024 14023 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.559054 14144 tablet_bootstrap.cc:654] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.566323 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:17.567152 14022 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:17.555506 14235 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:17.557996 14224 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.582022 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.583494 14143 tablet_bootstrap.cc:654] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:17.585458 13914 leader_election.cc:343] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.595227 14149 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.587497 14223 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.596769 14097 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:17.597203 14223 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.599493 14223 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:17.595384 14142 tablet_bootstrap.cc:654] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.604763 13914 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:17.612023 14235 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.613348 14235 consensus_queue.cc:1048] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.613612 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.614436 14224 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.616942 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.617941 14095 raft_consensus.cc:2468] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:17.601531 13913 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:17.629434 13837 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:17.630764 14236 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.631160 14236 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.631467 14236 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.629242 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.629281 14149 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.634111 14149 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.636336 14149 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.637688 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.643049 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.645500 13989 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:17.644358 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:17.646775 13840 leader_election.cc:343] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.647436 14022 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:17.646723 14196 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.648483 13768 catalog_manager.cc:5697] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:17.649524 14063 leader_election.cc:343] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.633179 14224 raft_consensus.cc:2804] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.657116 14224 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.667869 14224 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.668195 14061 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:17.670286 14249 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.670670 14249 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.670974 14249 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.678042 13771 catalog_manager.cc:5697] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.679358 14022 raft_consensus.cc:3060] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.680295 14146 tablet_bootstrap.cc:492] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.703491 14146 ts_tablet_manager.cc:1403] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.210s	user 0.029s	sys 0.011s
I20260709 12:12:17.706512 14146 raft_consensus.cc:359] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.685354 14160 consensus_queue.cc:1048] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.711035 14249 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.712929 14146 raft_consensus.cc:385] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.713397 14146 raft_consensus.cc:740] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
W20260709 12:12:17.688035 14062 consensus_peers.cc:597] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e -> Peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Couldn't send request to peer 6f3e7e9dcfab49fb99d979c338c67ffb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.693631 14216 consensus_queue.cc:1048] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.686681 14023 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:17.718600 14146 consensus_queue.cc:260] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.733575 14144 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:17.737423 14144 ts_tablet_manager.cc:1403] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.219s	user 0.048s	sys 0.068s
I20260709 12:12:17.740797 14146 ts_tablet_manager.cc:1434] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:12:17.742569 14146 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:17.723482 14236 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.746840 13838 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:17.789204 14265 log.cc:927] Time spent T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:12:17.789716 14236 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:17.791306 14144 raft_consensus.cc:359] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.792270 14144 raft_consensus.cc:385] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.793329 14249 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.792604 14144 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.795694 14146 tablet_bootstrap.cc:654] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.795506 14144 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.795964 14224 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.796967 14261 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.754056 14149 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.798375 14144 ts_tablet_manager.cc:1434] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:12:17.806118 14144 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:17.803385 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:17.807816 14023 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.803756 14261 raft_consensus.cc:697] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:17.818104 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:17.819005 14097 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.802891 14149 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.832777 14142 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:17.833108 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:17.833436 14142 ts_tablet_manager.cc:1403] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.364s	user 0.027s	sys 0.024s
W20260709 12:12:17.827705 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 75337.4us
I20260709 12:12:17.835135 14143 tablet_bootstrap.cc:492] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
W20260709 12:12:17.835348 14063 leader_election.cc:343] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.835821 14143 ts_tablet_manager.cc:1403] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.314s	user 0.022s	sys 0.019s
I20260709 12:12:17.846701 14143 raft_consensus.cc:359] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.847533 14143 raft_consensus.cc:385] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.847819 14143 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.848374 14261 consensus_queue.cc:237] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.821620 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:17.854300 14021 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.857133 14276 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.857765 14276 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.860679 14224 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.861986 13949 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.863161 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.862141 14149 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.864030 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:17.865881 14063 leader_election.cc:343] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:17.866416 13840 leader_election.cc:343] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.867158 14276 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:17.870195 14143 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.876771 14143 ts_tablet_manager.cc:1434] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:12:17.877086 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:17.882047 14094 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:17.871570 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:17.879045 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:17.883813 14093 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:17.884793 13840 leader_election.cc:343] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:17.886582 14097 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:17.886593 14143 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:17.879853 14144 tablet_bootstrap.cc:654] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.893630 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:17.903719 13912 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:17.906797 14235 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.907338 14235 raft_consensus.cc:697] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:17.908252 14235 consensus_queue.cc:237] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.911375 13874 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:17.918891 14143 tablet_bootstrap.cc:654] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:17.919198 14275 log.cc:927] Time spent T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:17.921469 14142 raft_consensus.cc:359] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.922423 14142 raft_consensus.cc:385] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:17.922768 14142 raft_consensus.cc:740] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.923496 14142 consensus_queue.cc:260] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:17.926735 14021 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:17.924381 13837 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:17.905691 14023 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:17.947415 14224 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.958624 14142 ts_tablet_manager.cc:1434] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.002s
I20260709 12:12:17.960265 14142 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:17.951468 14093 raft_consensus.cc:2468] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:17.957263 14224 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.961174 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:17.965011 14061 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:17.970427 14149 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.970839 14149 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.971211 14149 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.971599 14281 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.972018 14142 tablet_bootstrap.cc:654] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.972204 14281 raft_consensus.cc:697] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:17.965209 14224 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.973281 14281 consensus_queue.cc:237] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.986171 14144 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:17.986778 14144 ts_tablet_manager.cc:1403] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.022s
I20260709 12:12:17.989090 14249 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.989849 14249 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:17.992705 13770 catalog_manager.cc:5697] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.993738 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:17.994557 14249 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:17.996845 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:17.998091 14146 tablet_bootstrap.cc:492] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:17.988505 14224 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:17.998703 14146 ts_tablet_manager.cc:1403] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.256s	user 0.011s	sys 0.005s
I20260709 12:12:18.004611 14224 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.006237 13837 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:18.008654 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:18.010453 14063 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:18.011761 14173 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.012557 14149 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.013139 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:18.013983 14093 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
W20260709 12:12:18.014626 13840 leader_election.cc:343] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.016650 14146 raft_consensus.cc:359] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.017598 14146 raft_consensus.cc:385] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.017918 14146 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.018980 14146 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.019788 14149 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.020542 14224 raft_consensus.cc:2804] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.021124 14224 raft_consensus.cc:697] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:18.021138 13837 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:18.022069 14224 consensus_queue.cc:237] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.022580 14216 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.019321 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:18.025246 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:18.025995 13874 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
W20260709 12:12:18.028523 14063 leader_election.cc:343] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.029811 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.032011 14149 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.026023 14146 ts_tablet_manager.cc:1434] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:12:18.034130 14146 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.040076 14146 tablet_bootstrap.cc:654] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.049868 14143 tablet_bootstrap.cc:492] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.050486 14143 ts_tablet_manager.cc:1403] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.042s
I20260709 12:12:18.050575 14216 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.051201 14216 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.053794 14143 raft_consensus.cc:359] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.054675 14143 raft_consensus.cc:385] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.056881 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.054966 14143 raft_consensus.cc:740] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
W20260709 12:12:18.045979 13986 consensus_peers.cc:597] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe -> Peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Couldn't send request to peer f808da6a0c774bf4aa2e0ad137d6a74e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:18.058331 13840 leader_election.cc:343] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.057699 13768 catalog_manager.cc:5697] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.058777 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:18.060346 13838 leader_election.cc:343] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.060827 13838 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:18.057013 14216 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.062230 14216 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.063689 14143 consensus_queue.cc:260] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.066157 14143 ts_tablet_manager.cc:1434] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:18.066784 14224 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:18.067233 14143 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.068171 14146 tablet_bootstrap.cc:492] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.068787 14146 ts_tablet_manager.cc:1403] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.005s
I20260709 12:12:18.075301 14143 tablet_bootstrap.cc:654] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:17.991701 14144 raft_consensus.cc:359] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.078008 14144 raft_consensus.cc:385] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.078357 14144 raft_consensus.cc:740] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.079095 14144 consensus_queue.cc:260] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.079826 14146 raft_consensus.cc:359] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.084324 14146 raft_consensus.cc:385] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.084618 14146 raft_consensus.cc:740] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.085503 14142 tablet_bootstrap.cc:492] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.086378 14142 ts_tablet_manager.cc:1403] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.021s
I20260709 12:12:18.085477 14146 consensus_queue.cc:260] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.086606 14196 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.087162 14196 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.088591 14146 ts_tablet_manager.cc:1434] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:18.089823 14146 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.090683 13771 catalog_manager.cc:5697] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.091971 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:18.093581 13988 leader_election.cc:343] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.094257 14196 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.095220 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.095929 14146 tablet_bootstrap.cc:654] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.096026 13947 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:18.097669 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.098387 14142 raft_consensus.cc:359] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.098966 14196 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.099563 14196 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.099980 14196 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.099117 14142 raft_consensus.cc:385] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.100905 14142 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.101827 14142 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.104033 14142 ts_tablet_manager.cc:1434] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:12:18.105139 14142 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:18.083138 14144 ts_tablet_manager.cc:1434] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 12:12:18.118431 14144 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.119633 14235 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.120223 14235 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.121414 14258 consensus_queue.cc:1048] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:18.122479 14235 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.123027 14235 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.123482 14235 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.123762 13770 catalog_manager.cc:5697] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.126025 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.144307 14093 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:18.144965 14142 tablet_bootstrap.cc:654] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.133458 14276 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:18.154320 14144 tablet_bootstrap.cc:654] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.136859 14143 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.156805 14143 ts_tablet_manager.cc:1403] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.014s
I20260709 12:12:18.136904 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.158164 13874 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:18.139335 14235 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.159618 13914 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:18.159829 14143 raft_consensus.cc:359] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.160538 14143 raft_consensus.cc:385] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.160857 14143 raft_consensus.cc:740] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.161042 14235 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.161868 14143 consensus_queue.cc:260] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.139582 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.140686 14224 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.164453 14224 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.166851 14224 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.168598 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.169414 13949 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:18.170817 13840 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:18.140699 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.171608 14224 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.171998 14023 raft_consensus.cc:2393] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:18.172060 14224 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.172721 14144 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:18.173223 14093 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.173444 14144 ts_tablet_manager.cc:1403] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.001s
I20260709 12:12:18.172739 14224 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.181548 14144 raft_consensus.cc:359] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.182286 14144 raft_consensus.cc:385] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.182534 14144 raft_consensus.cc:740] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.183055 13914 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.183203 14144 consensus_queue.cc:260] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.185075 14160 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.185312 14144 ts_tablet_manager.cc:1434] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:18.186331 14144 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.190083 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.192324 14144 tablet_bootstrap.cc:654] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.199927 14224 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.155668 14142 tablet_bootstrap.cc:492] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.202457 14142 ts_tablet_manager.cc:1403] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.098s	user 0.003s	sys 0.010s
I20260709 12:12:18.204573 14224 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.201316 14195 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.154446 14146 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.208613 14195 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.208935 14146 ts_tablet_manager.cc:1403] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.021s
I20260709 12:12:18.210876 14195 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.205703 14142 raft_consensus.cc:359] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.211925 14142 raft_consensus.cc:385] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.212332 14142 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.164048 14143 ts_tablet_manager.cc:1434] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:18.129492 14196 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.213549 14142 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.214363 14143 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.206182 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:18.214329 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.218588 14146 raft_consensus.cc:359] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.219651 14146 raft_consensus.cc:385] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.220170 14146 raft_consensus.cc:740] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.224711 14142 ts_tablet_manager.cc:1434] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:12:18.226714 14146 consensus_queue.cc:260] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.232915 14142 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:18.238071 14160 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.240911 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.223188 14097 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:18.250830 13986 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:18.251792 14195 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.252194 14195 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.252543 14195 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.260464 14023 raft_consensus.cc:2393] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
W20260709 12:12:18.264958 13988 leader_election.cc:343] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.272950 14146 ts_tablet_manager.cc:1434] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.005s
I20260709 12:12:18.274917 14146 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.280346 14235 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.281291 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:18.281723 14143 tablet_bootstrap.cc:654] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.283574 14281 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.283787 14195 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.282034 13949 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.284168 14281 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.289074 14196 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.288692 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.292017 14142 tablet_bootstrap.cc:654] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:18.295630 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:18.296015 14144 tablet_bootstrap.cc:492] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:18.296540 14144 ts_tablet_manager.cc:1403] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.110s	user 0.025s	sys 0.052s
I20260709 12:12:18.299710 14144 raft_consensus.cc:359] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.300453 14144 raft_consensus.cc:385] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.300765 14144 raft_consensus.cc:740] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.301486 14144 consensus_queue.cc:260] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.304257 14144 ts_tablet_manager.cc:1434] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:18.305343 14144 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.312983 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:18.314270 13873 raft_consensus.cc:2393] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
W20260709 12:12:18.322134 14063 leader_election.cc:343] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.323498 14146 tablet_bootstrap.cc:654] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.328015 14144 tablet_bootstrap.cc:654] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.290347 14281 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:18.289855 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 101819us
I20260709 12:12:18.328558 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.335886 14224 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:18.339269 14062 leader_election.cc:343] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.339891 14062 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.344082 14281 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.354413 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:18.359349 13840 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:18.361531 14299 consensus_queue.cc:1048] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:18.367533 14195 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.368867 14276 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.369736 14276 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:18.377568 14261 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.378175 14261 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.376832 14196 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.379799 14196 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.381027 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:18.381351 14143 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.381989 14143 ts_tablet_manager.cc:1403] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.168s	user 0.032s	sys 0.050s
I20260709 12:12:18.382443 14196 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:18.382577 13988 leader_election.cc:343] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.380496 14261 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:18.384027 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.385694 13949 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:18.386242 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.387125 14143 raft_consensus.cc:359] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.388144 14143 raft_consensus.cc:385] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.388447 14143 raft_consensus.cc:740] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.388334 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:18.390993 13989 leader_election.cc:343] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.389400 14143 consensus_queue.cc:260] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.394160 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.396070 13838 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:18.397161 14063 consensus_peers.cc:597] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:18.398566 14261 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.401055 14143 ts_tablet_manager.cc:1434] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:12:18.401055 14281 consensus_queue.cc:1048] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:18.402397 14143 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.403146 14144 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:18.403878 14144 ts_tablet_manager.cc:1403] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.018s
I20260709 12:12:18.403605 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:18.405553 13986 leader_election.cc:343] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.406134 13986 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:18.407202 14258 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.407577 14144 raft_consensus.cc:359] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.372587 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:18.408417 14144 raft_consensus.cc:385] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.411746 14144 raft_consensus.cc:740] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.409140 14196 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.420431 14144 consensus_queue.cc:260] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.421612 14143 tablet_bootstrap.cc:654] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.411796 14093 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.420943 14258 raft_consensus.cc:697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:18.426043 14258 consensus_queue.cc:237] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.444299 14299 consensus_queue.cc:1048] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:18.448935 14142 tablet_bootstrap.cc:492] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.449572 14142 ts_tablet_manager.cc:1403] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.004s
I20260709 12:12:18.464272 14144 ts_tablet_manager.cc:1434] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.060s	user 0.014s	sys 0.013s
I20260709 12:12:18.465605 14144 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.468998 14310 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.471834 14310 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.474407 14310 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.477355 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.479563 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.484225 14146 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.484934 14146 ts_tablet_manager.cc:1403] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.008s
W20260709 12:12:18.485332 13840 consensus_peers.cc:597] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:18.486222 14224 consensus_queue.cc:1048] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:18.490381 14142 raft_consensus.cc:359] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.496681 14142 raft_consensus.cc:385] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.497246 14142 raft_consensus.cc:740] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
W20260709 12:12:18.484299 13988 leader_election.cc:343] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.502647 14143 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.503259 14143 ts_tablet_manager.cc:1403] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.002s
I20260709 12:12:18.505151 14142 consensus_queue.cc:260] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:18.506501 13986 leader_election.cc:343] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.507136 13986 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:18.508368 14143 raft_consensus.cc:359] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.509428 14143 raft_consensus.cc:385] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.509732 14143 raft_consensus.cc:740] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.510489 14143 consensus_queue.cc:260] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.512030 14142 ts_tablet_manager.cc:1434] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:12:18.512110 14196 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.512868 14143 ts_tablet_manager.cc:1434] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:12:18.515434 14143 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.488126 14146 raft_consensus.cc:359] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.517848 14146 raft_consensus.cc:385] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.518148 14146 raft_consensus.cc:740] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.519429 14142 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:18.525692 14281 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.526412 14281 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.558573 14146 consensus_queue.cc:260] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.560776 14143 tablet_bootstrap.cc:654] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.564849 14144 tablet_bootstrap.cc:654] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.564369 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.566880 14281 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.561097 14093 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:18.573040 14281 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.574491 14281 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.576707 14146 ts_tablet_manager.cc:1434] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:12:18.577322 14281 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.580148 14142 tablet_bootstrap.cc:654] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.582769 14146 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.582970 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.586414 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:18.588063 14062 leader_election.cc:343] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.589538 14146 tablet_bootstrap.cc:654] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.590762 14061 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.590786 13986 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.592388 14310 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.592923 14310 raft_consensus.cc:697] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:18.593807 14310 consensus_queue.cc:237] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.595496 14235 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.596025 14235 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.598380 14235 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.600538 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.601428 14023 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:18.601542 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.602463 13872 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:18.603103 13913 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:18.604168 14249 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.604377 14235 raft_consensus.cc:2804] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.604830 14235 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.605202 14235 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.613461 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:18.615392 14061 leader_election.cc:343] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.615870 14061 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.615887 14144 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:18.617669 14144 ts_tablet_manager.cc:1403] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.152s	user 0.004s	sys 0.018s
I20260709 12:12:18.617281 14281 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.623731 14235 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.628294 14146 tablet_bootstrap.cc:492] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.629062 14146 ts_tablet_manager.cc:1403] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.018s
I20260709 12:12:18.629922 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:18.630190 14093 raft_consensus.cc:3060] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.630649 13872 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.631407 14235 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.634603 14146 raft_consensus.cc:359] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.635689 14146 raft_consensus.cc:385] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.637081 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:18.637814 14021 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.640367 13872 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:18.641813 13914 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:18.643028 14143 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.643544 14143 ts_tablet_manager.cc:1403] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.004s
I20260709 12:12:18.643819 14299 raft_consensus.cc:2804] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.644734 14299 raft_consensus.cc:697] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:18.646431 14143 raft_consensus.cc:359] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.646032 14299 consensus_queue.cc:237] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.628413 13771 catalog_manager.cc:5697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.655951 14143 raft_consensus.cc:385] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.656364 14143 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.657644 14144 raft_consensus.cc:359] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.658481 14144 raft_consensus.cc:385] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.658761 14144 raft_consensus.cc:740] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.659458 14144 consensus_queue.cc:260] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.636086 14146 raft_consensus.cc:740] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.661429 14146 consensus_queue.cc:260] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.661334 14143 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.664669 14146 ts_tablet_manager.cc:1434] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.005s
I20260709 12:12:18.665139 14021 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:18.665773 14146 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.668218 14143 ts_tablet_manager.cc:1434] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:12:18.673028 14143 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.678602 14146 tablet_bootstrap.cc:654] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.678920 14142 tablet_bootstrap.cc:492] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.679505 14142 ts_tablet_manager.cc:1403] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.021s
I20260709 12:12:18.680558 14143 tablet_bootstrap.cc:654] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.694007 13872 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.681070 14261 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.682374 14281 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.711179 14261 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.711119 14281 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.713709 14146 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.714288 14146 ts_tablet_manager.cc:1403] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 12:12:18.715741 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.716578 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:18.717417 14062 leader_election.cc:343] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.717571 14146 raft_consensus.cc:359] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.718329 14146 raft_consensus.cc:385] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.718643 14146 raft_consensus.cc:740] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.719420 14146 consensus_queue.cc:260] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.719954 14261 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:18.720305 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.688169 14142 raft_consensus.cc:359] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.721616 14142 raft_consensus.cc:385] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.722049 14142 raft_consensus.cc:740] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.722348 14146 ts_tablet_manager.cc:1434] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:18.723011 14142 consensus_queue.cc:260] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.723466 14146 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.723464 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:18.721829 14063 leader_election.cc:343] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.724502 14063 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.681348 14144 ts_tablet_manager.cc:1434] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.004s
I20260709 12:12:18.724504 14093 raft_consensus.cc:2393] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:18.725437 14249 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.727118 14144 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.729676 14142 ts_tablet_manager.cc:1434] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.003s
I20260709 12:12:18.729429 13837 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:18.727231 14281 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.730734 14276 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.734000 14146 tablet_bootstrap.cc:654] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.740720 14144 tablet_bootstrap.cc:654] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.744726 14142 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:18.746214 14143 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.746542 14276 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:18.746804 14143 ts_tablet_manager.cc:1403] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.000s
I20260709 12:12:18.748795 14146 tablet_bootstrap.cc:492] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.749325 14146 ts_tablet_manager.cc:1403] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 12:12:18.750340 14143 raft_consensus.cc:359] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.751055 14143 raft_consensus.cc:385] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.751312 14143 raft_consensus.cc:740] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.751362 14142 tablet_bootstrap.cc:654] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.752218 14143 consensus_queue.cc:260] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.752380 14146 raft_consensus.cc:359] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.753163 14146 raft_consensus.cc:385] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.753466 14146 raft_consensus.cc:740] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.754300 14146 consensus_queue.cc:260] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.754961 14143 ts_tablet_manager.cc:1434] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:18.755986 14143 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.756659 14146 ts_tablet_manager.cc:1434] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:18.768463 14146 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:18.770442 14143 tablet_bootstrap.cc:654] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.773634 13769 catalog_manager.cc:5697] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.775755 14142 tablet_bootstrap.cc:492] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.780936 14310 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.781178 14142 ts_tablet_manager.cc:1403] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.017s
I20260709 12:12:18.781504 14310 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.783866 14310 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.784080 14142 raft_consensus.cc:359] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.784886 14142 raft_consensus.cc:385] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.785166 14142 raft_consensus.cc:740] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.785522 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.785930 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:18.785842 14142 consensus_queue.cc:260] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.786558 14093 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
W20260709 12:12:18.787639 13988 leader_election.cc:343] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.780592 14143 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.788584 14143 ts_tablet_manager.cc:1403] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:12:18.788374 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.789678 14310 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.789849 14144 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:18.790131 14310 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.790592 14310 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.790640 14144 ts_tablet_manager.cc:1403] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.064s	user 0.003s	sys 0.009s
I20260709 12:12:18.793793 14144 raft_consensus.cc:359] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.793587 13768 catalog_manager.cc:5697] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.795493 14146 tablet_bootstrap.cc:654] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.796669 14142 ts_tablet_manager.cc:1434] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:12:18.799052 14281 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.800839 14144 raft_consensus.cc:385] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.801913 14144 raft_consensus.cc:740] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.801681 14281 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.802731 14144 consensus_queue.cc:260] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.804082 14281 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.805399 14142 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:18.806061 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.806793 13947 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:18.807976 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.799088 14143 raft_consensus.cc:359] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.808845 14143 raft_consensus.cc:385] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.809152 14143 raft_consensus.cc:740] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.809403 14063 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:18.809931 14143 consensus_queue.cc:260] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.810288 14021 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:18.810808 14281 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.811225 14281 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.811559 14281 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.813650 14142 tablet_bootstrap.cc:654] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.800827 14310 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.820715 14143 ts_tablet_manager.cc:1434] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:12:18.821872 14143 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:18.824170 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:18.825136 14093 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.828058 14143 tablet_bootstrap.cc:654] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.829139 14276 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.829937 14276 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.834997 14276 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:18.835310 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.836290 14094 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:18.837595 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:18.838429 14021 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:18.840090 13837 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:18.843848 14143 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.844278 14143 ts_tablet_manager.cc:1403] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 12:12:18.846865 14143 raft_consensus.cc:359] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.847371 14143 raft_consensus.cc:385] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.847638 14143 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.847798 14258 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.848268 14258 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.848387 14143 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.850719 14258 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:18.853147 14276 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.853886 14276 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.854350 14276 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.855804 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.856813 14143 ts_tablet_manager.cc:1434] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:12:18.858191 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.859031 14094 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:18.860870 13986 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:18.862406 14143 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
W20260709 12:12:18.862749 13989 leader_election.cc:343] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.868527 14258 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.868887 14143 tablet_bootstrap.cc:654] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:18.869179 14258 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.870471 14258 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.876183 14144 ts_tablet_manager.cc:1434] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 12:12:18.880560 14310 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:18.880712 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:18.891872 13988 leader_election.cc:343] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.891520 14258 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.895435 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:18.897279 13989 leader_election.cc:343] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.899863 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:18.900601 14094 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.901088 14144 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:18.902974 14258 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:18.904491 14143 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:18.905145 14143 ts_tablet_manager.cc:1403] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 12:12:18.912794 14179 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.913401 14179 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.915624 14179 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:18.908900 14143 raft_consensus.cc:359] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.917577 14143 raft_consensus.cc:385] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:18.917667 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:18.917876 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:18.918778 14097 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:18.918913 13947 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:18.920820 13840 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:18.922114 14179 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:18.922610 14179 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.923069 14179 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.937053 13947 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.944149 14094 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:18.946347 13986 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:18.947666 14258 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.917871 14143 raft_consensus.cc:740] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.948290 14258 raft_consensus.cc:697] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:18.948540 14281 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.949394 14258 consensus_queue.cc:237] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.951684 14093 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:18.953673 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:18.955412 14310 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:18.956091 14310 raft_consensus.cc:697] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:18.957269 14310 consensus_queue.cc:237] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.970377 14196 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:18.978724 14142 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:18.979398 14142 ts_tablet_manager.cc:1403] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.174s	user 0.036s	sys 0.052s
I20260709 12:12:18.983192 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:18.984108 13945 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:18.985299 14146 tablet_bootstrap.cc:492] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:18.985915 14146 ts_tablet_manager.cc:1403] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.218s	user 0.071s	sys 0.068s
I20260709 12:12:18.986521 14179 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:18.949244 14143 consensus_queue.cc:260] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.996402 13945 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:19.000110 14063 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:18.989475 14142 raft_consensus.cc:359] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:18.993994 14146 raft_consensus.cc:359] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.994590 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:19.002347 14146 raft_consensus.cc:385] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.002656 14021 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.002779 14146 raft_consensus.cc:740] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.003849 14146 consensus_queue.cc:260] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:18.995067 14281 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:18.995645 14276 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:18.997851 14144 tablet_bootstrap.cc:654] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.008320 14142 raft_consensus.cc:385] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.001194 14249 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:19.008801 14142 raft_consensus.cc:740] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.012125 14143 ts_tablet_manager.cc:1434] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.003s
I20260709 12:12:19.013541 14143 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:19.014271 14142 consensus_queue.cc:260] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.016850 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:19.017680 13948 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.021692 14146 ts_tablet_manager.cc:1434] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:12:19.022871 14146 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:19.022773 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:19.023758 14093 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.036787 14249 raft_consensus.cc:697] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:19.039866 14142 ts_tablet_manager.cc:1434] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.005s
I20260709 12:12:19.041103 14142 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.040508 14249 consensus_queue.cc:237] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.047380 14146 tablet_bootstrap.cc:654] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.047868 14143 tablet_bootstrap.cc:654] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.001915 14179 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.062659 14310 consensus_queue.cc:1048] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:19.089805 14299 consensus_queue.cc:1048] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:19.095213 14142 tablet_bootstrap.cc:654] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.096836 13948 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.097469 14341 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:19.097887 14179 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.097195 13771 catalog_manager.cc:5697] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:19.098532 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:19.098412 14179 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.099268 14020 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.102437 14021 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:19.090035 14276 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:19.120808 14093 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.118564 14179 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:19.119810 13770 catalog_manager.cc:5697] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:19.165460 14300 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.179634 14144 tablet_bootstrap.cc:492] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:19.180233 14144 ts_tablet_manager.cc:1403] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.280s	user 0.004s	sys 0.022s
I20260709 12:12:19.166471 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:19.174919 14299 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.166965 13840 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:19.193977 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:19.194563 14344 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.195307 14344 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.193171 14299 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.184952 14300 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.198060 14344 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:19.199124 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:19.199738 14299 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:19.200137 14300 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:19.201198 13945 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:19.190055 14093 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.208230 14224 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:19.209038 14224 raft_consensus.cc:697] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:19.210103 14224 consensus_queue.cc:237] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.215515 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:19.217218 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:19.221338 13913 leader_election.cc:343] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.222301 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:19.289268 14146 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:19.290060 14146 ts_tablet_manager.cc:1403] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.267s	user 0.019s	sys 0.027s
I20260709 12:12:19.292167 14144 raft_consensus.cc:359] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.293378 14144 raft_consensus.cc:385] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.298017 14144 raft_consensus.cc:740] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.298978 14144 consensus_queue.cc:260] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.312975 14093 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.299378 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:19.315706 14142 tablet_bootstrap.cc:492] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.316319 14142 ts_tablet_manager.cc:1403] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.275s	user 0.022s	sys 0.002s
I20260709 12:12:19.319500 14020 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.296000 13912 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:19.322345 14144 ts_tablet_manager.cc:1434] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.142s	user 0.014s	sys 0.004s
I20260709 12:12:19.323673 14144 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:19.320297 14142 raft_consensus.cc:359] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.328135 14142 raft_consensus.cc:385] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.329691 14142 raft_consensus.cc:740] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.330708 14142 consensus_queue.cc:260] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:19.336825 14343 log.cc:927] Time spent T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.234s	user 0.001s	sys 0.003s
I20260709 12:12:19.347323 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:19.348654 14142 ts_tablet_manager.cc:1434] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:12:19.350217 14142 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
W20260709 12:12:19.357805 14061 leader_election.cc:343] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.361191 14144 tablet_bootstrap.cc:654] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.370069 14142 tablet_bootstrap.cc:654] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.375294 14144 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:19.375895 14144 ts_tablet_manager.cc:1403] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.003s
W20260709 12:12:19.379012 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 91448.2us
I20260709 12:12:19.379240 14144 raft_consensus.cc:359] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.379967 14144 raft_consensus.cc:385] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:19.380172 14063 leader_election.cc:343] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.380254 14144 raft_consensus.cc:740] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.381392 14143 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:19.381470 14144 consensus_queue.cc:260] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.382682 14143 ts_tablet_manager.cc:1403] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.369s	user 0.032s	sys 0.028s
I20260709 12:12:19.383574 14300 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:19.385713 14344 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.386258 14344 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.388599 14344 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:19.390556 14143 raft_consensus.cc:359] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.391531 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:19.391800 14143 raft_consensus.cc:385] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:19.393392 14061 leader_election.cc:343] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.395059 14144 ts_tablet_manager.cc:1434] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:12:19.396282 14144 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:19.392310 14143 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.400662 14143 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.403146 14144 tablet_bootstrap.cc:654] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.405164 14143 ts_tablet_manager.cc:1434] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:12:19.406301 14143 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:19.385488 14146 raft_consensus.cc:359] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.407431 14146 raft_consensus.cc:385] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.407850 14146 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.408885 14146 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.391484 14063 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:19.414029 14143 tablet_bootstrap.cc:654] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.415637 14344 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:19.420540 14142 tablet_bootstrap.cc:492] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.421371 14142 ts_tablet_manager.cc:1403] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.016s
I20260709 12:12:19.425655 14142 raft_consensus.cc:359] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.426528 14142 raft_consensus.cc:385] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.426932 14142 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.427917 14142 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.431241 14142 ts_tablet_manager.cc:1434] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:12:19.433730 14142 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.286638 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:19.435513 13874 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:19.438695 14023 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:19.441668 14344 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:19.445030 13989 consensus_peers.cc:597] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.442348 14344 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.451545 14142 tablet_bootstrap.cc:654] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.452982 14344 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.455683 14144 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:19.456306 14144 ts_tablet_manager.cc:1403] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.018s
I20260709 12:12:19.456535 13914 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:19.462087 13838 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:19.461943 14144 raft_consensus.cc:359] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.462975 14144 raft_consensus.cc:385] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.463286 14144 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.463548 14276 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:19.464073 14144 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.464115 14276 raft_consensus.cc:697] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:19.466176 14276 consensus_queue.cc:237] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.467041 14144 ts_tablet_manager.cc:1434] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:12:19.468123 14144 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:19.475533 14144 tablet_bootstrap.cc:654] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.477643 13838 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:19.480345 14143 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:19.481082 14143 ts_tablet_manager.cc:1403] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.007s
I20260709 12:12:19.482074 14341 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.482928 14341 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.483817 14143 raft_consensus.cc:359] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.484336 14143 raft_consensus.cc:385] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.484498 14143 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.485353 14143 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.487929 14261 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:19.488492 14261 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.488938 14143 ts_tablet_manager.cc:1434] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:19.490295 14143 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:19.497924 14143 tablet_bootstrap.cc:654] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.488261 14196 consensus_queue.cc:1048] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:19.507944 14143 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:19.508013 14142 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.507858 14258 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:19.508944 14143 ts_tablet_manager.cc:1403] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:12:19.488929 14261 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.511276 14341 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.513082 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:19.513197 14143 raft_consensus.cc:359] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.513929 14143 raft_consensus.cc:385] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.514220 14143 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.515468 14143 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.519272 14143 ts_tablet_manager.cc:1434] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:19.520371 14143 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:19.525839 14142 ts_tablet_manager.cc:1403] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.009s
W20260709 12:12:19.526118 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 121177us
I20260709 12:12:19.526268 14348 consensus_queue.cc:1048] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:19.528371 14143 tablet_bootstrap.cc:654] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.528664 14144 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:19.529237 14144 ts_tablet_manager.cc:1403] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.013s
I20260709 12:12:19.529562 14146 ts_tablet_manager.cc:1434] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.236s	user 0.008s	sys 0.000s
I20260709 12:12:19.530666 14146 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
W20260709 12:12:19.533061 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 116020us
W20260709 12:12:19.535732 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 79328.1us
I20260709 12:12:19.534248 14144 raft_consensus.cc:359] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.537487 14144 raft_consensus.cc:385] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.537763 14144 raft_consensus.cc:740] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.538100 14299 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:19.538735 14258 consensus_queue.cc:1048] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:19.538872 14299 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.538496 14144 consensus_queue.cc:260] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.539551 14299 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.541689 14144 ts_tablet_manager.cc:1434] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:12:19.543115 14144 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:19.550130 14344 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.550729 14344 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.551769 14142 raft_consensus.cc:359] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.553076 14344 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.555804 14144 tablet_bootstrap.cc:654] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.555485 14261 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.558439 13945 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.558915 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:19.562444 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:19.565320 14063 leader_election.cc:343] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:19.566217 14063 leader_election.cc:343] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.570308 14261 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:19.552486 14142 raft_consensus.cc:385] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.572095 14142 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.572618 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:19.575255 13989 leader_election.cc:343] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:19.572885 14142 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.605887 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:19.606647 14023 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.610241 14146 tablet_bootstrap.cc:654] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.615295 14142 ts_tablet_manager.cc:1434] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 12:12:19.616498 14142 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
W20260709 12:12:19.621837 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:19.627439 14142 tablet_bootstrap.cc:654] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.621891 14023 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.600538 14344 consensus_queue.cc:1048] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:12:19.648239 14143 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:19.648880 14143 ts_tablet_manager.cc:1403] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.129s	user 0.033s	sys 0.039s
I20260709 12:12:19.652271 14143 raft_consensus.cc:359] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.665741 14143 raft_consensus.cc:385] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.666482 14143 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.677837 14143 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.699474 13838 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:19.675561 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 86196.1us
I20260709 12:12:19.760304 14373 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.797528 14373 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.799790 13872 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:19.803970 14364 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:19.804612 14364 raft_consensus.cc:697] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:19.805518 14364 consensus_queue.cc:237] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.807196 14224 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.807958 14224 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.811642 14224 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.825801 14142 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.826596 14142 ts_tablet_manager.cc:1403] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.210s	user 0.006s	sys 0.009s
I20260709 12:12:19.831990 14142 raft_consensus.cc:359] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.833701 14142 raft_consensus.cc:385] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.834084 14142 raft_consensus.cc:740] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.835039 14142 consensus_queue.cc:260] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.838423 14142 ts_tablet_manager.cc:1434] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:12:19.840590 14142 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
W20260709 12:12:19.862605 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 58548.3us
I20260709 12:12:19.868999 14142 tablet_bootstrap.cc:654] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.876183 14142 tablet_bootstrap.cc:492] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.876821 14142 ts_tablet_manager.cc:1403] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.010s
I20260709 12:12:19.879968 14142 raft_consensus.cc:359] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.880803 14142 raft_consensus.cc:385] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.881111 14142 raft_consensus.cc:740] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.881810 14142 consensus_queue.cc:260] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.884886 14142 ts_tablet_manager.cc:1434] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:19.885881 14142 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.892369 14142 tablet_bootstrap.cc:654] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.896878 14258 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.897508 14142 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.897430 14258 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:19.898012 14142 ts_tablet_manager.cc:1403] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:19.899639 14258 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:19.900868 14258 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.901551 14258 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.901710 14142 raft_consensus.cc:359] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.902494 14142 raft_consensus.cc:385] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.902716 14142 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.903147 14142 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.904659 14258 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:19.905120 14142 ts_tablet_manager.cc:1434] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:19.906064 14142 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.910913 14142 tablet_bootstrap.cc:654] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.916837 14142 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.917402 14142 ts_tablet_manager.cc:1403] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.007s
I20260709 12:12:19.921828 14142 raft_consensus.cc:359] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.922369 14142 raft_consensus.cc:385] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.922616 14142 raft_consensus.cc:740] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.923118 14142 consensus_queue.cc:260] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.924238 14299 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:19.930621 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:19.931602 13945 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:19.932770 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:19.932847 14299 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:19.933513 13949 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:19.933583 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:19.937490 13840 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:19.938259 14364 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:19.939231 14364 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.939635 14364 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:19.924810 14142 ts_tablet_manager.cc:1434] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:19.941756 14142 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.948200 14142 tablet_bootstrap.cc:654] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.949359 14364 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:19.953557 14364 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:19.953794 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:19.954447 13947 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:19.960839 14142 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:19.961964 14142 ts_tablet_manager.cc:1403] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:12:19.964931 14142 raft_consensus.cc:359] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.965750 14142 raft_consensus.cc:385] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:19.966099 14142 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.966820 14142 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:19.969094 14142 ts_tablet_manager.cc:1434] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:19.970193 14142 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:19.974989 14144 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:19.975617 14144 ts_tablet_manager.cc:1403] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.433s	user 0.013s	sys 0.028s
I20260709 12:12:19.977334 14142 tablet_bootstrap.cc:654] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:19.979682 14143 ts_tablet_manager.cc:1434] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.330s	user 0.010s	sys 0.002s
I20260709 12:12:19.981115 14143 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
W20260709 12:12:19.991967 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 827756us
I20260709 12:12:20.007138 14144 raft_consensus.cc:359] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.008064 14144 raft_consensus.cc:385] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.008324 14144 raft_consensus.cc:740] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.009349 14144 consensus_queue.cc:260] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.010180 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.011704 14144 ts_tablet_manager.cc:1434] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:12:20.013211 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.014374 13871 raft_consensus.cc:2468] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:20.018392 14144 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:20.024686 14143 tablet_bootstrap.cc:654] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.017827 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.031625 13873 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:20.033780 13947 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:20.040580 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.041510 14094 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:20.043707 14144 tablet_bootstrap.cc:654] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.061702 14179 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.062676 13912 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:20.061621 13840 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:20.064109 14300 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.064248 14276 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:20.065943 14276 raft_consensus.cc:697] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:20.066103 14373 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:20.066941 14276 consensus_queue.cc:237] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.062534 14179 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.069658 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.071403 14179 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.073284 14142 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:20.073891 14142 ts_tablet_manager.cc:1403] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.104s	user 0.031s	sys 0.043s
I20260709 12:12:20.081935 14146 tablet_bootstrap.cc:492] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:20.082720 14179 consensus_queue.cc:1048] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:20.081691 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.084000 13873 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:20.085176 14146 ts_tablet_manager.cc:1403] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.555s	user 0.020s	sys 0.022s
W20260709 12:12:19.596444 13988 leader_election.cc:343] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.088011 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:20.089103 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 493731us
I20260709 12:12:20.088819 14146 raft_consensus.cc:359] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.089655 14146 raft_consensus.cc:385] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.089932 14146 raft_consensus.cc:740] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.090690 14146 consensus_queue.cc:260] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.092664 14341 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.093137 14146 ts_tablet_manager.cc:1434] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:20.094159 14146 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:20.104523 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.105430 14093 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:20.118572 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.119338 14093 raft_consensus.cc:2468] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:20.120541 13986 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:20.122074 14344 consensus_queue.cc:1048] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:20.126040 14344 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:20.126573 14344 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.128418 14258 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.128903 14258 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.128960 14344 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.129362 14258 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.134315 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.137673 13771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38496 (request call id 51) took 1047 ms. Trace:
I20260709 12:12:20.064791 14300 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.163568 14300 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:20.168594 14343 log.cc:927] Time spent T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:20.164050 13986 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:20.142426 13771 rpcz_store.cc:276] 0709 12:12:19.090738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.094791 (+  4053us) service_pool.cc:224] Handling call
0709 12:12:20.137606 (+1042815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:19.107689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:19.111033 (+  3344us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:19.111069 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:12:19.111086 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:19.111420 (+   334us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:19.111482 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:19.111508 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:19.111689 (+   181us) tablet.cc:701] Row locks acquired
0709 12:12:19.111710 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:19.111891 (+   181us) write_op.cc:270] Start()
0709 12:12:19.112005 (+   114us) write_op.cc:276] Timestamp: P: 1783599139111834 usec, L: 0
0709 12:12:19.112025 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:19.161861 (+ 49836us) log.cc:844] Serialized 540 byte log entry
0709 12:12:19.194630 (+ 32769us) op_driver.cc:464] REPLICATION: finished
0709 12:12:19.195186 (+   556us) write_op.cc:301] APPLY: starting
0709 12:12:19.195287 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:19.195398 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:19.195510 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:19.195728 (+   218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:19.195967 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:12:19.196044 (+    77us) write_op.cc:312] APPLY: finished
0709 12:12:19.196240 (+   196us) log.cc:844] Serialized 22 byte log entry
0709 12:12:19.196402 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.196494 (+    92us) write_op.cc:454] Released schema lock
0709 12:12:19.196540 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:19.196962 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.196991 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":162248,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":304,"apply.run_cpu_time_us":1763,"apply.run_wall_time_us":1763,"num_ops":1,"prepare.queue_time_us":4260,"prepare.run_cpu_time_us":3116,"prepare.run_wall_time_us":61877,"replication_time_us":82462}]]}
I20260709 12:12:20.185063 14146 tablet_bootstrap.cc:654] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.185554 14144 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:20.186259 14144 ts_tablet_manager.cc:1403] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.168s	user 0.006s	sys 0.009s
I20260709 12:12:20.180866 14366 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.178830 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.187346 14142 raft_consensus.cc:359] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.200217 14142 raft_consensus.cc:385] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.200518 14142 raft_consensus.cc:740] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.200609 14249 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.201140 14249 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.201275 14142 consensus_queue.cc:260] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:20.201786 14062 leader_election.cc:343] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.188014 14366 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.202850 14062 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:20.203408 14249 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:20.188226 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.205456 13873 raft_consensus.cc:2468] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:20.207767 14142 ts_tablet_manager.cc:1434] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.000s
I20260709 12:12:20.204453 14366 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.208981 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.210404 14142 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:20.192996 14173 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.213301 14249 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.214429 14364 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.234300 14196 raft_consensus.cc:2804] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.234398 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.234880 14196 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.235278 14196 raft_consensus.cc:3060] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:20.245628 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 81696.4us
I20260709 12:12:20.231707 14173 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:20.247509 13840 leader_election.cc:343] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.249475 14173 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.251287 14300 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.254769 13947 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:20.255218 14300 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:20.252216 14258 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.253098 14146 tablet_bootstrap.cc:492] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:20.256124 14146 ts_tablet_manager.cc:1403] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.015s
I20260709 12:12:20.258416 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:20.258302 14144 raft_consensus.cc:359] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.259187 14144 raft_consensus.cc:385] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.259191 13873 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.259548 14144 raft_consensus.cc:740] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.259866 14146 raft_consensus.cc:359] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.262269 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:20.262554 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.263082 14093 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.263397 13947 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:20.265189 14146 raft_consensus.cc:385] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.265594 14146 raft_consensus.cc:740] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.267199 14146 consensus_queue.cc:260] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.233148 14364 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.270232 14146 ts_tablet_manager.cc:1434] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:12:20.226235 14062 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:20.262225 14142 tablet_bootstrap.cc:654] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.260295 14144 consensus_queue.cc:260] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.273770 14143 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:20.274333 14143 ts_tablet_manager.cc:1403] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.294s	user 0.058s	sys 0.074s
I20260709 12:12:20.271318 14146 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:20.231969 14366 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:12:20.277941 14143 raft_consensus.cc:359] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.278738 14143 raft_consensus.cc:385] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.279008 14143 raft_consensus.cc:740] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.282806 14249 raft_consensus.cc:2804] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.283373 14249 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.283740 14249 raft_consensus.cc:3060] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.286608 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:20.287381 14095 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.270354 14173 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:20.293255 14173 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.272450 14258 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:20.294632 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:20.282804 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68693.4us
I20260709 12:12:20.295610 14173 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.271315 14364 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:20.305384 14143 consensus_queue.cc:260] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.281124 14276 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.308864 14062 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.313241 14144 ts_tablet_manager.cc:1434] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.000s
I20260709 12:12:20.317848 14144 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:20.289016 14366 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.296396 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.302400 14261 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.333722 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.345449 14143 ts_tablet_manager.cc:1434] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.071s	user 0.001s	sys 0.006s
I20260709 12:12:20.352382 14373 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.363031 14373 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.364408 14143 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:20.365496 14373 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:20.339457 14093 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:20.339887 14173 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:20.361829 13838 leader_election.cc:343] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.327535 14261 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.367945 14173 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.369030 14173 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.369972 14261 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.370785 14249 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.371853 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.367974 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.373340 14249 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:20.374043 13840 leader_election.cc:343] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.377079 13912 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:20.378309 14373 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.378811 14373 raft_consensus.cc:697] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:20.379809 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.379657 14373 consensus_queue.cc:237] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.380671 14023 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:20.384686 14364 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:20.385795 13989 leader_election.cc:343] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.386111 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:20.387488 13948 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.388214 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.388469 13913 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:20.392594 14372 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.403528 14095 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:20.324213 14366 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.406462 14366 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.408331 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.408960 14146 tablet_bootstrap.cc:654] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.409150 13944 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.410596 13840 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:20.319730 14276 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.435252 13771 catalog_manager.cc:5697] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } }
I20260709 12:12:20.442209 13913 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:20.443323 14276 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:20.413551 14366 raft_consensus.cc:2804] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:20.434656 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 120505us
W20260709 12:12:20.452044 13989 leader_election.cc:343] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.461391 14144 tablet_bootstrap.cc:654] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:20.465301 14061 leader_election.cc:343] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.465711 14405 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.466394 14405 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.469470 14143 tablet_bootstrap.cc:654] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:20.451087 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 154363us
I20260709 12:12:20.448414 14366 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.473829 13986 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.474895 13873 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:20.476203 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.465775 14173 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.477062 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.485435 14341 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.477495 14196 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.486057 14341 raft_consensus.cc:697] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:20.487038 14341 consensus_queue.cc:237] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.488116 14196 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:20.479761 14405 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.504142 14062 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:20.483985 14366 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.493263 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.506592 14405 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:20.509531 14063 leader_election.cc:343] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.512704 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:20.509109 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 212657us
I20260709 12:12:20.536729 14404 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.537340 14404 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.539687 14404 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.544436 14021 raft_consensus.cc:2393] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:20.552174 14173 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.552944 14142 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:20.553474 14142 ts_tablet_manager.cc:1403] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.345s	user 0.023s	sys 0.018s
I20260709 12:12:20.554860 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:20.557318 14143 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
W20260709 12:12:20.557623 14063 leader_election.cc:343] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.557835 14143 ts_tablet_manager.cc:1403] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.007s
I20260709 12:12:20.558240 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:20.559311 14097 raft_consensus.cc:2393] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:20.560295 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.561064 14020 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.562052 14146 tablet_bootstrap.cc:492] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:20.561971 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.562701 14146 ts_tablet_manager.cc:1403] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.292s	user 0.017s	sys 0.014s
I20260709 12:12:20.550175 14380 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.564581 13838 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.543655 14019 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.533466 14261 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:12:20.569965 14146 raft_consensus.cc:359] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.571942 14146 raft_consensus.cc:385] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.572307 14146 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.570307 14143 raft_consensus.cc:359] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.573052 14143 raft_consensus.cc:385] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.573354 14143 raft_consensus.cc:740] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.579134 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.580016 14097 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:20.569751 14173 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.585479 14142 raft_consensus.cc:359] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.584343 14143 consensus_queue.cc:260] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.586341 14142 raft_consensus.cc:385] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.587127 14142 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.574208 14179 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:20.575769 13989 leader_election.cc:343] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.582378 14404 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:20.598178 14224 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:20.599768 13945 raft_consensus.cc:1275] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:20.589003 14173 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.614729 14144 tablet_bootstrap.cc:492] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:20.617362 14142 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.604245 14146 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.622134 14144 ts_tablet_manager.cc:1403] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.305s	user 0.026s	sys 0.010s
I20260709 12:12:20.592283 14179 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.628432 14146 ts_tablet_manager.cc:1434] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 12:12:20.629518 14146 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:20.630908 14143 ts_tablet_manager.cc:1434] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.001s
I20260709 12:12:20.630786 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.631778 14095 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:20.632117 14143 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:20.633469 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.634805 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:20.635128 14063 leader_election.cc:343] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.635643 14179 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.636797 14173 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.637632 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.635123 14142 ts_tablet_manager.cc:1434] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 12:12:20.643352 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.644073 14095 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.644244 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.635553 13872 raft_consensus.cc:3060] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.635515 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:20.618664 14224 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.660130 14364 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.645884 14366 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.661657 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.662040 14364 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.662477 14020 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:20.663947 14366 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.664258 14364 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.666924 14144 raft_consensus.cc:359] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.668883 14224 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.669449 14142 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:20.645004 14093 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.671823 14144 raft_consensus.cc:385] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.678222 14144 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.670662 14061 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.673121 14097 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:20.692891 14405 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.693463 14405 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.693909 14405 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:20.695560 13970 debug-util.cc:398] Leaking SignalData structure 0x7b08002b22c0 after lost signal to thread 7581
W20260709 12:12:20.697266 13970 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0c60 after lost signal to thread 13806
W20260709 12:12:20.698875 13970 debug-util.cc:398] Leaking SignalData structure 0x7b0800048f00 after lost signal to thread 13898
W20260709 12:12:20.700090 13970 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2640 after lost signal to thread 13973
W20260709 12:12:20.701112 14419 log.cc:927] Time spent T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:12:20.701371 13970 debug-util.cc:398] Leaking SignalData structure 0x7b08001102c0 after lost signal to thread 14047
W20260709 12:12:20.703199 13970 debug-util.cc:398] Leaking SignalData structure 0x7b0800225ce0 after lost signal to thread 14121
I20260709 12:12:20.704916 14144 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.709151 14144 ts_tablet_manager.cc:1434] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.003s
I20260709 12:12:20.711982 14144 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:20.724582 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.725356 14021 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.727823 14146 tablet_bootstrap.cc:654] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:20.729331 14416 log.cc:927] Time spent T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:20.724656 14224 consensus_queue.cc:1048] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:20.729094 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.711114 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.733938 14144 tablet_bootstrap.cc:654] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.742815 14021 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:20.744892 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.745321 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:20.745661 13873 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:20.747608 14142 tablet_bootstrap.cc:654] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.746889 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.746186 14405 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.754671 14143 tablet_bootstrap.cc:654] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.755002 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:20.756928 14063 leader_election.cc:343] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.760583 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:20.761327 14179 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.762176 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.762825 13874 raft_consensus.cc:2393] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:20.763688 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:20.770258 13869 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.770465 14418 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.771072 14418 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:20.773904 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:20.762951 13870 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:20.778625 14418 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.780745 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:20.781622 14224 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:20.782358 13837 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.783401 14421 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.783911 14261 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.784343 14261 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.784724 14261 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.786146 14418 consensus_queue.cc:1048] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:20.787249 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:20.791580 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.792300 14021 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.798513 14062 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:20.801995 14405 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.804276 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:20.804708 13838 leader_election.cc:343] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.805105 14023 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.807135 13837 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:20.814096 13872 raft_consensus.cc:2468] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:20.815347 13838 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:20.774426 14179 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:20.804296 14420 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.816699 14418 raft_consensus.cc:2804] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.818532 14344 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:20.820864 14420 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.823128 14344 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.823423 14420 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.823606 14344 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.824119 14422 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:20.827971 13988 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:20.829330 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:20.829978 13945 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.831104 14144 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:20.831604 14144 ts_tablet_manager.cc:1403] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.005s
I20260709 12:12:20.833504 14396 raft_consensus.cc:2804] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.834046 14396 raft_consensus.cc:697] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:20.834892 14396 consensus_queue.cc:237] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.842376 14023 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:20.843487 14144 raft_consensus.cc:359] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.844249 14144 raft_consensus.cc:385] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.844285 14061 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.844692 14144 raft_consensus.cc:740] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.845371 14144 consensus_queue.cc:260] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.846531 14249 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.847050 14249 raft_consensus.cc:697] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:20.847575 14144 ts_tablet_manager.cc:1434] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:20.847855 14249 consensus_queue.cc:237] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.849692 13988 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:20.817467 13869 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:20.848526 14144 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:20.840121 14344 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.856587 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.857311 14023 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.860494 14144 tablet_bootstrap.cc:654] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.870062 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.851819 14261 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:20.874380 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:20.853010 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:20.882371 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 55377.9us
I20260709 12:12:20.884655 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:20.875857 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.885375 14095 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:20.876217 14261 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:20.874179 14373 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:20.879514 14146 tablet_bootstrap.cc:492] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:20.827180 14418 raft_consensus.cc:697] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:20.890970 14146 ts_tablet_manager.cc:1403] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.262s	user 0.031s	sys 0.019s
I20260709 12:12:20.896194 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:20.901360 14344 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:20.893908 14062 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:20.905232 13945 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:20.905660 14380 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:20.906224 14420 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:20.888916 14097 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:20.909751 14146 raft_consensus.cc:359] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.897598 14092 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.911855 14142 tablet_bootstrap.cc:492] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:20.914381 14146 raft_consensus.cc:385] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.915539 14146 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.915719 14142 ts_tablet_manager.cc:1403] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.247s	user 0.016s	sys 0.015s
I20260709 12:12:20.892184 14021 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:20.918747 14404 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.922025 14146 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.915215 14405 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:20.923828 14093 raft_consensus.cc:1275] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:20.924023 14420 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:20.925256 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:20.925874 14418 consensus_queue.cc:237] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.928081 14143 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:20.928676 14143 ts_tablet_manager.cc:1403] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.297s	user 0.022s	sys 0.009s
W20260709 12:12:20.933054 13840 leader_election.cc:343] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.933604 13840 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:20.934377 14261 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.936367 13840 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:20.937422 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:20.938508 14261 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:20.938714 13768 catalog_manager.cc:5697] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.939247 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:20.940440 13840 leader_election.cc:343] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.920753 14396 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:12:20.942442 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:20.925513 14146 ts_tablet_manager.cc:1434] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 12:12:20.932071 14143 raft_consensus.cc:359] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:20.916837 14344 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:20.948779 14143 raft_consensus.cc:385] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.949288 14143 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
W20260709 12:12:20.941237 13840 leader_election.cc:343] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.950198 14143 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:20.950271 13840 leader_election.cc:343] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:20.948791 14146 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:20.954237 13838 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:20.955403 14224 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.956605 14224 raft_consensus.cc:697] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:20.957616 14224 consensus_queue.cc:237] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:20.961367 14143 ts_tablet_manager.cc:1434] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:12:20.961782 14092 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:20.965905 14143 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:20.959820 13768 catalog_manager.cc:5697] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:20.981750 13768 catalog_manager.cc:5697] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 2, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 2 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.986963 14249 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.995210 14249 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.007781 14380 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.988612 14062 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:21.019220 14142 raft_consensus.cc:359] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:21.026468 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 45277.7us
I20260709 12:12:21.029757 14249 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:21.029609 14380 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.040025 14380 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:21.042362 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:21.031524 14142 raft_consensus.cc:385] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.035202 14344 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:21.035075 14062 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:21.045958 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:21.048588 14142 raft_consensus.cc:740] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.030287 14023 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:21.081966 14142 consensus_queue.cc:260] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.060739 14249 raft_consensus.cc:2764] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:12:21.089107 14061 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:21.090225 14249 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.090762 14249 raft_consensus.cc:697] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:21.090793 14093 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:21.091800 14249 consensus_queue.cc:237] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.090878 14143 tablet_bootstrap.cc:654] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.097400 14144 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:21.099005 13945 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.106746 14146 tablet_bootstrap.cc:654] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.110217 14144 ts_tablet_manager.cc:1403] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.262s	user 0.015s	sys 0.006s
I20260709 12:12:21.114300 13770 catalog_manager.cc:5697] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.116269 13770 catalog_manager.cc:5697] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.118456 14142 ts_tablet_manager.cc:1434] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.202s	user 0.004s	sys 0.006s
I20260709 12:12:21.122576 14142 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:21.081555 14018 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:21.131400 14144 raft_consensus.cc:359] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.132246 14144 raft_consensus.cc:385] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.132584 14144 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.134290 14422 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.134899 14422 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.142743 14422 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:21.111562 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 76587.7us
I20260709 12:12:21.148372 14144 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.188134 14404 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.192871 14062 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:21.196588 14344 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.197227 13837 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:21.197276 14344 raft_consensus.cc:697] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:21.199024 14344 consensus_queue.cc:237] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.200307 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:21.200762 14422 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.201292 14422 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.201431 13870 raft_consensus.cc:2393] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:21.201655 14422 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.206411 13837 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:21.227283 14144 ts_tablet_manager.cc:1434] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.117s	user 0.012s	sys 0.000s
I20260709 12:12:21.222744 13768 catalog_manager.cc:5697] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 1 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } }
I20260709 12:12:21.229275 14144 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:21.214550 14418 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.230023 13768 catalog_manager.cc:5697] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.208168 14224 consensus_queue.cc:1048] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:12:21.244509 14142 tablet_bootstrap.cc:654] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.240307 13768 catalog_manager.cc:5697] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.242559 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:21.242717 14418 raft_consensus.cc:697] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:21.231106 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:21.265883 14143 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:21.266409 14143 ts_tablet_manager.cc:1403] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.301s	user 0.018s	sys 0.001s
I20260709 12:12:21.265182 13874 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:21.260135 14418 consensus_queue.cc:237] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.274701 14422 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.275785 13914 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:21.278334 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:21.257119 13870 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:21.278772 14300 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:21.280999 13840 leader_election.cc:343] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:21.284719 14144 tablet_bootstrap.cc:654] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.285187 14061 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:21.288949 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:21.285403 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:21.290339 14018 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:21.291167 14405 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.291599 14405 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.291965 14405 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.292671 14143 raft_consensus.cc:359] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.305414 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:21.310617 14143 raft_consensus.cc:385] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.311009 14096 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.310882 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:21.304780 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:21.315241 14434 consensus_queue.cc:1048] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:21.322716 14096 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:21.311079 14143 raft_consensus.cc:740] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.313519 14261 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.328691 14146 tablet_bootstrap.cc:492] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:21.329303 14146 ts_tablet_manager.cc:1403] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.381s	user 0.017s	sys 0.015s
I20260709 12:12:21.335925 14146 raft_consensus.cc:359] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.336905 14146 raft_consensus.cc:385] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.337239 14146 raft_consensus.cc:740] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.337956 14146 consensus_queue.cc:260] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.340070 14146 ts_tablet_manager.cc:1434] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:12:21.341684 13837 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:21.285895 14422 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:21.342689 14421 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.343227 14421 raft_consensus.cc:697] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:21.344127 14421 consensus_queue.cc:237] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.351929 14144 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:21.352675 14144 ts_tablet_manager.cc:1403] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.004s
I20260709 12:12:21.355597 14144 raft_consensus.cc:359] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.357429 14146 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:21.345475 14405 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.359313 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:21.360441 14261 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.360967 14261 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.356436 14144 raft_consensus.cc:385] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.361327 14261 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.361240 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:21.362421 14018 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.364041 14093 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:21.372897 14146 tablet_bootstrap.cc:654] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:21.377990 14063 consensus_peers.cc:597] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.385402 14146 tablet_bootstrap.cc:492] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:21.385982 14146 ts_tablet_manager.cc:1403] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.006s
I20260709 12:12:21.388801 14146 raft_consensus.cc:359] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.390434 14146 raft_consensus.cc:385] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.390756 14146 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.391625 14146 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.392762 14405 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:21.326447 14143 consensus_queue.cc:260] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.361784 14144 raft_consensus.cc:740] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.393519 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:21.394217 14146 ts_tablet_manager.cc:1434] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:12:21.395277 14146 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:21.395928 14143 ts_tablet_manager.cc:1434] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.003s
I20260709 12:12:21.401647 14300 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.403601 14146 tablet_bootstrap.cc:654] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:21.403286 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 44100.1us
I20260709 12:12:21.403764 14018 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:21.405705 14061 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:21.406790 14434 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:21.407279 14434 raft_consensus.cc:697] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:21.408218 14434 consensus_queue.cc:237] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.418322 14143 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:21.420080 14146 tablet_bootstrap.cc:492] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:21.427717 14146 ts_tablet_manager.cc:1403] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.013s
I20260709 12:12:21.430605 14146 raft_consensus.cc:359] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.431313 14146 raft_consensus.cc:385] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.431559 14146 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.432246 14146 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.395025 14144 consensus_queue.cc:260] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.434494 14144 ts_tablet_manager.cc:1434] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 12:12:21.435389 14144 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:21.436542 14142 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:21.437218 14142 ts_tablet_manager.cc:1403] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.315s	user 0.024s	sys 0.019s
I20260709 12:12:21.441318 14144 tablet_bootstrap.cc:654] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.444347 14146 ts_tablet_manager.cc:1434] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:21.445322 14146 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:21.448752 14261 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.450017 13869 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:21.451057 14146 tablet_bootstrap.cc:654] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.457084 14421 consensus_queue.cc:1048] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.463709 13948 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.440378 14142 raft_consensus.cc:359] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.473650 14142 raft_consensus.cc:385] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.474012 14142 raft_consensus.cc:740] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.474813 14142 consensus_queue.cc:260] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.476810 14404 consensus_queue.cc:1048] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.482677 14341 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.483366 14341 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.487112 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:21.487980 13945 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:21.489743 13989 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:21.506186 14405 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.506937 14405 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.508144 14143 tablet_bootstrap.cc:654] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.511439 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:21.512310 13945 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:21.513998 14063 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:21.515034 14434 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.515666 14434 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.516093 14434 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.516927 14261 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:21.517206 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:21.518364 14405 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:21.518803 14341 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:21.520092 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:21.524724 14404 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:21.525322 14404 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.525813 14404 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.530270 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:21.536769 14142 ts_tablet_manager.cc:1434] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.001s
I20260709 12:12:21.538112 14179 consensus_queue.cc:1048] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.538115 14142 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:21.543002 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:21.544132 14023 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:21.548066 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:21.550565 14224 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:21.551184 14341 consensus_queue.cc:1048] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.556533 14344 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.558382 14344 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:21.562860 13769 catalog_manager.cc:5697] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.579757 14420 consensus_queue.cc:1048] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:21.594807 14144 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:21.595461 14144 ts_tablet_manager.cc:1403] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.160s	user 0.030s	sys 0.031s
I20260709 12:12:21.596423 14146 tablet_bootstrap.cc:492] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:21.597241 14146 ts_tablet_manager.cc:1403] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.152s	user 0.054s	sys 0.069s
I20260709 12:12:21.598598 14144 raft_consensus.cc:359] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.599622 14144 raft_consensus.cc:385] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.529095 14434 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.605954 14142 tablet_bootstrap.cc:654] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:21.606633 14434 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:21.609264 14261 consensus_queue.cc:1048] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:21.611342 14404 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.612668 14021 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:21.626127 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:21.599982 14144 raft_consensus.cc:740] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.637418 14261 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.638041 14261 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.639881 14146 raft_consensus.cc:359] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.641479 14146 raft_consensus.cc:385] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.641888 14146 raft_consensus.cc:740] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.633472 14091 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:21.642939 14144 consensus_queue.cc:260] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:21.631518 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:21.646368 14143 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:21.646908 14143 ts_tablet_manager.cc:1403] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.003s
I20260709 12:12:21.650718 14146 consensus_queue.cc:260] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:21.658480 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:21.659065 14146 ts_tablet_manager.cc:1434] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 12:12:21.660164 14146 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:21.659943 13770 catalog_manager.cc:5697] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.663596 14144 ts_tablet_manager.cc:1434] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 12:12:21.662016 13770 catalog_manager.cc:5697] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.675753 14143 raft_consensus.cc:359] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.676574 14143 raft_consensus.cc:385] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:21.682876 14300 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.683475 14300 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:21.650254 13947 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:21.686090 14300 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:21.687397 14404 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:21.690294 14261 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:21.696806 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:21.697443 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:21.676864 14143 raft_consensus.cc:740] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:21.644950 14434 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:12:21.920138 14143 consensus_queue.cc:260] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:21.930437 14344 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.931171 14404 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:22.094343 14468 log.cc:927] Time spent T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:12:22.097250 14469 log.cc:927] Time spent T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:12:22.075263 14344 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.139755 14344 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.088171 14404 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:22.144979 14404 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.172024 14146 tablet_bootstrap.cc:654] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:22.202054 13947 consensus_meta.cc:287] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.001s
I20260709 12:12:22.220325 13947 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:22.287400 14142 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:22.288304 14142 ts_tablet_manager.cc:1403] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.750s	user 0.044s	sys 0.029s
W20260709 12:12:22.289547 14020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.023s
W20260709 12:12:22.453123 13949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.025s	sys 0.036s
W20260709 12:12:22.453480 14020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.010s	sys 0.023s
I20260709 12:12:22.464623 14143 ts_tablet_manager.cc:1434] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.817s	user 0.042s	sys 0.026s
W20260709 12:12:22.458760 13949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.025s	sys 0.036s
W20260709 12:12:22.465021 14143 ts_tablet_manager.cc:1467] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Tablet startup took 817ms
W20260709 12:12:22.465509 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 543442us
W20260709 12:12:22.470053 14143 ts_tablet_manager.cc:1469] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e: Trace:
0709 12:12:15.773326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.773500 (+   174us) service_pool.cc:224] Handling call
0709 12:12:15.785727 (+ 12227us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:15.785840 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:15.868449 (+ 82609us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:15.908586 (+ 40137us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:15.909388 (+   802us) inbound_call.cc:177] Queueing success response
0709 12:12:21.417880 (+5508492us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:21.647126 (+229246us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:21.651279 (+  4153us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:21.651804 (+   525us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":22340,"raft.queue_time_us":218909,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"tablet-open.queue_time_us":5508668,"thread_start_us":327641,"threads_started":1}
I20260709 12:12:22.490617 14143 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:22.505678 14146 tablet_bootstrap.cc:492] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:22.506342 14146 ts_tablet_manager.cc:1403] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.846s	user 0.015s	sys 0.011s
I20260709 12:12:22.509649 14146 raft_consensus.cc:359] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.510319 14146 raft_consensus.cc:385] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.510593 14146 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.488025 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.511221 14146 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.511471 13945 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:22.514386 14143 tablet_bootstrap.cc:654] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:22.517266 13838 leader_election.cc:343] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.523039 14146 ts_tablet_manager.cc:1434] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:22.524458 14146 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:22.527386 14142 raft_consensus.cc:359] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.527992 14142 raft_consensus.cc:385] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.528272 14142 raft_consensus.cc:740] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.529994 14142 consensus_queue.cc:260] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.553946 14146 tablet_bootstrap.cc:654] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.552011 14475 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.563257 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:22.565078 14475 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.567416 14475 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.560464 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:22.568657 13987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.007s
I20260709 12:12:22.785447 14475 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:22.762164 13987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.007s
I20260709 12:12:22.789101 14475 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:22.791903 14475 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:22.791935 14404 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.792912 14404 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.802911 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:22.805101 14484 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:22.803118 14470 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:22.805837 14484 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.806111 14470 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:22.799127 14478 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:22.775386 14344 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:22.815951 14143 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:22.816784 14143 ts_tablet_manager.cc:1403] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.326s	user 0.011s	sys 0.008s
I20260709 12:12:22.799746 14249 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.818096 14142 ts_tablet_manager.cc:1434] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.529s	user 0.010s	sys 0.011s
W20260709 12:12:22.818571 14142 ts_tablet_manager.cc:1467] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Tablet startup took 529ms
I20260709 12:12:22.818143 14404 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.821755 14249 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.829452 14489 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:22.830271 14489 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.830947 14249 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.832907 14484 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.821354 14479 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:22.810868 14478 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.840463 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:22.842156 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:22.842725 13947 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.844806 14249 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:22.814477 14344 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:22.853566 14095 raft_consensus.cc:2393] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:22.855022 14249 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.857502 14249 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.858893 14090 raft_consensus.cc:2393] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:22.844257 14063 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:22.818915 14142 ts_tablet_manager.cc:1469] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Trace:
0709 12:12:15.650203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.650376 (+   173us) service_pool.cc:224] Handling call
0709 12:12:15.685182 (+ 34806us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:15.685308 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:15.724097 (+ 38789us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:15.839224 (+115127us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:15.839806 (+   582us) inbound_call.cc:177] Queueing success response
0709 12:12:21.537711 (+5697905us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:22.288690 (+750979us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:22.478026 (+189336us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:22.478793 (+   767us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":43732,"raft.queue_time_us":6483,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"tablet-open.queue_time_us":5697997,"thread_start_us":28085,"threads_started":1}
I20260709 12:12:22.846706 14143 raft_consensus.cc:359] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.862346 14143 raft_consensus.cc:385] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.862835 14143 raft_consensus.cc:740] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.869060 14489 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:22.870519 14249 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.871347 14249 raft_consensus.cc:697] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:22.872680 14249 consensus_queue.cc:237] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:22.848115 14479 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.874584 14484 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.875131 14484 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.876252 14479 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.878830 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.880177 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.855088 14344 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:22.881450 14472 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:22.882303 14484 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.882210 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.878755 14143 consensus_queue.cc:260] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.885413 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.874094 14485 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.912516 14143 ts_tablet_manager.cc:1434] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.002s
I20260709 12:12:22.913959 14143 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:22.915560 14146 tablet_bootstrap.cc:492] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:22.916304 14146 ts_tablet_manager.cc:1403] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.392s	user 0.023s	sys 0.020s
I20260709 12:12:22.873175 14478 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.862854 14142 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:22.893337 14475 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:22.918251 14475 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.920017 14146 raft_consensus.cc:359] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:22.893204 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.920598 14146 raft_consensus.cc:385] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.921082 14146 raft_consensus.cc:740] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.894054 14470 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:22.921947 14146 consensus_queue.cc:260] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:22.924712 14146 ts_tablet_manager.cc:1434] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:12:22.924558 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:22.926389 14475 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.935587 14142 tablet_bootstrap.cc:654] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.938004 14143 tablet_bootstrap.cc:654] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.905998 14472 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.906417 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:22.909837 13944 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:22.946681 14487 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.907567 14344 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:22.910598 14479 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.911057 14261 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:22.947295 14487 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:22.951447 14344 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.956761 14487 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.957271 14344 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.943769 13943 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:22.945168 14485 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:22.959097 14261 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.969821 14472 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.969941 14261 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:22.951508 14479 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.962726 14470 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:22.973773 14470 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:22.975476 14344 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:22.975662 14249 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:22.976042 14344 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.976362 14249 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:22.977293 14470 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:22.977578 14485 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:22.978744 14344 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.981040 14249 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:22.983350 14143 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:22.983884 14143 ts_tablet_manager.cc:1403] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.004s
W20260709 12:12:23.036604 13840 leader_election.cc:343] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.038393 13840 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:23.049674 13912 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:23.054064 13912 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:23.070837 14179 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.078984 14249 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.081749 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.082489 14249 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.087001 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.090871 14372 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.094072 14344 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.095265 14344 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.100095 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.100245 14472 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.108619 14344 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.114746 14344 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.115667 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.115710 14344 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.119071 14472 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.121789 14142 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:23.122641 14472 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.123054 14142 ts_tablet_manager.cc:1403] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.260s	user 0.008s	sys 0.008s
I20260709 12:12:23.105664 14478 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.126529 14344 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.127204 14478 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.130288 14478 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.130031 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.131601 13942 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:23.133364 14144 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:23.136945 14249 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.137759 14249 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.140429 14249 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.153290 14505 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.154563 14505 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.158424 14505 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.069784 14143 raft_consensus.cc:359] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.147845 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.171911 14143 raft_consensus.cc:385] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:23.174618 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 88882.3us
I20260709 12:12:23.174080 14143 raft_consensus.cc:740] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.182788 13873 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:23.181417 14505 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.191084 14505 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.193511 14258 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.194588 14258 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.195489 14470 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:23.196506 14470 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.198621 14142 raft_consensus.cc:359] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.199787 14142 raft_consensus.cc:385] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.199883 14470 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.200165 14142 raft_consensus.cc:740] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
W20260709 12:12:23.203195 13840 leader_election.cc:343] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.223368 14142 consensus_queue.cc:260] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.226560 14142 ts_tablet_manager.cc:1434] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.002s
I20260709 12:12:23.215786 14249 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.218111 14143 consensus_queue.cc:260] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.232112 14143 ts_tablet_manager.cc:1434] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.248s	user 0.007s	sys 0.008s
I20260709 12:12:23.234412 14143 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:23.220932 14505 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.221942 14258 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.206981 14372 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.229877 14144 tablet_bootstrap.cc:654] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.237005 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.237934 13840 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:23.250684 14484 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:23.251477 14484 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.251991 14484 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.266466 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.301347 14142 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:23.313391 14143 tablet_bootstrap.cc:654] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.313603 14484 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.315032 14144 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:23.315707 14144 ts_tablet_manager.cc:1403] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.239s	user 0.012s	sys 0.016s
I20260709 12:12:23.320103 14484 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.371246 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.373088 13988 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:23.374799 13988 leader_election.cc:343] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.375777 14470 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.376109 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.376749 14470 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.379081 14477 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.379738 14477 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.382220 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:23.386142 14485 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.386880 14487 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.387364 14501 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.387094 14485 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.387807 14487 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.388141 14501 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.394511 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.395658 13867 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:23.398286 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.400238 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.402300 13946 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.405054 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.406137 13870 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:23.409339 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.533542 14487 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.532753 14470 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.534745 14470 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:23.535240 14470 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.535689 14470 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.535956 14506 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.536676 14506 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.536320 14487 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.531263 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.542114 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.545526 13873 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:23.546947 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.547444 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.549517 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.551440 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.553289 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.555124 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.559996 14506 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.540258 14487 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.564713 14470 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.565601 14487 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.541740 14477 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.541246 14485 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.568024 14470 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.572511 14142 tablet_bootstrap.cc:654] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.573068 13869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 51) took 1876 ms. Trace:
I20260709 12:12:23.573596 13869 rpcz_store.cc:276] 0709 12:12:21.710540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.857532 (+146992us) service_pool.cc:224] Handling call
0709 12:12:21.985856 (+128324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.084210 (+ 98354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.568693 (+1484483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.568828 (+   135us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:23.568980 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.569108 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.572847 (+  3739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:23.581657 14470 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.582559 14470 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.584813 14479 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.589536 13874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 35) took 1070 ms. Trace:
I20260709 12:12:23.590029 13874 rpcz_store.cc:276] 0709 12:12:22.518842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.588122 (+1069280us) service_pool.cc:224] Handling call
0709 12:12:23.588623 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.588990 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.589031 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.589110 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:23.589153 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.589219 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.589343 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:23.590395 14142 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:23.591789 14142 ts_tablet_manager.cc:1403] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.291s	user 0.013s	sys 0.011s
I20260709 12:12:23.594882 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.595323 14142 raft_consensus.cc:359] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.596160 14142 raft_consensus.cc:385] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.596589 14142 raft_consensus.cc:740] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.597512 14142 consensus_queue.cc:260] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:23.601583 13840 leader_election.cc:343] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.585651 14470 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.604259 14513 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.606570 14477 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.607251 14477 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.609616 14477 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.610191 14477 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.610984 14477 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.614264 13946 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:23.614521 14506 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.620141 14506 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.620921 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.621641 13874 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:23.622900 14506 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.616020 14479 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.624073 14479 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.626741 14479 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.630048 13840 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:23.616515 14478 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.632359 14513 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:23.631887 14478 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.632998 14513 raft_consensus.cc:697] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:23.634238 14513 consensus_queue.cc:237] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.634689 14478 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.641131 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:23.645927 13947 consensus_meta.cc:287] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.793s	user 0.017s	sys 0.017s
I20260709 12:12:23.646720 14404 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.647480 14404 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.649160 14477 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.650645 14474 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.650735 14261 consensus_queue.cc:1048] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:23.644385 13912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.017s
I20260709 12:12:23.660884 14142 ts_tablet_manager.cc:1434] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:12:23.652530 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:23.661628 13912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.017s
W20260709 12:12:23.670720 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 613484us
W20260709 12:12:23.678503 14063 leader_election.cc:343] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.681663 14063 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:23.683112 14478 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.683264 14473 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.683607 14478 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.684052 14478 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.684087 14473 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.685401 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.686264 14096 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:23.689842 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.690584 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.690795 14095 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:23.693862 14473 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.695544 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.696612 14089 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:23.697381 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.699940 14062 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:23.702541 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.706192 14479 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:23.706709 14479 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.707116 14479 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.697408 14258 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.711133 14258 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.713006 14501 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.714743 14258 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.715875 14258 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.718735 13912 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:23.720477 14473 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.721073 14473 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.720849 14258 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.721633 14473 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.723299 14258 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.723856 14258 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.724381 14258 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.728403 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.729538 14258 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.732002 14144 raft_consensus.cc:359] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.734292 14144 raft_consensus.cc:385] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.734495 14144 raft_consensus.cc:740] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.737424 14144 consensus_queue.cc:260] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.742997 14478 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.744046 14473 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.745563 14478 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.746735 14473 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.748111 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:23.748260 14479 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.750157 14405 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.750545 14405 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.750921 14405 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.750968 14516 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.751243 14479 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:23.751602 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52071.5us
I20260709 12:12:23.751212 14144 ts_tablet_manager.cc:1434] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.435s	user 0.012s	sys 0.000s
I20260709 12:12:23.753789 14144 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:23.751771 14516 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.755537 14062 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:23.758590 14478 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.759155 14478 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:23.761127 14478 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.760538 14062 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:23.769974 14479 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:23.770057 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.771050 14023 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:23.773013 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.773360 14516 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.773612 14062 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:23.774962 14479 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.775480 14479 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.776015 14479 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.771941 14405 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.782584 14405 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.788890 14506 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.790169 14144 tablet_bootstrap.cc:654] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.791698 14062 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:23.792029 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.801250 14405 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:23.801369 14062 leader_election.cc:343] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.793588 14478 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.801848 14405 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.802467 14405 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.802627 14506 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.803922 14478 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.794391 14479 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.805791 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.798861 13913 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:23.806347 13770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38470 (request call id 49) took 2376 ms. Trace:
I20260709 12:12:23.810591 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.782811 14142 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:23.806912 14479 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.816118 14473 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.820391 14473 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:23.821296 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.821393 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:23.822381 14091 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:23.822641 14473 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:23.823359 14143 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.007s
W20260709 12:12:23.823779 14143 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.007s	sys 0.007s
I20260709 12:12:23.824182 14144 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:23.825310 14514 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:23.826011 14514 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.826474 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.827175 14018 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:23.828444 14514 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:23.828572 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.829907 14144 ts_tablet_manager.cc:1403] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.001s
I20260709 12:12:23.831347 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.832136 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.832870 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.833504 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.834463 13913 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:23.835369 14405 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:23.835935 14300 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.836421 14300 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.836793 14300 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.838752 13986 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:23.841320 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.842785 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.843911 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.844782 13866 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.844870 14261 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.844700 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.848693 14261 consensus_queue.cc:1048] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.849015 13837 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:23.849696 14094 raft_consensus.cc:1240] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:23.850100 14143 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:23.850718 14143 ts_tablet_manager.cc:1403] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.617s	user 0.014s	sys 0.013s
I20260709 12:12:23.851743 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.852468 13874 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.855430 14142 tablet_bootstrap.cc:654] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.857432 14470 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.850494 13837 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:23.865342 14143 raft_consensus.cc:359] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.866334 14143 raft_consensus.cc:385] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.866631 14143 raft_consensus.cc:740] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.867466 14143 consensus_queue.cc:260] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.867998 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.868782 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.870688 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.874392 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.876559 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.817708 13770 rpcz_store.cc:276] 0709 12:12:21.429351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.429872 (+   521us) service_pool.cc:224] Handling call
0709 12:12:23.806094 (+2376222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:22.912519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:22.913253 (+   734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:22.913286 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:12:22.913305 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:22.913754 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:22.913846 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:22.913891 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:22.914243 (+   352us) tablet.cc:701] Row locks acquired
0709 12:12:22.914261 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:22.914412 (+   151us) write_op.cc:270] Start()
0709 12:12:22.914523 (+   111us) write_op.cc:276] Timestamp: P: 1783599142914371 usec, L: 0
0709 12:12:22.914543 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:22.915246 (+   703us) log.cc:844] Serialized 928 byte log entry
0709 12:12:22.925789 (+ 10543us) op_driver.cc:464] REPLICATION: finished
0709 12:12:22.929307 (+  3518us) write_op.cc:301] APPLY: starting
0709 12:12:22.929395 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:22.929525 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:22.929661 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:22.929948 (+   287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:22.930145 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:12:22.930197 (+    52us) write_op.cc:312] APPLY: finished
0709 12:12:22.930424 (+   227us) log.cc:844] Serialized 28 byte log entry
0709 12:12:22.935114 (+  4690us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:22.935215 (+   101us) write_op.cc:454] Released schema lock
0709 12:12:22.935262 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:22.936770 (+  1508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:22.936804 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2459,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":3285,"apply.run_cpu_time_us":1887,"apply.run_wall_time_us":7434,"num_ops":2,"prepare.queue_time_us":26432,"prepare.run_cpu_time_us":6697,"prepare.run_wall_time_us":6827,"raft.queue_time_us":4274,"raft.run_cpu_time_us":1236,"raft.run_wall_time_us":5833,"replication_time_us":11097,"thread_start_us":40354,"threads_started":4,"wal-append.queue_time_us":4029}]]}
I20260709 12:12:23.879637 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.881440 14341 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.882156 14341 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.880326 14404 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:23.888947 14477 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.889560 14477 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.891322 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.892920 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.894323 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.894593 13947 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.895527 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.892331 14146 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:23.892326 13914 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:23.901608 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.901957 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.901851 14477 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.902145 14300 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:23.903486 14477 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:23.903528 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:23.904174 14477 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.905488 14300 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:23.896494 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.908594 14143 ts_tablet_manager.cc:1434] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:12:23.909106 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:23.909322 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.909951 14143 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:23.910034 13946 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:23.910701 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.911288 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.906636 14477 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.920894 14144 raft_consensus.cc:359] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.922816 14144 raft_consensus.cc:385] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.923273 14144 raft_consensus.cc:740] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.924162 14144 consensus_queue.cc:260] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:23.884783 14341 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:23.915721 14474 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:23.913215 13946 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:23.918638 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.934670 14144 ts_tablet_manager.cc:1434] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
W20260709 12:12:23.920715 14063 leader_election.cc:343] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:23.874410 13837 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:23.940152 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.960865 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:23.961694 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.962730 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:23.963804 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.967826 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.969230 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.969648 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.972791 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:23.972925 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:23.973126 14063 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:23.981115 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.971570 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:23.978456 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:23.997546 14142 tablet_bootstrap.cc:492] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:23.996062 14020 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:23.998577 14015 raft_consensus.cc:2393] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:23.998915 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.994344 14021 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.029872 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:23.996976 14096 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:23.973933 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.031203 14016 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:24.032120 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:23.981827 13945 raft_consensus.cc:1240] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:23.999938 14495 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.033524 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:24.000207 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 61067.2us
I20260709 12:12:24.002170 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.002611 14022 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:24.002847 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.037137 14023 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:24.038380 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.039431 14019 raft_consensus.cc:2393] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:24.040057 13989 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.042052 13989 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.043111 14474 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.043313 14341 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.044203 14341 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.008466 14142 ts_tablet_manager.cc:1403] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.010s
I20260709 12:12:24.042551 14143 tablet_bootstrap.cc:654] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.048089 14096 raft_consensus.cc:1240] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.047886 14142 raft_consensus.cc:359] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:23.994705 13869 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:23.979485 14405 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:23.955992 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 81673.1us
I20260709 12:12:24.006541 14421 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.008111 13840 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:24.004742 14475 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.013422 14509 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.011786 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.014979 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.015442 14144 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:24.020874 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.021533 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.023195 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.032366 14063 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:23.998577 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.060959 13989 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.063517 14477 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.065128 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 68385.6us
I20260709 12:12:24.066012 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.066413 14475 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.068310 14485 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.007001 13866 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:24.072926 14485 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.073011 13989 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.059674 14509 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.075938 14509 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.077132 14477 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.077950 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 45727.7us
I20260709 12:12:24.079713 14405 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.080680 13945 raft_consensus.cc:2393] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:24.081332 14091 raft_consensus.cc:1240] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.082841 13768 catalog_manager.cc:5697] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:24.084714 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.012372 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.049217 14142 raft_consensus.cc:385] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.073472 14485 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.043838 14474 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.069733 14475 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.106999 14142 raft_consensus.cc:740] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.085001 13768 catalog_manager.cc:5697] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:24.115383 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.117136 14142 consensus_queue.cc:260] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.121101 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.123207 14421 consensus_queue.cc:1059] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:24.123306 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.124805 14261 raft_consensus.cc:3055] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.125262 14261 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:24.126212 14477 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.126219 14261 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.126965 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.127740 14261 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.128808 14487 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.127130 14477 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.132012 14477 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.137187 14142 ts_tablet_manager.cc:1434] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.092s	user 0.002s	sys 0.006s
I20260709 12:12:24.138234 13874 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:24.105571 14179 raft_consensus.cc:2764] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:24.138911 14514 raft_consensus.cc:2764] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:12:24.139030 14142 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:24.145079 14146 tablet_bootstrap.cc:654] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.145176 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.146014 14018 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
W20260709 12:12:24.146673 14063 leader_election.cc:343] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.147778 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.149633 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.149796 14405 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:24.055955 13988 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.151397 14341 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.152776 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 102485us
I20260709 12:12:24.155786 13989 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:24.156922 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 43826.2us
I20260709 12:12:24.158604 14341 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:24.160971 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.088249 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.164546 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.165383 14018 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:24.057873 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.086829 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.176836 14062 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.090049 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.184209 14146 tablet_bootstrap.cc:492] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:24.184960 14146 ts_tablet_manager.cc:1403] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.293s	user 0.020s	sys 0.002s
I20260709 12:12:24.185417 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.188793 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.190296 14062 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.190376 14532 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.191561 14143 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:24.191335 14532 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:24.192065 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 46406.4us
W20260709 12:12:24.193516 14528 log.cc:927] Time spent T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:12:24.192101 14143 ts_tablet_manager.cc:1403] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.283s	user 0.032s	sys 0.037s
I20260709 12:12:24.192497 14062 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.198211 13768 catalog_manager.cc:5697] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:24.152401 14063 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.170259 14474 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.198508 14062 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:24.172899 14021 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:24.179479 14405 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.198853 13986 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.205003 14062 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:24.187301 14179 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.188019 14096 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:24.197643 14249 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.204478 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.216784 14480 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.213631 14179 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.215008 14341 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.217741 14020 raft_consensus.cc:1240] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.221776 14144 tablet_bootstrap.cc:654] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.209035 14506 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:24.221539 14146 raft_consensus.cc:359] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.220412 14249 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:24.218914 14478 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:24.227617 14146 raft_consensus.cc:385] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.230492 13986 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.233724 14146 raft_consensus.cc:740] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
W20260709 12:12:24.234375 13989 leader_election.cc:343] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.241144 13986 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.243264 13986 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.244364 13913 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.229063 14495 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:12:24.245931 14509 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:24.246443 14509 raft_consensus.cc:697] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:24.229404 14061 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.247527 14509 consensus_queue.cc:237] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.248257 14061 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.228577 14473 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.232925 14506 raft_consensus.cc:697] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.249836 14061 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.251065 14146 consensus_queue.cc:260] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.238605 14477 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.240067 14091 raft_consensus.cc:1240] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 12:12:24.291424 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 139181us
I20260709 12:12:24.292562 14480 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.260475 14470 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.240866 14478 raft_consensus.cc:697] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.278146 14516 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.284425 14249 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.281173 14495 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.312582 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.313638 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.313711 14506 consensus_queue.cc:237] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.314172 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.315194 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.308415 14144 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:24.343585 14144 ts_tablet_manager.cc:1403] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.350s	user 0.014s	sys 0.005s
I20260709 12:12:24.309540 14473 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:24.309749 14179 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.310580 14143 raft_consensus.cc:359] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.347124 14143 raft_consensus.cc:385] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.304093 14532 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.347486 14143 raft_consensus.cc:740] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
W20260709 12:12:24.301286 14063 leader_election.cc:343] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:24.319546 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbb00 after lost signal to thread 7581
I20260709 12:12:24.241262 14485 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.345016 14018 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
W20260709 12:12:24.335541 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 85818.6us
I20260709 12:12:24.357110 14143 consensus_queue.cc:260] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.362705 14144 raft_consensus.cc:359] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.363658 14144 raft_consensus.cc:385] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.364059 14144 raft_consensus.cc:740] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.369266 14144 consensus_queue.cc:260] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:24.370527 13895 debug-util.cc:398] Leaking SignalData structure 0x7b0800300520 after lost signal to thread 13806
I20260709 12:12:24.372346 14144 ts_tablet_manager.cc:1434] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:12:24.373744 14144 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:24.377720 14142 tablet_bootstrap.cc:654] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:24.358917 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 57689.4us
I20260709 12:12:24.382479 14063 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.394524 14143 ts_tablet_manager.cc:1434] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.199s	user 0.003s	sys 0.006s
I20260709 12:12:24.405220 14146 ts_tablet_manager.cc:1434] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.220s	user 0.007s	sys 0.003s
W20260709 12:12:24.406980 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 203641us
W20260709 12:12:24.431327 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 178842us
W20260709 12:12:24.423604 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 218666us
I20260709 12:12:24.453300 14144 tablet_bootstrap.cc:654] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.453006 13986 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.481300 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:24.482100 13867 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:24.484370 14549 log.cc:927] Time spent T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:12:24.486902 14143 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
W20260709 12:12:24.372611 13895 debug-util.cc:398] Leaking SignalData structure 0x7b080034c580 after lost signal to thread 13898
I20260709 12:12:24.451433 14300 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:24.491818 13986 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.495985 13986 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.395161 14495 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.400733 14179 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.499074 13838 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.400352 14485 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:24.395521 14063 leader_election.cc:343] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.516965 14179 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.497938 14300 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.518563 14470 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:24.515440 14537 log.cc:927] Time spent T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:12:24.515671 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08002da5a0 after lost signal to thread 13973
I20260709 12:12:24.498849 14404 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.540688 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2500 after lost signal to thread 13974
I20260709 12:12:24.541586 14421 consensus_queue.cc:1059] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:24.541988 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08000d43c0 after lost signal to thread 14047
I20260709 12:12:24.543085 14261 raft_consensus.cc:3055] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.543448 14261 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:24.544023 13913 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:24.544246 14261 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.545931 14261 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.405056 14478 consensus_queue.cc:237] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.552752 13867 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
W20260709 12:12:24.557859 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9d80 after lost signal to thread 14121
W20260709 12:12:24.558485 13895 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1c80 after lost signal to thread 14122
I20260709 12:12:24.563088 14179 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.525497 14146 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:24.566555 14554 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.567018 14554 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.567344 14554 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.492661 14516 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.578574 14143 tablet_bootstrap.cc:654] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.582765 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.585539 13947 raft_consensus.cc:1240] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.526804 13838 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.521979 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.396950 14061 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:24.531059 14553 consensus_queue.cc:1059] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:12:24.531636 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:24.532614 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 137142us
W20260709 12:12:24.596053 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 199256us
I20260709 12:12:24.596688 14553 raft_consensus.cc:3055] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.597136 14479 raft_consensus.cc:2804] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:24.526584 14477 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.597599 14479 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.598006 14479 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:24.598330 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 72215us
W20260709 12:12:24.599363 13838 leader_election.cc:343] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.599817 13838 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.527662 14514 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.600873 14179 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.597999 14477 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.601321 14179 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:24.601532 13942 raft_consensus.cc:1240] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.601786 14179 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.601833 14513 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:24.602902 14477 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:24.603868 14550 consensus_queue.cc:1059] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:24.597153 14553 raft_consensus.cc:740] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:24.606114 14550 raft_consensus.cc:3055] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.606559 14550 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:24.607551 14550 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.607863 14261 consensus_queue.cc:1059] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.608927 14261 raft_consensus.cc:3055] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.609268 14261 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:24.533584 14300 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.610154 14261 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.528741 14470 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.611168 14470 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.611594 14261 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.613627 14513 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:24.615739 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.540002 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.617096 14096 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:24.615137 14479 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.600873 14514 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:24.619319 14514 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.621070 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.621836 13947 raft_consensus.cc:2468] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:24.604058 14061 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.605741 14553 consensus_queue.cc:260] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.619151 14479 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:24.576061 14554 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.629276 14061 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.630023 13944 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:24.630112 14506 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.626843 14062 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:24.622926 13989 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:24.632822 14405 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:24.633093 14477 raft_consensus.cc:2804] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:24.633350 14405 raft_consensus.cc:697] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.633560 14477 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.634008 14477 raft_consensus.cc:3060] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.634338 14405 consensus_queue.cc:237] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.634968 14061 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.635844 14506 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:24.636233 14506 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.628618 13838 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.629087 14538 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.636555 14506 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.637217 14550 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.639242 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.641306 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.653093 14542 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.645358 14485 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.653625 14542 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:24.654079 14542 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.653834 14485 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.656183 14485 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.656813 14553 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.600530 13912 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.659935 14473 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.659955 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 59517.8us
I20260709 12:12:24.661226 13912 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.665099 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.669775 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.677793 14146 tablet_bootstrap.cc:654] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.672894 14473 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.679473 14473 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.680022 14473 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.681047 13837 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:24.681995 14484 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:24.682389 14484 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.682737 14484 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.684500 14538 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:24.678972 14513 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.685433 14513 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:24.686039 14513 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.682715 14501 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:24.688402 14501 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.690699 14501 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:24.692289 14300 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:24.692906 14300 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.693197 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.695073 14300 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:24.697021 14144 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:24.697111 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.697660 14144 ts_tablet_manager.cc:1403] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.324s	user 0.025s	sys 0.020s
I20260709 12:12:24.697985 14018 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:24.701706 13913 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:24.671603 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.706168 14484 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.708045 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.708981 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.668292 14542 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.709651 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.713608 13867 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.713918 14470 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.714696 14142 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:24.714839 14542 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.715286 14142 ts_tablet_manager.cc:1403] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.577s	user 0.034s	sys 0.042s
I20260709 12:12:24.705479 14300 raft_consensus.cc:2804] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.716478 14300 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:24.717025 14300 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.710451 14179 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.720476 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.720691 14142 raft_consensus.cc:359] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.723846 14142 raft_consensus.cc:385] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.724225 14142 raft_consensus.cc:740] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.728688 14142 consensus_queue.cc:260] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.734627 13869 raft_consensus.cc:1240] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.736060 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.738435 14559 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.738955 14559 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.741137 13872 raft_consensus.cc:1240] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.742897 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.744158 14554 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.745260 14559 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:24.746023 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.735080 14094 raft_consensus.cc:1240] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.750694 14479 consensus_queue.cc:1059] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.750844 14018 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.722301 14478 consensus_queue.cc:1059] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:12:24.706780 14061 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.752857 14538 raft_consensus.cc:3055] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.753273 14538 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.753902 14479 raft_consensus.cc:3055] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.754259 14479 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.754328 14538 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.754947 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:24.755188 14479 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.757185 14548 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.758327 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 55193.5us
I20260709 12:12:24.759467 14061 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.760506 14548 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:24.761782 13989 leader_election.cc:343] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.762455 14479 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.763731 14506 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.765724 14142 ts_tablet_manager.cc:1434] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:12:24.766983 14142 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:24.767443 14506 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:24.770004 14514 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.771054 14470 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:24.771188 13874 raft_consensus.cc:1240] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.772007 14538 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.773929 14484 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:24.774657 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 49685.2us
I20260709 12:12:24.775573 13912 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.777144 14509 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.778671 14514 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.779636 14548 consensus_queue.cc:1059] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.780522 14548 consensus_queue.cc:1243] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer 33ef851003ef478cac1897bfee45a8f2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:12:24.781881 14478 raft_consensus.cc:3055] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.782011 14179 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.782404 14478 raft_consensus.cc:740] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.783530 14478 consensus_queue.cc:260] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.742966 14513 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.786449 14513 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.787209 13868 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:24.792517 14018 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:24.793903 14300 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.794340 14495 consensus_queue.cc:1059] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:24.794687 13913 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:24.792837 14478 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.798769 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.801388 14506 consensus_queue.cc:1059] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.775609 14144 raft_consensus.cc:359] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.747454 14477 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:24.801601 14495 raft_consensus.cc:3055] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.801712 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.803831 14495 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.802438 14480 raft_consensus.cc:3055] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:24.801963 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.805495 14480 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:24.804821 14495 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.806137 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:24.806278 14061 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.806411 14480 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:24.807129 13868 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
W20260709 12:12:24.807502 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 45126.3us
I20260709 12:12:24.808012 14480 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.802871 14144 raft_consensus.cc:385] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.809489 14144 raft_consensus.cc:740] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.811477 14144 consensus_queue.cc:260] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.779838 13912 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.813202 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.813308 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.813410 14509 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.806555 14495 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.808939 14548 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.808604 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.800895 14554 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:24.816946 14554 raft_consensus.cc:697] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:24.818012 14554 consensus_queue.cc:237] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.821841 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.825455 14144 ts_tablet_manager.cc:1434] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 12:12:24.827281 14143 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:24.828135 14143 ts_tablet_manager.cc:1403] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.342s	user 0.017s	sys 0.005s
I20260709 12:12:24.833312 14092 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:24.833673 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.834354 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.836412 14088 raft_consensus.cc:2393] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:24.842449 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:24.843739 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:24.844588 14063 leader_election.cc:343] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:24.845352 14477 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:24.846879 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:24.847568 13944 raft_consensus.cc:3060] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.853417 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.853793 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.860872 14020 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.861290 13868 raft_consensus.cc:2468] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:24.861516 13874 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.846789 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.865731 14095 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:24.868891 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.841089 14473 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.869002 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.855072 14144 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:24.887327 14142 tablet_bootstrap.cc:654] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.885990 14477 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.903985 13838 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.889303 13941 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:24.895831 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:24.899039 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:24.909780 14015 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:24.925704 14300 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:24.909816 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.911479 14421 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.909871 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.894454 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:24.915791 13872 raft_consensus.cc:3060] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:24.931702 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 44299us
I20260709 12:12:24.932076 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.932834 14470 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.933104 13988 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.933483 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.933670 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.934005 14143 raft_consensus.cc:359] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.934757 14143 raft_consensus.cc:385] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.935024 14143 raft_consensus.cc:740] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.935578 14143 consensus_queue.cc:260] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:24.935933 14553 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.937031 13867 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:24.937712 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.932287 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.939555 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.940007 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.940237 14016 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:24.940887 14023 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:24.918197 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:24.942519 13838 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.910073 14477 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:24.946915 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.949149 13838 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.951018 14501 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.951522 13838 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.952450 14501 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.953789 14095 raft_consensus.cc:2410] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:24.953903 14023 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:24.958065 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:24.960762 14484 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.960980 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:24.961738 14421 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.941393 13866 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:24.965859 14096 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:24.967643 13986 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.975543 13838 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:24.978497 14144 tablet_bootstrap.cc:654] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.963027 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.980207 14143 ts_tablet_manager.cc:1434] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.152s	user 0.005s	sys 0.002s
I20260709 12:12:24.968541 14477 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.969094 14473 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:24.970275 14094 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:24.973182 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:24.983335 13944 raft_consensus.cc:2468] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:24.923647 13914 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:24.985414 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68596.7us
I20260709 12:12:24.986223 13914 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:24.960424 14020 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:24.992487 14473 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:24.999691 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:24.987959 13988 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:25.001215 14146 tablet_bootstrap.cc:492] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:25.016021 14146 ts_tablet_manager.cc:1403] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.514s	user 0.012s	sys 0.038s
I20260709 12:12:25.015214 14341 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:25.001762 14421 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:25.018899 13912 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:25.019366 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 55707.6us
I20260709 12:12:24.995051 14554 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:24.994184 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:25.004359 13874 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:24.997421 14542 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:25.010049 14089 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:25.023548 14017 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:25.027614 14143 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:25.012900 13838 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:25.014469 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:25.020347 13988 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:25.030063 13837 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:25.023783 14341 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:25.029314 14487 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:25.031466 14501 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:25.023517 14509 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:25.023684 13944 raft_consensus.cc:1240] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:25.032258 13771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38478 (request call id 49) took 3462 ms. Trace:
I20260709 12:12:25.045495 13771 rpcz_store.cc:276] 0709 12:12:21.569346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.582699 (+ 13353us) service_pool.cc:224] Handling call
0709 12:12:25.032083 (+3449384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7237,"reported_tablets":2}
I20260709 12:12:25.041697 14513 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:25.041918 14341 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:25.020910 14554 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:25.047389 14341 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.047592 14554 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.042498 13988 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:25.053557 14470 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:25.061668 13989 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:25.062886 14477 raft_consensus.cc:2804] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:25.063438 14477 raft_consensus.cc:697] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:25.066815 14516 consensus_queue.cc:1059] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:25.067293 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:25.068529 13988 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:25.038160 14146 raft_consensus.cc:359] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:25.070264 14146 raft_consensus.cc:385] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.070583 14146 raft_consensus.cc:740] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:25.071344 14146 consensus_queue.cc:260] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:25.073695 14341 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.064347 14477 consensus_queue.cc:237] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.077090 14341 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:25.075130 14146 ts_tablet_manager.cc:1434] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.004s
I20260709 12:12:25.078656 14146 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:25.074872 13872 raft_consensus.cc:2468] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:25.084669 14501 raft_consensus.cc:697] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:25.084812 14470 consensus_queue.cc:1059] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:25.086084 14470 raft_consensus.cc:3055] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:25.085989 14501 consensus_queue.cc:237] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.087150 13769 catalog_manager.cc:5697] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:25.089666 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 50354.6us
I20260709 12:12:25.088395 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:25.088954 13989 leader_election.cc:343] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.088996 14014 raft_consensus.cc:1275] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.091611 13914 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:25.086512 14470 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:25.092052 13769 catalog_manager.cc:5697] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:25.101728 13768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38496 (request call id 53) took 3673 ms. Trace:
I20260709 12:12:25.144866 13770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38490 (request call id 46) took 1208 ms. Trace:
I20260709 12:12:25.145659 13770 rpcz_store.cc:276] 0709 12:12:23.889158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.892925 (+  3767us) service_pool.cc:224] Handling call
0709 12:12:25.097605 (+1204680us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15930,"reported_tablets":9}
I20260709 12:12:25.153103 14146 tablet_bootstrap.cc:654] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.147904 14480 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.153743 14480 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:25.149101 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 65800.9us
I20260709 12:12:25.089051 14513 raft_consensus.cc:697] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:25.083818 14341 raft_consensus.cc:2804] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:25.092537 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:25.095691 14509 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:25.161908 14143 tablet_bootstrap.cc:654] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.164052 13866 raft_consensus.cc:1240] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:25.102348 13768 rpcz_store.cc:276] 0709 12:12:21.428857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.429519 (+   662us) service_pool.cc:224] Handling call
0709 12:12:25.101668 (+3672149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:24.499568 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:24.500161 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:24.500214 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:12:24.500232 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:24.518621 (+ 18389us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:24.518725 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:24.518751 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:24.519249 (+   498us) tablet.cc:701] Row locks acquired
0709 12:12:24.519369 (+   120us) write_op.cc:260] PREPARE: finished
0709 12:12:24.519567 (+   198us) write_op.cc:270] Start()
0709 12:12:24.519716 (+   149us) write_op.cc:276] Timestamp: P: 1783599144519495 usec, L: 0
0709 12:12:24.519752 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:12:24.520534 (+   782us) log.cc:844] Serialized 1316 byte log entry
0709 12:12:24.870798 (+350264us) op_driver.cc:464] REPLICATION: finished
0709 12:12:24.950029 (+ 79231us) write_op.cc:301] APPLY: starting
0709 12:12:24.950156 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:24.950368 (+   212us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:24.950557 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:24.951331 (+   774us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:24.951671 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:12:24.951775 (+   104us) write_op.cc:312] APPLY: finished
0709 12:12:24.952209 (+   434us) log.cc:844] Serialized 34 byte log entry
0709 12:12:24.952414 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:24.952511 (+    97us) write_op.cc:454] Released schema lock
0709 12:12:24.952564 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.013747 (+ 61183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.013782 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39413,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":78898,"apply.run_cpu_time_us":3138,"apply.run_wall_time_us":39464,"num_ops":3,"prepare.queue_time_us":249479,"prepare.run_cpu_time_us":23024,"prepare.run_wall_time_us":148116,"raft.queue_time_us":160989,"raft.run_cpu_time_us":4362,"raft.run_wall_time_us":79128,"replication_time_us":350878,"thread_start_us":477213,"threads_started":4,"wal-append.queue_time_us":180262}]]}
I20260709 12:12:25.165148 13868 raft_consensus.cc:1275] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:25.149014 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 98247.2us
I20260709 12:12:25.160375 14421 consensus_queue.cc:1059] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:12:25.180903 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:25.097057 14016 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
W20260709 12:12:25.155849 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.179416 14480 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:25.181666 13872 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:25.189179 14142 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:25.192739 14142 ts_tablet_manager.cc:1403] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.426s	user 0.018s	sys 0.003s
I20260709 12:12:25.194455 14470 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.159132 14341 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.196280 14341 raft_consensus.cc:3060] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:25.196441 13914 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:25.188324 14509 raft_consensus.cc:697] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:25.189354 14495 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.201162 14495 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.195839 14470 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.203871 14062 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:25.185104 14553 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:25.173276 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 104842us
I20260709 12:12:25.223114 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:25.223932 14094 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:25.224222 14061 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:25.215876 14475 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:25.214272 14480 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:25.236500 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 67782.4us
W20260709 12:12:25.212836 14063 consensus_peers.cc:597] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.206450 14550 consensus_queue.cc:1048] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:12:25.242811 13986 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:25.212493 14506 consensus_queue.cc:1059] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:12:25.200506 14509 consensus_queue.cc:237] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.241707 14480 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.248617 14249 raft_consensus.cc:2804] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:25.268997 14249 raft_consensus.cc:697] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:25.269634 13986 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:25.243212 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 82443.6us
I20260709 12:12:25.245713 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:25.270133 14249 consensus_queue.cc:237] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.305235 13866 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:25.248930 14479 consensus_queue.cc:1048] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:12:25.259315 14480 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:25.329787 14019 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:25.330763 14554 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.332959 14495 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:25.335342 13944 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:25.299703 14061 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:25.337693 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 76944us
I20260709 12:12:25.245335 14513 consensus_queue.cc:237] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.342434 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:25.344900 14554 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:25.345909 14089 raft_consensus.cc:1275] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.347775 14484 raft_consensus.cc:3055] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:25.348244 14484 raft_consensus.cc:740] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:25.349208 14484 consensus_queue.cc:260] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.350971 14405 raft_consensus.cc:3055] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:25.351614 14405 raft_consensus.cc:740] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:25.352147 14495 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:25.353340 14559 raft_consensus.cc:3055] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:25.353835 14559 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:25.354032 14142 raft_consensus.cc:359] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.354987 14559 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.356920 14405 consensus_queue.cc:260] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.358530 14559 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.359117 14405 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.367652 14146 tablet_bootstrap.cc:492] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:25.368387 14146 ts_tablet_manager.cc:1403] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.018s
I20260709 12:12:25.372054 14146 raft_consensus.cc:359] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.373171 14146 raft_consensus.cc:385] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.354948 14142 raft_consensus.cc:385] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.373646 14146 raft_consensus.cc:740] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:25.373849 14142 raft_consensus.cc:740] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:25.376989 14142 consensus_queue.cc:260] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:25.372444 14063 leader_election.cc:343] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.380806 14484 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.382786 14146 consensus_queue.cc:260] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.303210 14144 tablet_bootstrap.cc:492] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:25.401388 14144 ts_tablet_manager.cc:1403] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.573s	user 0.029s	sys 0.017s
I20260709 12:12:25.303237 14477 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:25.412118 14142 ts_tablet_manager.cc:1434] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.219s	user 0.007s	sys 0.002s
I20260709 12:12:25.416970 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:25.417855 13872 raft_consensus.cc:2393] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:25.420254 13988 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:25.403887 14577 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:25.421175 14577 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:25.421731 14577 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:25.381821 14341 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.430594 14341 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:25.402420 14475 consensus_queue.cc:1048] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:12:25.407562 14550 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:12:25.436935 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:25.438683 13989 leader_election.cc:343] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.441221 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:25.405095 14421 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.445194 14421 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.446451 14580 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:25.469528 14146 ts_tablet_manager.cc:1434] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.101s	user 0.010s	sys 0.003s
I20260709 12:12:25.398092 14495 consensus_queue.cc:1048] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 12:12:25.486881 14142 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:25.489269 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:25.490319 13866 raft_consensus.cc:3060] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:25.448004 14421 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:25.474258 14474 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.480608 14478 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.501029 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 232875us
I20260709 12:12:25.501458 14146 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:25.508153 13986 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:25.483177 14479 consensus_queue.cc:1048] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:12:25.501034 14474 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.502796 14478 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:25.514663 14470 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:25.544519 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:25.546269 14021 raft_consensus.cc:1275] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.550622 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:25.563400 14094 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:25.560887 13838 leader_election.cc:343] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.533895 14470 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.581764 14484 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:12:25.569492 13840 leader_election.cc:343] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.571713 14300 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.572960 14470 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:25.616703 14405 consensus_queue.cc:1048] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:12:25.621734 14478 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:25.573668 14480 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.623826 14143 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:25.624429 14143 ts_tablet_manager.cc:1403] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.603s	user 0.049s	sys 0.052s
I20260709 12:12:25.600198 14300 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:25.634374 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:25.635844 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:25.637451 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:25.641151 14063 consensus_peers.cc:597] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.641683 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 144949us
W20260709 12:12:25.642932 14593 log.cc:927] Time spent T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:25.646515 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:25.646695 14480 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:25.648557 13840 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:25.649757 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 83997.3us
I20260709 12:12:25.653409 14261 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:25.656620 14592 log.cc:927] Time spent T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:12:25.654340 14144 raft_consensus.cc:359] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.661504 14144 raft_consensus.cc:385] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.661873 14144 raft_consensus.cc:740] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
W20260709 12:12:25.673540 14062 leader_election.cc:343] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.676102 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:25.677983 14146 tablet_bootstrap.cc:654] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.682896 14144 consensus_queue.cc:260] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.652442 13866 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:25.691815 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:25.692566 14022 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:25.688290 14061 leader_election.cc:343] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:25.719748 14015 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.713814 14017 raft_consensus.cc:2393] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:25.740043 14142 tablet_bootstrap.cc:654] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.770620 14470 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:25.783494 14146 tablet_bootstrap.cc:492] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:25.784132 14144 ts_tablet_manager.cc:1434] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.382s	user 0.006s	sys 0.005s
I20260709 12:12:25.785257 14146 ts_tablet_manager.cc:1403] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.290s	user 0.014s	sys 0.011s
I20260709 12:12:25.786710 14143 raft_consensus.cc:359] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.787447 14143 raft_consensus.cc:385] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.787745 14143 raft_consensus.cc:740] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:25.711766 13988 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:25.788501 14143 consensus_queue.cc:260] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.728549 14016 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:25.797466 14018 raft_consensus.cc:2393] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:25.815595 14577 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:25.857340 14590 raft_consensus.cc:2804] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:25.763811 14513 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 12:12:25.781378 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 89044us
W20260709 12:12:25.864063 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 152458us
I20260709 12:12:25.774407 14583 consensus_queue.cc:1048] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
W20260709 12:12:25.901470 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 83840.6us
I20260709 12:12:25.919430 14143 ts_tablet_manager.cc:1434] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.295s	user 0.011s	sys 0.005s
I20260709 12:12:25.923216 14261 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:25.923836 14261 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:25.924379 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:25.930692 14142 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:25.931259 14142 ts_tablet_manager.cc:1403] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.449s	user 0.011s	sys 0.005s
I20260709 12:12:25.905534 14590 raft_consensus.cc:697] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
W20260709 12:12:25.910111 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 47325.4us
I20260709 12:12:25.913126 14470 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:25.963770 14261 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:25.929021 14094 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:12:25.929404 14474 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:25.974673 14094 pending_rounds.cc:85] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Aborting all ops after (but not including) 0
I20260709 12:12:25.957396 14501 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.983865 13872 raft_consensus.cc:1275] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.984253 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:25.985023 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:25.987896 14513 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.989085 14146 raft_consensus.cc:359] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:25.989611 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:25.990000 14300 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:25.990559 14143 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:25.991641 14577 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:25.991905 14093 raft_consensus.cc:1275] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:25.997934 14022 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:25.998378 14590 consensus_queue.cc:237] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.000970 13948 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.002786 13947 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.004741 14478 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.005822 14063 leader_election.cc:343] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.006171 14144 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:26.016348 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:26.060966 13868 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.024804 14142 raft_consensus.cc:359] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.027355 14146 raft_consensus.cc:385] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.079685 14142 raft_consensus.cc:385] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.029400 14018 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.019618 14094 pending_rounds.cc:107] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:12:26.022895 14501 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.037508 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.038729 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:26.039266 14513 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.061753 14061 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:26.076026 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:26.018368 13989 leader_election.cc:343] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:26.089561 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 71930.7us
I20260709 12:12:26.081014 14063 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:26.081142 14514 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:12:26.083169 14096 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.083374 14094 raft_consensus.cc:2889] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.099135 14501 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:26.099481 14495 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.076977 14478 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.080231 14142 raft_consensus.cc:740] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.079893 14146 raft_consensus.cc:740] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.102756 14478 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:26.103515 14146 consensus_queue.cc:260] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.105870 14146 ts_tablet_manager.cc:1434] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.320s	user 0.008s	sys 0.002s
I20260709 12:12:26.106741 14513 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:26.107287 14146 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:26.078888 14088 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:26.109349 14142 consensus_queue.cc:260] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.118000 14143 tablet_bootstrap.cc:654] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.124114 14142 ts_tablet_manager.cc:1434] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.003s
I20260709 12:12:26.114477 14495 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.146014 14142 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
W20260709 12:12:26.135221 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 129416us
I20260709 12:12:26.159066 14300 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.140455 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.165966 13870 raft_consensus.cc:2410] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:26.138556 14495 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:26.175693 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 114149us
I20260709 12:12:26.177218 14061 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:26.179659 14495 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:26.160025 14300 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.181964 14300 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:26.182497 14480 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.182787 14146 tablet_bootstrap.cc:654] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.183136 14480 raft_consensus.cc:697] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:26.184095 14480 consensus_queue.cc:237] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.184926 14096 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:26.185545 14479 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.190724 14478 consensus_queue.cc:1048] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:26.188537 14144 tablet_bootstrap.cc:654] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.196929 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:26.211694 14341 consensus_queue.cc:1048] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:26.199987 14495 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.229734 14023 raft_consensus.cc:1275] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:26.236127 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.238804 13867 raft_consensus.cc:2393] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:26.239049 14474 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.239527 14474 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.241699 14474 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:26.237850 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:26.243749 14093 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:26.244943 13837 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:26.246897 14495 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.250744 14018 raft_consensus.cc:1275] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:26.240213 13986 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:26.255053 14550 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:26.258915 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.259802 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.260926 14142 tablet_bootstrap.cc:654] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.264928 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.287045 13942 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:26.267681 14554 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:26.269249 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.285215 13913 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:26.276683 14574 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:26.270810 14092 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:26.282531 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.295617 14554 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.355211 14421 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:26.355852 14479 consensus_queue.cc:1048] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:26.358191 14484 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.358467 14480 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.283515 14553 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.366582 14554 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:26.282743 14474 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:12:26.296515 14574 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.431384 13986 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:26.408933 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 123786us
I20260709 12:12:26.296881 13949 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:26.433215 14553 raft_consensus.cc:697] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:26.430786 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:26.436856 14574 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:26.443135 14478 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.435524 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.457144 13945 raft_consensus.cc:2410] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:26.447455 14300 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:26.379632 14495 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:26.443331 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 158223us
I20260709 12:12:26.378288 13868 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:26.449378 14470 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:26.480695 14470 raft_consensus.cc:697] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:26.475831 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:26.481985 14096 raft_consensus.cc:2393] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:26.463804 14063 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:26.458534 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:26.480298 13914 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:26.410542 14480 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.406548 14484 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.511838 14144 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:26.520181 14144 ts_tablet_manager.cc:1403] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.514s	user 0.013s	sys 0.015s
W20260709 12:12:26.513393 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 58373.9us
I20260709 12:12:26.481892 14470 consensus_queue.cc:237] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.514456 13871 raft_consensus.cc:2393] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:26.472587 14478 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.488984 14300 raft_consensus.cc:697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:26.459969 14626 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:12:26.530474 13840 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:26.537753 14142 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:26.538342 14142 ts_tablet_manager.cc:1403] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.393s	user 0.017s	sys 0.020s
I20260709 12:12:26.526110 14550 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.525239 14495 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:26.532909 14611 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.536789 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 56914.9us
I20260709 12:12:26.649479 14146 tablet_bootstrap.cc:492] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:26.650194 14146 ts_tablet_manager.cc:1403] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.543s	user 0.032s	sys 0.038s
I20260709 12:12:26.637996 14485 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:26.671196 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 207501us
W20260709 12:12:26.679214 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 147824us
I20260709 12:12:26.533517 14553 consensus_queue.cc:237] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:26.674114 14485 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.689445 14542 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.693944 14542 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:26.695328 14625 log.cc:927] Time spent T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:12:26.696420 14542 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:26.697784 14624 log.cc:927] Time spent T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:12:26.703898 14142 raft_consensus.cc:359] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.719530 14142 raft_consensus.cc:385] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.720054 14142 raft_consensus.cc:740] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.726708 14144 raft_consensus.cc:359] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.729756 14144 raft_consensus.cc:385] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.730280 14144 raft_consensus.cc:740] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.734403 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:26.721012 14142 consensus_queue.cc:260] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.646114 14611 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.718396 14485 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:26.738157 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 93341.7us
W20260709 12:12:26.689371 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 153459us
I20260709 12:12:26.763795 14611 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:26.758215 14146 raft_consensus.cc:359] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.765218 14146 raft_consensus.cc:385] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.765561 14146 raft_consensus.cc:740] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.766315 14146 consensus_queue.cc:260] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.679448 14300 consensus_queue.cc:237] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.768040 14146 ts_tablet_manager.cc:1434] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.117s	user 0.005s	sys 0.001s
I20260709 12:12:26.792341 14143 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:26.793274 14143 ts_tablet_manager.cc:1403] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.803s	user 0.009s	sys 0.010s
I20260709 12:12:26.802773 14146 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:26.785228 14484 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:26.814724 14146 tablet_bootstrap.cc:654] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:26.816236 14061 leader_election.cc:343] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:26.841014 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 94368.5us
I20260709 12:12:26.842806 13912 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:26.840458 14144 consensus_queue.cc:260] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:26.848212 14142 ts_tablet_manager.cc:1434] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.309s	user 0.008s	sys 0.000s
I20260709 12:12:26.849901 14554 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.851384 14142 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:26.853073 13942 raft_consensus.cc:3060] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.853155 14143 raft_consensus.cc:359] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:26.854074 14143 raft_consensus.cc:385] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.854391 14143 raft_consensus.cc:740] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.855261 14143 consensus_queue.cc:260] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:26.857532 14143 ts_tablet_manager.cc:1434] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 12:12:26.845429 14574 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.858979 14144 ts_tablet_manager.cc:1434] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.338s	user 0.008s	sys 0.000s
I20260709 12:12:26.861336 13948 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.861716 14484 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.863461 14514 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.878341 13840 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:26.881647 14513 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:26.882236 14513 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:26.882718 14513 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.892601 14063 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:26.894613 14634 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:26.896032 14542 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.896788 14542 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.899758 14542 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:26.901952 14610 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.902619 14610 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.908304 14610 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:26.909364 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:26.910537 14091 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:26.913786 14577 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:26.914631 14577 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.921484 14634 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.922179 14634 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.924796 14405 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.925050 14495 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:26.925640 14405 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:26.925935 14495 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:26.947129 14062 leader_election.cc:343] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.979445 14062 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:26.929123 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:26.985857 14091 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:26.937635 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.987282 13946 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:26.987582 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.988517 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:26.989339 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 58159.5us
I20260709 12:12:26.992460 13840 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:26.994539 14144 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
W20260709 12:12:26.995123 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 48030.1us
I20260709 12:12:26.846122 14485 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:26.989066 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:26.949913 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.003346 13986 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:26.943042 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.929080 14495 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:26.947710 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:26.928558 14405 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:26.937649 14480 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:26.871768 14484 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.025367 14640 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:27.025962 14640 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:27.026332 14640 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.026702 14484 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:27.026863 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.027716 14095 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:26.993423 14550 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.009833 14063 leader_election.cc:343] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.931800 14634 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:26.993801 14616 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.877130 14514 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:26.932020 14577 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:27.031317 14143 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:27.032107 14514 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.033151 14550 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.035462 14550 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.001597 13866 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:27.037736 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.030977 13868 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:26.999495 14611 raft_consensus.cc:2804] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.049263 14142 tablet_bootstrap.cc:654] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.002071 14583 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.061079 14146 tablet_bootstrap.cc:492] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:27.062057 14146 ts_tablet_manager.cc:1403] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.262s	user 0.031s	sys 0.087s
I20260709 12:12:27.059006 13940 raft_consensus.cc:2393] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:27.064496 14062 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:27.081187 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 63359.1us
I20260709 12:12:27.053792 14611 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.056540 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.056300 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.077950 13837 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:27.121441 14611 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.121882 14095 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
W20260709 12:12:27.121995 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 44167.5us
I20260709 12:12:27.122579 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.123144 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.124014 14021 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:27.129971 14636 raft_consensus.cc:2804] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.054105 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.081308 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.050001 14470 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.070180 14583 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.123320 14017 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:27.104296 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.056317 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.067472 14633 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.132709 13912 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:27.108060 14590 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.108498 14421 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.069703 14506 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:12:27.136552 14477 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.116585 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.130481 14636 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:27.191545 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 58936.1us
W20260709 12:12:27.183395 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 71984.4us
W20260709 12:12:27.201007 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 78232.1us
I20260709 12:12:27.149300 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:27.182061 14088 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:27.208294 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 74306.8us
I20260709 12:12:27.214493 13838 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:27.189234 14636 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.155090 14094 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:27.182335 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.139001 14470 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.154641 14633 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.204599 14640 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.225099 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:27.220528 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.225927 14095 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.226032 14089 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:27.226631 14640 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:27.226372 14146 raft_consensus.cc:359] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.227200 14146 raft_consensus.cc:385] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.227226 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:27.227605 14146 raft_consensus.cc:740] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.228015 14089 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.198927 14574 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.230751 13912 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:27.228399 14146 consensus_queue.cc:260] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.191592 14019 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:27.204173 14474 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.228325 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.180480 14421 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.257642 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.258481 14017 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:27.259397 14421 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.260447 14641 consensus_queue.cc:1048] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.126s
I20260709 12:12:27.257730 14637 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:12:27.177965 14590 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.191617 14477 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.228750 14617 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.231777 14542 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.249696 14485 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.385828 14617 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.386514 14617 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.389986 14470 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.262485 14473 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.392928 14473 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.393334 14473 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.263100 13869 raft_consensus.cc:2368] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:27.394644 14477 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:27.251121 14090 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:27.268798 14015 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:27.397080 13914 leader_election.cc:400] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:27.397619 13914 leader_election.cc:403] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:27.398397 14661 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:27.259514 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.399668 14632 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.401551 14550 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.402081 14550 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:27.406788 14659 log.cc:927] Time spent T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:12:27.407840 14655 log.cc:927] Time spent T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 12:12:27.408983 14146 ts_tablet_manager.cc:1434] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.347s	user 0.008s	sys 0.001s
I20260709 12:12:27.380087 14542 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.410044 14542 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.410218 14146 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:27.413053 14021 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:27.255086 14474 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.464489 14143 tablet_bootstrap.cc:654] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.469133 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.469966 14097 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:27.470888 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:27.471628 14097 raft_consensus.cc:2393] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:27.474918 14144 tablet_bootstrap.cc:654] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:27.444057 14513 consensus_meta.cc:287] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.000s
I20260709 12:12:27.259951 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:27.493419 13865 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:27.453287 14474 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.442044 14550 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.499615 13838 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:27.513877 13838 leader_election.cc:343] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.517578 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:27.398990 14661 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.466500 14095 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:27.521023 14142 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:27.496496 14513 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:27.530951 14660 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:27.531462 14660 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.531486 14513 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.531993 14660 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.519743 14665 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:27.532858 14665 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.536902 14485 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.537554 14485 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.538480 14665 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.540283 14485 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:27.540010 14142 ts_tablet_manager.cc:1403] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.689s	user 0.036s	sys 0.014s
W20260709 12:12:27.545042 13948 consensus_meta.cc:287] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.004s
I20260709 12:12:27.547552 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:27.549644 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.545455 14590 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.560983 14095 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:27.559058 13943 raft_consensus.cc:2393] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:27.571408 13838 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:27.571920 14473 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:27.572728 14610 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:27.602873 14610 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.603314 14610 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.607360 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.609754 13946 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:27.610898 14473 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:27.497608 14089 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:27.583115 14660 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.611848 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:27.612531 14095 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.613793 14660 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.584167 14611 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.616544 14611 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:27.588917 14146 tablet_bootstrap.cc:654] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.618417 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:27.619206 14478 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.559783 14664 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:27.528393 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:27.596123 14636 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:27.580159 14583 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:27.617441 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:27.615720 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:27.639277 13769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38470 (request call id 50) took 3288 ms. Trace:
I20260709 12:12:27.598142 14542 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.619632 13874 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.724782 14477 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.724987 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:27.641151 13769 rpcz_store.cc:276] 0709 12:12:24.313017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.314396 (+  1379us) service_pool.cc:224] Handling call
0709 12:12:27.601315 (+3286919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:25.414258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:25.414968 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:25.415013 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:12:25.415040 (+    27us) tablet.cc:662] Decoding operations
0709 12:12:25.415549 (+   509us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:25.415649 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:25.415697 (+    48us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:25.416095 (+   398us) tablet.cc:701] Row locks acquired
0709 12:12:25.416123 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:12:25.416311 (+   188us) write_op.cc:270] Start()
0709 12:12:25.416448 (+   137us) write_op.cc:276] Timestamp: P: 1783599145416257 usec, L: 0
0709 12:12:25.416477 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:12:25.507574 (+ 91097us) log.cc:844] Serialized 928 byte log entry
0709 12:12:25.812840 (+305266us) op_driver.cc:464] REPLICATION: finished
0709 12:12:26.028960 (+216120us) write_op.cc:301] APPLY: starting
0709 12:12:26.029067 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:26.029201 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:26.029327 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:26.029671 (+   344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:26.029857 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:12:26.029913 (+    56us) write_op.cc:312] APPLY: finished
0709 12:12:26.030128 (+   215us) log.cc:844] Serialized 28 byte log entry
0709 12:12:26.030306 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:26.030407 (+   101us) write_op.cc:454] Released schema lock
0709 12:12:26.030449 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:26.030867 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:26.030895 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2881,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":213414,"apply.run_cpu_time_us":1895,"apply.run_wall_time_us":1896,"num_ops":2,"prepare.queue_time_us":229523,"prepare.run_cpu_time_us":3991,"prepare.run_wall_time_us":108452,"replication_time_us":381332,"thread_start_us":283991,"threads_started":2}]]}
W20260709 12:12:27.726961 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:27.720640 14583 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.635746 14142 raft_consensus.cc:359] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:27.721901 14616 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.725524 14477 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.817791 14484 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:27.817924 14470 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.848616 14142 raft_consensus.cc:385] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.636497 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.884371 14142 raft_consensus.cc:740] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.740875 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.743441 14590 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.620182 14664 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:27.878535 13840 leader_election.cc:343] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.885553 14142 consensus_queue.cc:260] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:27.741672 13945 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.631151 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.851836 14616 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.817466 14509 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.771119 14632 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:27.853564 14480 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.865132 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:27.720158 14660 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:27.861653 14485 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:27.883570 14341 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.883715 14554 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.937686 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:27.939477 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:27.896353 14484 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:27.940922 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:27.941439 14480 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.942184 14015 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:27.942955 14477 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.894722 14641 consensus_queue.cc:1048] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 12:12:27.943194 14636 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:27.631266 14617 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:27.625455 14474 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.928493 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:27.865814 14583 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.028805 14645 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.029443 14645 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.030879 14583 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:28.031498 14019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 109) took 1030 ms. Trace:
I20260709 12:12:28.031833 14645 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:27.902527 14590 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.032064 14019 rpcz_store.cc:276] 0709 12:12:27.000673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.001752 (+  1079us) service_pool.cc:224] Handling call
0709 12:12:28.031250 (+1029498us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540099edd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.031412 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324352768}
I20260709 12:12:28.033088 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.033569 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.033986 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 108) took 1033 ms. Trace:
I20260709 12:12:28.034943 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:27.987659 14554 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.036247 14143 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:28.035616 14019 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:28.037781 14554 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.039968 14474 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.041260 13867 raft_consensus.cc:2368] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:28.041916 14553 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:28.042390 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.042490 14553 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.044104 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.044402 13988 leader_election.cc:400] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:28.044767 13988 leader_election.cc:403] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:12:28.045509 14665 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.046993 14617 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.047490 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.047586 13838 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:27.902045 14470 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:27.993510 14574 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:28.012437 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.035632 13946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 94) took 1095 ms. Trace:
I20260709 12:12:28.034459 14020 rpcz_store.cc:276] 0709 12:12:27.000292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.001833 (+  1541us) service_pool.cc:224] Handling call
0709 12:12:27.636965 (+635132us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:28.032890 (+395925us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:28.033918 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55646848}
I20260709 12:12:27.954612 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:28.010910 13913 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:28.051579 14143 ts_tablet_manager.cc:1403] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 1.058s	user 0.019s	sys 0.012s
W20260709 12:12:28.055090 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 155376us
I20260709 12:12:27.931094 14509 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.014272 14501 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.015488 14477 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:27.955622 14485 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.065584 14142 ts_tablet_manager.cc:1434] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.524s	user 0.015s	sys 0.008s
I20260709 12:12:27.960120 14341 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.059082 14096 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:27.957999 14660 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:28.070830 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 60070.5us
I20260709 12:12:28.055106 14636 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.034395 14590 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.053625 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:28.073104 14142 ts_tablet_manager.cc:1467] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Tablet startup took 531ms
I20260709 12:12:28.080657 13913 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:28.073266 13989 leader_election.cc:343] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.071929 14094 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.074303 14667 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.102311 14144 tablet_bootstrap.cc:492] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:28.076141 14477 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.105301 14144 ts_tablet_manager.cc:1403] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 1.127s	user 0.040s	sys 0.051s
I20260709 12:12:28.108946 14146 tablet_bootstrap.cc:492] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:28.100764 14554 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.087407 14636 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.109582 14146 ts_tablet_manager.cc:1403] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.700s	user 0.036s	sys 0.069s
I20260709 12:12:28.098333 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:28.097834 14553 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.122856 14143 raft_consensus.cc:359] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:28.126405 14610 consensus_meta.cc:287] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 12:12:28.126793 14146 raft_consensus.cc:359] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.127727 14485 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.127745 14638 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.128760 13949 raft_consensus.cc:3060] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.073213 14501 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.101750 14542 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.129712 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 143) took 1017 ms. Trace:
I20260709 12:12:28.129647 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.131021 14480 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.132809 14674 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.119066 14636 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.059564 13946 rpcz_store.cc:276] 0709 12:12:26.940179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.013222 (+ 73043us) service_pool.cc:224] Handling call
0709 12:12:27.228146 (+214924us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:28.035418 (+807272us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54008e62d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.035569 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810557696}
I20260709 12:12:28.133672 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.135375 14616 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.135576 14660 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:28.087532 14142 ts_tablet_manager.cc:1469] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Trace:
0709 12:12:16.386260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.391689 (+  5429us) service_pool.cc:224] Handling call
0709 12:12:16.396285 (+  4596us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.396392 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.455008 (+ 58616us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.577281 (+122273us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.585716 (+  8435us) inbound_call.cc:177] Queueing success response
0709 12:12:26.850897 (+10265181us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:27.541308 (+690411us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:27.542033 (+   725us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:27.543076 (+  1043us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":24390,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":17303,"tablet-open.queue_time_us":10263283,"thread_start_us":94949,"threads_started":1}
I20260709 12:12:28.198913 14143 raft_consensus.cc:385] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.155093 13947 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:28.210867 14143 raft_consensus.cc:740] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.137017 14144 raft_consensus.cc:359] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.200773 14146 raft_consensus.cc:385] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.211869 14146 raft_consensus.cc:740] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.213232 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.213967 14143 consensus_queue.cc:260] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.215624 14475 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.210569 14610 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.217048 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.218441 14144 raft_consensus.cc:385] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.141566 13874 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:28.224140 14144 raft_consensus.cc:740] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.219096 13840 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:28.138859 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:28.141911 14095 consensus_meta.cc:287] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:12:28.226742 14143 ts_tablet_manager.cc:1434] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.163s	user 0.007s	sys 0.004s
I20260709 12:12:28.136547 14665 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:28.142993 13948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 89) took 1282 ms. Trace:
I20260709 12:12:28.126479 14470 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.149381 14484 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.226398 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.214669 14674 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.263187 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.263474 14574 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:28.264060 14574 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.141858 14509 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.230485 14146 consensus_queue.cc:260] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.266530 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.217746 14015 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:28.214361 13945 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:28.268857 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.269459 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.270340 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.270879 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.271649 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.272130 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.217692 14341 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:28.268378 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.273351 13869 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:28.274408 14146 ts_tablet_manager.cc:1434] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.006s
I20260709 12:12:28.274895 13869 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.275537 14090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 137) took 1222 ms. Trace:
I20260709 12:12:28.264410 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.232705 13865 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:28.233512 14144 consensus_queue.cc:260] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.278937 14144 ts_tablet_manager.cc:1434] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.170s	user 0.025s	sys 0.002s
I20260709 12:12:28.237776 14477 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.279313 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.280342 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:28.281054 14093 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.281242 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.282215 14015 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.284363 14554 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.239502 14097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 113) took 1017 ms. Trace:
I20260709 12:12:28.285274 14097 rpcz_store.cc:276] 0709 12:12:27.221927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.472228 (+250301us) service_pool.cc:224] Handling call
0709 12:12:27.472563 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.238898 (+766335us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5400864820. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce380badc0 00007fce381451c0 00007fce38146231 00007fce38142d8f 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c
0709 12:12:28.239089 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.239119 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.239166 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.239215 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.239282 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.239436 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9769216}
I20260709 12:12:28.286440 14674 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:28.214807 14638 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.287609 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.243391 14501 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.241484 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.289736 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.113662 14667 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.242095 14019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 138) took 1196 ms. Trace:
I20260709 12:12:28.230170 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:28.301828 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 100) took 1219 ms. Trace:
I20260709 12:12:28.302359 13872 rpcz_store.cc:276] 0709 12:12:27.082812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.103922 (+ 21110us) service_pool.cc:224] Handling call
0709 12:12:28.289141 (+1185219us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:28.301243 (+ 12102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.301460 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.301489 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.301538 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.301568 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.301633 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.301752 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6189312}
I20260709 12:12:28.303090 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.243409 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.304946 14023 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.290495 14018 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.306247 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.307730 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.306305 14640 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:12:28.311282 13940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 93) took 1375 ms (client timeout 1600 ms). Trace:
W20260709 12:12:28.311779 13940 rpcz_store.cc:269] 0709 12:12:26.935856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.947362 (+ 11506us) service_pool.cc:224] Handling call
0709 12:12:28.311041 (+1363679us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5400734e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.311176 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48743808}
I20260709 12:12:28.244061 14094 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:28.244228 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.246812 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:28.249146 13868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 105) took 1297 ms. Trace:
I20260709 12:12:28.253386 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.329600 14667 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.254735 14610 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.255596 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.258322 13837 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.296586 14016 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
W20260709 12:12:28.331202 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 72963.7us
W20260709 12:12:28.331508 14016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 107) took 1333 ms (client timeout 1678 ms). Trace:
I20260709 12:12:28.332074 13837 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.332310 14015 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
W20260709 12:12:28.332015 14016 rpcz_store.cc:269] 0709 12:12:26.999926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.006438 (+  6512us) service_pool.cc:224] Handling call
0709 12:12:28.047325 (+1040887us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:28.331311 (+283986us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54008f5cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.331425 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597724800}
I20260709 12:12:28.333518 14513 raft_consensus.cc:2804] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.333896 14513 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.334236 14513 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.334409 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:28.335935 14514 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:28.336328 14514 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.336678 14514 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.336831 14480 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.337316 14616 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.338106 14616 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.339118 14021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 111) took 1221 ms. Trace:
I20260709 12:12:28.339560 14021 rpcz_store.cc:276] 0709 12:12:27.117753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.338197 (+1220444us) service_pool.cc:224] Handling call
0709 12:12:28.338565 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.338767 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.338796 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.338839 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.338877 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.338943 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.339058 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:28.304474 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:28.341178 14610 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.258777 13768 catalog_manager.cc:5697] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 2, leader changed from f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132) to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.323585 14061 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:28.343532 14061 leader_election.cc:343] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.337432 14480 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.343664 13768 catalog_manager.cc:5697] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 2, leader changed from <none> to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.344908 14634 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:28.345482 14634 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.345927 14634 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.346226 14480 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.298816 14680 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:28.260385 14661 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.275952 14090 rpcz_store.cc:276] 0709 12:12:27.053105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.053307 (+   202us) service_pool.cc:224] Handling call
0709 12:12:28.275277 (+1221970us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54000b7cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.275444 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217743104}
I20260709 12:12:28.292615 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:28.294142 13838 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:28.317708 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:28.353111 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 59103.6us
I20260709 12:12:28.313529 13914 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:28.353936 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52807us
I20260709 12:12:28.354498 14638 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.354655 14667 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:28.326179 14017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 101) took 1208 ms. Trace:
I20260709 12:12:28.199100 14020 rpcz_store.cc:276] 0709 12:12:27.112116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.086414 (+974298us) service_pool.cc:224] Handling call
0709 12:12:28.113180 (+ 26766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.129283 (+ 16103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.129328 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.129375 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.129422 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.129494 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.129653 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:28.261547 13949 raft_consensus.cc:2468] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:28.327834 14645 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.299180 14019 rpcz_store.cc:276] 0709 12:12:27.046125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.044952 (+998827us) service_pool.cc:224] Handling call
0709 12:12:28.045257 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.088971 (+ 43714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.093959 (+  4988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.103820 (+  9861us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.110029 (+  6209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.241849 (+131820us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b540047e5d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:28.241898 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.242036 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59538176}
I20260709 12:12:28.344113 14061 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.347239 14680 raft_consensus.cc:697] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:28.295786 13840 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:28.375157 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 79406.6us
I20260709 12:12:28.346345 13768 catalog_manager.cc:5697] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 2, leader changed from 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129) to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.353294 14501 raft_consensus.cc:2804] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:12:28.353111 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 60568.8us
I20260709 12:12:28.354940 14635 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:28.314770 14143 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:28.321748 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.324657 13868 rpcz_store.cc:276] 0709 12:12:26.951680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.973754 (+ 22074us) service_pool.cc:224] Handling call
0709 12:12:28.248881 (+1275127us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b540012be54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.249042 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78505216}
I20260709 12:12:28.230882 14095 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:28.353960 13838 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.370950 14023 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:28.297241 14554 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.377456 14142 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:28.355763 14667 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:28.381389 13840 leader_election.cc:343] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.397964 14023 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:28.386955 13838 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.370048 14639 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.313301 13945 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:28.380590 14674 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:28.381443 14616 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.385764 14617 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:28.448575 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 61705.4us
W20260709 12:12:28.447369 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 48503us
W20260709 12:12:28.454825 13840 leader_election.cc:343] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.455304 13838 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:28.455762 14093 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:28.386206 14501 raft_consensus.cc:697] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:28.385540 14665 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:12:28.387476 14635 raft_consensus.cc:697] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:28.389449 14421 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.404291 14667 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:28.507220 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 155644us
I20260709 12:12:28.398523 14479 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.381345 14645 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.523686 13837 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:28.528340 13837 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:28.550348 13837 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:28.481693 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.398528 14554 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.463583 14542 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.483628 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.489298 13868 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:28.368533 14017 rpcz_store.cc:276] 0709 12:12:27.118051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.325223 (+1207172us) service_pool.cc:224] Handling call
0709 12:12:28.325617 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.325822 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.325859 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.325904 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:28.325949 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.326006 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.326122 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:28.453063 14643 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.553694 14509 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:28.573964 14509 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.574997 14635 consensus_queue.cc:237] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.576742 14509 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.566220 14421 raft_consensus.cc:2804] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.502357 14480 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.577507 14421 raft_consensus.cc:697] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:28.511241 14611 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.509768 14680 consensus_queue.cc:237] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.570122 14554 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.570544 14645 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.571061 14636 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.555605 14577 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.553514 14479 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.483060 14633 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.609005 14577 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.611203 14577 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.611799 14634 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.232234 13948 rpcz_store.cc:276] 0709 12:12:26.860573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.860752 (+   179us) service_pool.cc:224] Handling call
0709 12:12:26.861121 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.545785 (+684664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.545824 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.546398 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:12:27.915563 (+369165us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.076615 (+161052us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.092846 (+ 16231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.103290 (+ 10444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.142522 (+ 39232us) raft_consensus.cc:1685] finished
0709 12:12:28.142545 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.142876 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104318,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":652,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":14716,"thread_start_us":474186,"threads_started":2,"wal-append.queue_time_us":503410}
I20260709 12:12:28.555850 14675 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.621232 14554 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.454109 14639 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.622133 14554 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.623677 14639 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.626336 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.627599 14088 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:28.630725 14501 consensus_queue.cc:237] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.632872 13871 raft_consensus.cc:2393] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:28.638111 14554 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.640122 14470 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:28.640931 14470 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.577641 14480 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.572485 14590 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:28.563308 14063 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:41801 timed out after 1.600s (SENT) [suppressed 539 similar messages]
I20260709 12:12:28.563185 14484 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.599550 14421 consensus_queue.cc:237] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:28.577723 14617 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:28.604048 14142 tablet_bootstrap.cc:654] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.605849 14514 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.597254 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 144) took 1465 ms. Trace:
I20260709 12:12:28.612702 14479 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.573156 14018 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:28.613894 14143 tablet_bootstrap.cc:654] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.660266 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:28.588523 14667 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.638485 14636 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.664429 14484 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:28.667189 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.664014 13838 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:28.591914 14611 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:28.671516 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 121276us
I20260709 12:12:28.663417 14645 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:28.669625 14018 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.660120 14554 consensus_queue.cc:1059] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:12:28.656879 14590 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.659145 14617 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.661595 14574 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.683578 13838 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:28.678591 14636 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.685808 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.718261 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:28.713670 14019 raft_consensus.cc:1240] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:28.686304 14645 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.720886 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:28.742074 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 178794us
I20260709 12:12:28.756321 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.734833 13869 raft_consensus.cc:1240] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:28.732270 14096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 136) took 1711 ms. Trace:
I20260709 12:12:28.735155 14470 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:28.737563 14688 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:28.725652 14513 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.740999 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.761059 13865 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:28.755036 14475 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:28.757874 14022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 133) took 1697 ms. Trace:
I20260709 12:12:28.798544 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:28.801822 14063 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:28.805275 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 121927us
I20260709 12:12:28.781819 14638 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:28.792074 14662 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:28.819425 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.806142 14639 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:28.831991 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.799101 14022 rpcz_store.cc:276] 0709 12:12:27.044375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.050210 (+  5835us) service_pool.cc:224] Handling call
0709 12:12:28.681989 (+1631779us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:28.690677 (+  8688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.717082 (+ 26405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.721383 (+  4301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.722754 (+  1371us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.726651 (+  3897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.734569 (+  7918us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.741974 (+  7405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11947776}
I20260709 12:12:28.834802 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 110) took 1191 ms. Trace:
I20260709 12:12:28.661080 14015 rpcz_store.cc:276] 0709 12:12:27.132319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.333293 (+1200974us) service_pool.cc:224] Handling call
0709 12:12:28.333662 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.333896 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:12:28.398042 (+ 64146us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.525833 (+127791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.553070 (+ 27237us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:28.560794 (+  7724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.578712 (+ 17918us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.592416 (+ 13704us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5417,"prepare.queue_time_us":193315,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":15744,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":102849,"threads_started":2,"wal-append.queue_time_us":153804}
I20260709 12:12:28.835311 13947 rpcz_store.cc:276] 0709 12:12:27.643699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.276894 (+633195us) service_pool.cc:224] Handling call
0709 12:12:28.277660 (+   766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.285439 (+  7779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.834503 (+549064us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b54008e1f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:28.834728 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16921472}
I20260709 12:12:28.835785 14662 raft_consensus.cc:697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:28.836441 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.834868 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.836807 14662 consensus_queue.cc:237] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:28.837836 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:28.761878 14096 rpcz_store.cc:276] 0709 12:12:27.022003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.039907 (+ 17904us) service_pool.cc:224] Handling call
0709 12:12:28.729330 (+1689423us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54000b77d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:28.729645 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134313856}
I20260709 12:12:28.839210 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.839600 14667 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.839819 14096 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:28.808532 14633 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:28.841204 14513 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.841413 14590 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.790650 14688 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:28.842247 14691 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:12:28.843822 14634 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.843981 14688 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.812690 14638 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:28.844964 14617 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.797120 14475 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:28.846326 14638 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:28.846999 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.847494 14475 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.847826 13872 raft_consensus.cc:2393] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:28.841952 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.850185 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.851289 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:28.851866 14090 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.810949 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:28.863334 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 48764.6us
I20260709 12:12:28.864987 13912 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:28.866633 13912 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:28.853181 14097 raft_consensus.cc:2368] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:28.820751 14636 raft_consensus.cc:697] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:28.835670 14574 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:28.847807 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:28.865347 14611 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:28.876855 14142 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:28.878487 14142 ts_tablet_manager.cc:1403] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.510s	user 0.016s	sys 0.009s
I20260709 12:12:28.867621 14300 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.879860 14645 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:28.886245 13865 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:28.879725 14091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 138) took 1826 ms. Trace:
I20260709 12:12:28.871803 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:28.873629 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:28.870877 14638 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:28.888558 14018 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
W20260709 12:12:29.155913 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 247399us
I20260709 12:12:29.171346 14143 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:28.876156 14014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 97) took 1877 ms. Trace:
I20260709 12:12:29.171094 13989 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.172137 14143 ts_tablet_manager.cc:1403] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.875s	user 0.013s	sys 0.018s
I20260709 12:12:29.153435 14616 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:29.084671 14091 rpcz_store.cc:276] 0709 12:12:27.053449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.069178 (+ 15729us) service_pool.cc:224] Handling call
0709 12:12:28.878809 (+1809631us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:28.879091 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.879318 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.879349 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.879401 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.879432 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.879507 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.879634 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6483840}
I20260709 12:12:29.177105 14636 consensus_queue.cc:237] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.180333 13989 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.193708 13989 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.086766 14639 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.086010 14590 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:29.156874 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:29.203487 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.203855 14639 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.204234 14018 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:29.205250 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.205382 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.206135 14639 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:29.168139 14638 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:29.207479 14638 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.179463 14014 rpcz_store.cc:276] 0709 12:12:26.998700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.000449 (+  1749us) service_pool.cc:224] Handling call
0709 12:12:28.636886 (+1636437us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:28.637143 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.637631 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.637674 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.638255 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.739124 (+100869us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:28.742785 (+  3661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.755184 (+ 12399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.862506 (+107322us) raft_consensus.cc:1685] finished
0709 12:12:28.862545 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.874082 (+ 11537us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2247,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":161,"spinlock_wait_cycles":54986496,"thread_start_us":100378,"threads_started":1,"wal-append.queue_time_us":147871}
I20260709 12:12:29.210609 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.195353 14616 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.214393 14616 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:29.220093 14638 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.189069 14645 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.229249 14143 raft_consensus.cc:359] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.230705 14143 raft_consensus.cc:385] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.231148 14143 raft_consensus.cc:740] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.196720 14667 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.225315 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.200187 14341 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.227448 14015 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.242290 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:29.243501 13944 raft_consensus.cc:2368] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.246014 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.238799 14143 consensus_queue.cc:260] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.233340 14017 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:29.257023 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.224412 14590 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:29.260742 14590 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:29.256024 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 54797.8us
I20260709 12:12:29.262609 14638 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:29.266093 14144 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:29.270354 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.262285 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 103) took 1385 ms. Trace:
I20260709 12:12:29.275399 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.278764 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.239040 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.247035 14092 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:29.285036 14143 ts_tablet_manager.cc:1434] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.000s
I20260709 12:12:29.247552 13945 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:29.287525 13912 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.279618 14020 rpcz_store.cc:276] 0709 12:12:27.877334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.379290 (+501956us) service_pool.cc:224] Handling call
0709 12:12:29.261474 (+882184us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:29.261660 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.261916 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.261959 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.262030 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:29.262059 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.262123 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.262232 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109708544}
I20260709 12:12:29.288612 14090 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:29.272131 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.287338 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.293859 14063 leader_election.cc:400] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.294848 14063 leader_election.cc:403] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.280278 14021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 147) took 1759 ms. Trace:
I20260709 12:12:29.294301 13949 raft_consensus.cc:2368] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.295421 14479 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:29.296806 14063 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.297789 14143 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:29.299152 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:29.299480 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.302588 14063 leader_election.cc:400] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.288877 14554 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:29.289599 14701 log.cc:927] Time spent T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:12:29.304692 14634 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:29.305141 14634 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:29.305581 14634 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.305395 14479 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.307312 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.308523 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.313463 14096 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:29.313858 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.314055 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.315019 14095 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:29.315678 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.316987 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.317090 14634 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.319020 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.319216 14015 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:29.321671 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:29.322336 13949 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.323508 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.305256 14617 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.310478 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.329820 13986 leader_election.cc:400] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
W20260709 12:12:29.312294 14684 log.cc:927] Time spent T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.823s	user 0.000s	sys 0.014s
I20260709 12:12:29.312129 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.331068 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.337653 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.338076 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.321517 14640 consensus_queue.cc:1048] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:29.312546 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.310178 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:29.309453 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.341328 13988 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.330050 14616 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.345086 14061 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.351547 14061 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:29.352936 14633 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:29.346329 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:29.353639 14633 raft_consensus.cc:697] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:29.354007 14018 raft_consensus.cc:2368] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:29.354702 14633 consensus_queue.cc:237] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.354916 14616 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.331579 14617 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.358107 14616 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:29.358777 14617 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:29.359231 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 494815us
I20260709 12:12:29.359934 14617 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.362742 13837 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.365902 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.366783 14014 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:29.367166 14142 raft_consensus.cc:359] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.367941 14142 raft_consensus.cc:385] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.368214 14142 raft_consensus.cc:740] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.368904 14142 consensus_queue.cc:260] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.295334 14021 rpcz_store.cc:276] 0709 12:12:27.521150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.279234 (+1758084us) service_pool.cc:224] Handling call
0709 12:12:29.279645 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.279876 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.279912 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.279966 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:29.280016 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.280083 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.280210 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:29.371155 14590 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.376386 13986 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.377787 13986 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:29.378971 14144 tablet_bootstrap.cc:654] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.379050 13838 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:29.374291 14421 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:29.382032 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.383486 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.383706 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.385124 14616 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:29.385746 14616 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.386188 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.387212 14509 raft_consensus.cc:3055] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:29.387687 14509 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:29.388005 14616 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:29.348335 14667 consensus_queue.cc:1048] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:12:29.390035 14016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 146) took 1869 ms. Trace:
I20260709 12:12:29.390537 14421 raft_consensus.cc:697] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:29.368494 13871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 107) took 1508 ms (client timeout 1844 ms). Trace:
W20260709 12:12:29.393342 14063 leader_election.cc:343] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.377434 14617 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.377681 14634 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:29.377938 13949 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:29.412552 14142 ts_tablet_manager.cc:1434] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.534s	user 0.006s	sys 0.001s
W20260709 12:12:29.412983 14142 ts_tablet_manager.cc:1467] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Tablet startup took 534ms
I20260709 12:12:29.399462 14639 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.388032 13945 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:29.381316 14477 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.406914 14062 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.388906 13873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 113) took 1345 ms. Trace:
I20260709 12:12:29.399777 14604 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.431257 14143 tablet_bootstrap.cc:654] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.415189 14645 raft_consensus.cc:2764] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:12:29.396780 14509 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:29.411672 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.419143 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:29.399622 14016 rpcz_store.cc:276] 0709 12:12:27.520888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.375270 (+854382us) service_pool.cc:224] Handling call
0709 12:12:29.389182 (+1013912us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:29.389436 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.389646 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.389677 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.389736 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:29.389772 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.389847 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.389967 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97448832}
I20260709 12:12:29.419684 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.410457 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.435529 14097 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.439355 14063 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.440234 14633 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.420499 14639 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.422055 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.422232 14634 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.423055 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.422986 14716 consensus_queue.cc:1059] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:29.441967 14019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 112) took 1137 ms. Trace:
I20260709 12:12:29.442833 14716 raft_consensus.cc:3055] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.442986 14639 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:29.443300 14716 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:29.421622 14421 consensus_queue.cc:237] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:29.413311 14142 ts_tablet_manager.cc:1469] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Trace:
0709 12:12:16.403537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.410933 (+  7396us) service_pool.cc:224] Handling call
0709 12:12:16.425508 (+ 14575us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.425613 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.457374 (+ 31761us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.586183 (+128809us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.586620 (+   437us) inbound_call.cc:177] Queueing success response
0709 12:12:28.312931 (+11726311us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:28.878847 (+565916us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:28.891874 (+ 13027us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:28.919551 (+ 27677us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":215473,"raft.queue_time_us":32864,"spinlock_wait_cycles":9200384,"tablet-open.queue_time_us":11711788}
I20260709 12:12:29.446197 14142 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:29.446409 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:29.446974 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.447782 14097 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:29.411067 14617 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.450361 13943 raft_consensus.cc:1240] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:29.403554 13871 rpcz_store.cc:269] 0709 12:12:27.860011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.861734 (+  1723us) service_pool.cc:224] Handling call
0709 12:12:28.255409 (+393675us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:29.368261 (+1112852us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540050ad54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:29.368424 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725977088}
I20260709 12:12:29.430545 14514 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:29.451128 13943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 106) took 1827 ms. Trace:
I20260709 12:12:29.398262 13838 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:29.432962 14062 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.451613 13943 rpcz_store.cc:276] 0709 12:12:27.623994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.624242 (+   248us) service_pool.cc:224] Handling call
0709 12:12:28.899421 (+1275179us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:29.449973 (+550552us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ef8c 00007fce3501eef6 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:29.450155 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.450846 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.451064 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186192000}
I20260709 12:12:29.431471 13873 rpcz_store.cc:276] 0709 12:12:28.043178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.279363 (+236185us) service_pool.cc:224] Handling call
0709 12:12:28.629466 (+350103us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:28.629885 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.630173 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:12:28.795270 (+165097us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.358879 (+563609us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b1800068080. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287 00007fce3815e208
0709 12:12:29.375379 (+ 16500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.375456 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:29.376806 (+  1350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.381443 (+  4637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.388842 (+  7399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10461,"prepare.queue_time_us":231926,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":495596,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":58126976,"thread_start_us":181968,"threads_started":2,"wal-append.queue_time_us":69455}
I20260709 12:12:29.436978 13874 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:29.433987 14604 raft_consensus.cc:697] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:29.489006 14645 consensus_queue.cc:1059] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:29.489310 14604 consensus_queue.cc:237] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:29.490413 14645 raft_consensus.cc:3055] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.490852 14645 raft_consensus.cc:740] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:29.437589 14509 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:29.491801 14645 consensus_queue.cc:260] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.444380 14716 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.493503 14716 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.494093 14645 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.494985 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.451406 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:29.452240 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 54048.5us
I20260709 12:12:29.497598 14023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 108) took 1374 ms. Trace:
I20260709 12:12:29.425246 14093 raft_consensus.cc:1275] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.453349 13867 raft_consensus.cc:2468] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:29.498062 14023 rpcz_store.cc:276] 0709 12:12:28.123113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.399593 (+276480us) service_pool.cc:224] Handling call
0709 12:12:29.496740 (+1097147us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:29.497020 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.497236 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.497267 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.497316 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:29.497351 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.497410 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.497534 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12596480}
I20260709 12:12:29.452834 14514 raft_consensus.cc:2804] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.454177 14616 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.499542 14514 raft_consensus.cc:697] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:29.455798 14617 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:29.457361 13913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.500535 14514 consensus_queue.cc:237] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:29.501572 13913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.457830 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.461726 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:29.504616 13988 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.505162 14477 consensus_queue.cc:1059] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:29.422040 14664 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:29.506266 14714 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.506510 14664 raft_consensus.cc:3055] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:29.506906 14664 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:29.507961 13869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 68) took 1027 ms. Trace:
I20260709 12:12:29.507776 14664 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.469936 14143 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:29.510524 14146 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:29.517571 14664 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:29.517867 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.518733 13941 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:29.519845 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:29.509517 13914 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.520959 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:29.521584 13945 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.522045 14554 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.522262 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.509773 14638 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:29.523806 14638 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.524595 13867 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:29.525996 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.526336 14638 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:29.527154 13946 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:29.530309 14146 tablet_bootstrap.cc:654] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.490185 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.538410 14143 ts_tablet_manager.cc:1403] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.002s
I20260709 12:12:29.440762 14633 raft_consensus.cc:697] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:29.540297 13870 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.463855 14144 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:29.541195 14144 ts_tablet_manager.cc:1403] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.275s	user 0.015s	sys 0.017s
I20260709 12:12:29.541703 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.531709 13941 raft_consensus.cc:1275] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.500608 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.509722 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.534427 13945 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:29.537405 14097 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.537544 14063 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.539934 14633 consensus_queue.cc:237] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.453553 14062 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:29.557760 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 104270us
W20260709 12:12:29.511922 13947 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.030s	sys 0.064s
I20260709 12:12:29.442510 14019 rpcz_store.cc:276] 0709 12:12:28.304243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.560528 (+256285us) service_pool.cc:224] Handling call
0709 12:12:28.566231 (+  5703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.735412 (+169181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.441623 (+706211us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400871754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:29.441882 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263449472}
W20260709 12:12:29.471405 14704 log.cc:927] Time spent T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 12:12:29.413691 13986 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:29.560310 13947 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.030s	sys 0.064s
I20260709 12:12:29.580835 14142 tablet_bootstrap.cc:700] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent opening tablet: real 0.121s	user 0.004s	sys 0.000s
W20260709 12:12:29.580713 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 167124us
I20260709 12:12:29.581943 13986 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.582629 13914 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.578374 13913 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.584606 13986 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.587066 14142 tablet_bootstrap.cc:654] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.590870 13986 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.590750 14144 raft_consensus.cc:359] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.593286 13986 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.588738 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:29.594589 14667 raft_consensus.cc:2764] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:12:29.588946 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.508446 13869 rpcz_store.cc:276] 0709 12:12:28.480357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.489963 (+  9606us) service_pool.cc:224] Handling call
0709 12:12:28.563748 (+ 73785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.782215 (+218467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.507637 (+725422us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003cc8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:29.507883 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345834240}
I20260709 12:12:29.579404 14088 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:29.596658 14667 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.597682 14480 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:29.598500 13986 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:29.592284 14674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.009s	sys 0.020s
W20260709 12:12:29.599972 14674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.009s	sys 0.020s
I20260709 12:12:29.600221 14674 raft_consensus.cc:697] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:29.601106 14089 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:29.601212 14674 consensus_queue.cc:237] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.576159 14617 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.605343 13912 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.604116 13986 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.593472 14144 raft_consensus.cc:385] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.582521 14639 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:29.610102 14143 raft_consensus.cc:359] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.613260 14143 raft_consensus.cc:385] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.613795 14143 raft_consensus.cc:740] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.611331 14144 raft_consensus.cc:740] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.611996 13986 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.584059 14640 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:29.590884 14716 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:29.589192 14509 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.635139 13914 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.584152 13948 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:29.588241 14300 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.641772 14014 raft_consensus.cc:1275] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.615765 13940 raft_consensus.cc:1275] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:29.596508 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:29.646299 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 86724.4us
I20260709 12:12:29.619977 14144 consensus_queue.cc:260] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.615437 14577 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.637615 14638 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.630820 14715 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.649786 14144 ts_tablet_manager.cc:1434] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 12:12:29.609213 14667 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.615193 14143 consensus_queue.cc:260] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.654942 14063 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:29.617055 14475 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:12:29.615393 14550 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:29.625124 14061 leader_election.cc:400] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
W20260709 12:12:29.662122 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 43526.1us
I20260709 12:12:29.593011 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.664378 14061 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:29.628216 13945 raft_consensus.cc:1275] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:29.604063 14477 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:29.673450 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:29.672240 13945 pending_rounds.cc:85] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Aborting all ops after (but not including) 1
I20260709 12:12:29.676723 13945 pending_rounds.cc:107] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:29.677096 13945 raft_consensus.cc:2889] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:29.658252 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.668731 14061 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.612890 14639 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:29.648362 14021 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:29.679081 14143 ts_tablet_manager.cc:1434] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.140s	user 0.010s	sys 0.000s
I20260709 12:12:29.680563 14062 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:29.689728 14062 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:29.676239 14617 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:29.675849 14634 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:29.681953 14724 log.cc:927] Time spent T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.113s	user 0.003s	sys 0.004s
I20260709 12:12:29.681833 14479 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:29.678496 14550 raft_consensus.cc:697] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:29.685935 14639 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.694804 14637 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.698704 14633 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.711400 14143 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:29.695497 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.700785 14617 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.697809 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.700933 14480 raft_consensus.cc:2804] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:29.712164 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 48158.7us
W20260709 12:12:29.715706 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 130035us
I20260709 12:12:29.701061 14634 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.687945 14706 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:12:29.722079 13913 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.731084 14146 tablet_bootstrap.cc:492] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:29.731952 14146 ts_tablet_manager.cc:1403] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.021s
W20260709 12:12:29.799175 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 77194.2us
I20260709 12:12:29.717227 14633 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.718242 14617 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.711874 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.720003 14480 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.720893 14634 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:29.850472 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 160816us
I20260709 12:12:29.851426 14062 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:29.800123 14667 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.863781 14144 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:29.841318 14509 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:29.842749 14633 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.849716 14480 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.842146 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:29.882789 14700 consensus_queue.cc:1048] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.185s
I20260709 12:12:29.888737 14637 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:29.850814 14715 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:29.895475 14715 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:29.860229 14550 consensus_queue.cc:237] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.868348 14509 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:29.898104 14509 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.868558 14667 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.862155 14554 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:29.904706 14554 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:29.924474 14421 consensus_queue.cc:1048] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:29.921144 13837 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:29.928583 13837 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:29.929375 14421 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:29.931317 14715 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:29.932252 14661 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.932790 14661 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.933113 14661 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.930006 14604 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:29.945545 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:29.950631 14667 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:29.952543 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.920766 14015 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:29.974016 14016 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:29.977316 14146 raft_consensus.cc:359] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.978194 14146 raft_consensus.cc:385] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.978482 14146 raft_consensus.cc:740] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.979316 14637 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.979863 14637 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.982457 14637 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:29.983626 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.985673 14639 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:29.986443 14063 leader_election.cc:343] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.986967 14645 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.987675 14645 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:29.987797 14667 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:29.983606 14554 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:29.988812 14667 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:29.989960 14645 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:29.991750 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:29.995016 14091 raft_consensus.cc:1240] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:29.999109 14633 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:29.954908 14480 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:30.005760 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:30.008407 14143 tablet_bootstrap.cc:654] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.996186 14639 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:30.019039 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 53450.8us
W20260709 12:12:30.037220 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 185899us
I20260709 12:12:30.038630 13913 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.016146 14146 consensus_queue.cc:260] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:30.154457 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 485814us
W20260709 12:12:30.118369 13866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 104) took 2209 ms (client timeout 1924 ms). Trace:
I20260709 12:12:30.161222 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:30.160145 14645 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:30.177770 14480 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:30.288605 14016 raft_consensus.cc:1275] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:30.255975 14633 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:30.232108 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:30.231415 14475 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:30.252516 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:30.240469 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.224545 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:30.291533 14667 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:30.303509 14475 raft_consensus.cc:697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:30.229218 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:30.233517 14732 consensus_queue.cc:1059] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 12:12:30.305536 14475 consensus_queue.cc:237] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.234265 14699 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:30.307677 14699 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:30.311372 14699 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:30.319249 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:30.321447 14480 raft_consensus.cc:3055] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.322068 14480 raft_consensus.cc:740] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:30.323304 14480 consensus_queue.cc:260] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:30.296658 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.348013 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:30.348738 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52277.4us
I20260709 12:12:30.349009 13944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48292 (request call id 120) took 1030 ms. Trace:
I20260709 12:12:30.349398 13944 rpcz_store.cc:276] 0709 12:12:29.318927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.329366 (+ 10439us) service_pool.cc:224] Handling call
0709 12:12:30.347803 (+1018437us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:30.348927 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4408576}
I20260709 12:12:30.350157 13988 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.350996 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 125) took 1024 ms. Trace:
I20260709 12:12:30.351405 14015 rpcz_store.cc:276] 0709 12:12:29.326313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.329858 (+  3545us) service_pool.cc:224] Handling call
0709 12:12:29.812218 (+482360us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:30.350810 (+538592us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400002154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:30.350917 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79562368}
W20260709 12:12:30.353734 14617 consensus_meta.cc:287] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
I20260709 12:12:30.354168 14617 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.355278 13942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 103) took 1482 ms. Trace:
I20260709 12:12:30.355679 13942 rpcz_store.cc:276] 0709 12:12:28.873360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.880662 (+  7302us) service_pool.cc:224] Handling call
0709 12:12:29.648176 (+767514us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:30.354384 (+706208us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:30.354601 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.354822 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.354856 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.354992 (+   136us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:30.355039 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.355102 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.355216 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32573440}
I20260709 12:12:30.299428 14645 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.355319 14089 raft_consensus.cc:1240] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:30.358839 14645 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:30.241659 14734 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.359856 14734 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.360903 13947 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:30.258665 14142 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:30.372293 14142 ts_tablet_manager.cc:1403] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.926s	user 0.022s	sys 0.041s
I20260709 12:12:30.384001 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:30.294240 14144 tablet_bootstrap.cc:654] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.402275 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.404968 14715 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.254693 14093 raft_consensus.cc:1275] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:30.422926 13768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38478 (request call id 50) took 4853 ms. Trace:
I20260709 12:12:30.445996 14477 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.446653 14477 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.433555 13768 rpcz_store.cc:276] 0709 12:12:25.547293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.547503 (+   210us) service_pool.cc:224] Handling call
0709 12:12:30.400542 (+4853039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:28.638994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:28.639832 (+   838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:28.639869 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:12:28.639888 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:28.640772 (+   884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:28.640842 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:28.640869 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:28.641213 (+   344us) tablet.cc:701] Row locks acquired
0709 12:12:28.641231 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:28.641390 (+   159us) write_op.cc:270] Start()
0709 12:12:28.641514 (+   124us) write_op.cc:276] Timestamp: P: 1783599148641328 usec, L: 0
0709 12:12:28.641536 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:28.642450 (+   914us) log.cc:844] Serialized 1316 byte log entry
0709 12:12:28.875866 (+233416us) op_driver.cc:464] REPLICATION: finished
0709 12:12:29.301024 (+425158us) write_op.cc:301] APPLY: starting
0709 12:12:29.301119 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:29.301281 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:29.301399 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:29.302046 (+   647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:29.302243 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:12:29.302292 (+    49us) write_op.cc:312] APPLY: finished
0709 12:12:29.302539 (+   247us) log.cc:844] Serialized 34 byte log entry
0709 12:12:29.302726 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:29.302836 (+   110us) write_op.cc:454] Released schema lock
0709 12:12:29.302880 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:29.303258 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:29.303287 (+    29us) write_op.cc:454] Released schema lock
0709 12:12:29.454725 (+151438us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54005b9854. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce3814032a 00007fce380c5f14 00007fce380c5ec3 00007fce380c5e38 00007fce380c5df3 00007fce380c50dc 00007fce380eee16 00007fce380d6cbb 00007fce380c139d 00007fce380c4d75
Metrics: {"mutex_wait_us":35609,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":420733,"apply.run_cpu_time_us":2210,"apply.run_wall_time_us":2211,"num_ops":3,"prepare.queue_time_us":249751,"prepare.run_cpu_time_us":21894,"prepare.run_wall_time_us":199068,"raft.queue_time_us":1106,"raft.run_cpu_time_us":15212,"raft.run_wall_time_us":637536,"replication_time_us":224840,"spinlock_wait_cycles":83153152,"thread_start_us":341812,"threads_started":4,"wal-append.queue_time_us":171540,"wal-append.run_cpu_time_us":3121,"wal-append.run_wall_time_us":1489314}]]}
W20260709 12:12:30.451243 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 62703.9us
I20260709 12:12:30.185258 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:30.404901 14020 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:30.452466 13988 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.184906 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:30.405982 14300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.039s	sys 0.114s
I20260709 12:12:30.470995 13988 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.423134 14633 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.424355 14734 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:30.436511 14634 consensus_meta.cc:287] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 12:12:30.482239 14634 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:30.432152 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 393612us
I20260709 12:12:30.439232 14645 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.485705 14097 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.523175 13840 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:30.412057 13769 catalog_manager.cc:5697] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.471894 14020 pending_rounds.cc:85] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Aborting all ops after (but not including) 1
I20260709 12:12:30.486272 14542 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.486123 13915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.113s	sys 0.181s
I20260709 12:12:30.466915 14716 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:30.175546 13866 rpcz_store.cc:269] 0709 12:12:27.859022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.861893 (+  2871us) service_pool.cc:224] Handling call
0709 12:12:28.317555 (+455662us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:30.036522 (+1718967us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540078bc54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:30.068566 (+ 32044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878748288}
I20260709 12:12:30.457046 14636 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
W20260709 12:12:30.486681 14674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.039s	sys 0.043s
I20260709 12:12:30.504395 14667 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.506161 14617 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:30.506381 14142 raft_consensus.cc:359] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.539055 14020 pending_rounds.cc:107] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:30.487074 14633 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.539073 14734 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:30.476642 14715 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:30.510808 14661 consensus_meta.cc:287] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.003s
W20260709 12:12:30.477108 14300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.040s	sys 0.114s
I20260709 12:12:30.513411 14477 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:30.561816 14674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.039s	sys 0.043s
I20260709 12:12:30.518332 14062 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.532009 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:30.587009 14023 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:30.566636 14020 raft_consensus.cc:2889] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.541065 14721 consensus_queue.cc:1048] T 2c47dd7750a84d98a2f83efe24a70125 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:12:30.537616 13769 catalog_manager.cc:5697] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 2, leader changed from f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132) to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 2 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:30.438995 14680 consensus_queue.cc:1059] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:12:30.598351 14680 raft_consensus.cc:3055] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.598762 14680 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:30.599507 14509 consensus_meta.cc:287] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.004s
I20260709 12:12:30.599756 14680 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:30.605248 14643 consensus_queue.cc:1175] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33ef851003ef478cac1897bfee45a8f2" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:12:30.606489 14680 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.548024 13913 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:30.607996 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 60100.8us
W20260709 12:12:30.544121 13915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.114s	sys 0.181s
I20260709 12:12:30.476204 13868 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.539561 14421 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:30.517691 14485 consensus_queue.cc:1048] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
W20260709 12:12:30.516186 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 75624.9us
I20260709 12:12:30.569597 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:30.563596 14142 raft_consensus.cc:385] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:30.593565 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 75341.4us
I20260709 12:12:30.610368 14142 raft_consensus.cc:740] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.507464 14699 consensus_queue.cc:1048] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.613612 14142 consensus_queue.cc:260] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.605144 14617 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.609186 13913 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:30.600013 14509 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.584911 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.578816 14734 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:30.560740 14716 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:30.541070 14542 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:30.564302 14636 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.603647 14633 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:30.607838 14550 consensus_queue.cc:1059] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.582406 14661 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:30.611090 13838 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.595163 13989 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.624924 14477 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.625324 14022 raft_consensus.cc:1275] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.626082 14022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 166) took 1004 ms. Trace:
I20260709 12:12:30.626441 14022 rpcz_store.cc:276] 0709 12:12:29.621644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.633341 (+ 11697us) service_pool.cc:224] Handling call
0709 12:12:30.624586 (+991245us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:30.624900 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.625777 (+   877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.626017 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6227712}
I20260709 12:12:30.627564 14716 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:30.629529 14734 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:30.627952 14509 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:30.630805 14485 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.632251 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:30.632849 13944 raft_consensus.cc:1240] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:30.636287 14514 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.636855 14740 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.609107 14738 raft_consensus.cc:2764] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:30.621942 14089 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:30.638652 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:30.626114 14542 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:30.645010 14636 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:30.645066 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:30.647126 14661 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:30.648073 13865 raft_consensus.cc:2393] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:30.648970 14550 raft_consensus.cc:3055] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.649374 14550 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:30.650228 14550 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:30.651378 14550 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.621518 14093 raft_consensus.cc:1275] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.637301 14740 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:30.653581 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 58583.2us
I20260709 12:12:30.654369 13989 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:30.658874 13913 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.660923 14146 ts_tablet_manager.cc:1434] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.929s	user 0.015s	sys 0.006s
W20260709 12:12:30.661309 14146 ts_tablet_manager.cc:1467] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Tablet startup took 929ms
I20260709 12:12:30.595163 13769 catalog_manager.cc:5697] T 10e5c0206d594f77b1c65f9d7e8584c3 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.663543 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:30.664997 14061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.024s	sys 0.026s
I20260709 12:12:30.667725 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:30.665362 14061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.024s	sys 0.026s
W20260709 12:12:30.669929 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 514459us
I20260709 12:12:30.668367 13947 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
W20260709 12:12:30.672145 14063 leader_election.cc:343] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.664685 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:30.677040 14061 leader_election.cc:343] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.678552 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:30.672230 13769 catalog_manager.cc:5697] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 2, leader changed from 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 2 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:30.681171 14061 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:30.677433 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:30.688251 14061 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.664812 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:30.622076 14674 consensus_queue.cc:1048] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.053s
I20260709 12:12:30.665354 14716 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.659775 14740 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.665287 14475 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:30.661639 14146 ts_tablet_manager.cc:1469] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Trace:
0709 12:12:16.264597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.273838 (+  9241us) service_pool.cc:224] Handling call
0709 12:12:16.275906 (+  2068us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.276030 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.286957 (+ 10927us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.382666 (+ 95709us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.383179 (+   513us) inbound_call.cc:177] Queueing success response
0709 12:12:29.510176 (+13126997us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:29.732336 (+222160us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:29.974979 (+242643us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:29.975597 (+   618us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":188605,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"tablet-open.queue_time_us":13127075,"thread_start_us":476479,"threads_started":1}
I20260709 12:12:30.699388 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:30.697381 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.725556 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:30.682792 13940 raft_consensus.cc:1275] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:30.682922 14633 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:30.731312 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 260402us
I20260709 12:12:30.731778 13986 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.732703 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:30.682787 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:30.701785 14687 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:30.744242 14687 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:30.745160 14146 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:30.698254 14738 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:12:30.730952 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.752102 13913 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:30.754526 14016 raft_consensus.cc:1275] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.756152 14742 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.691172 14616 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.693413 14470 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:30.703042 14716 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.775063 14143 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:30.775755 14143 ts_tablet_manager.cc:1403] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 1.077s	user 0.046s	sys 0.023s
W20260709 12:12:30.783555 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.767822 14687 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:30.789093 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 57430.8us
I20260709 12:12:30.770138 14470 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.798775 14470 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.803457 14480 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.778578 14716 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.806449 14021 raft_consensus.cc:1275] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:30.807749 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:30.861785 13946 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:30.780359 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:30.810539 14645 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.811369 14634 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:30.793293 14667 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.804265 14477 consensus_queue.cc:1059] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:30.865747 13989 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:30.818171 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:30.820044 14015 raft_consensus.cc:1275] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.833110 14146 tablet_bootstrap.cc:654] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.834602 14093 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:30.834777 14732 consensus_queue.cc:1059] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:30.868876 14738 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.869558 14732 raft_consensus.cc:3055] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.869937 14732 raft_consensus.cc:740] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:30.870777 14732 consensus_queue.cc:260] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.837098 13868 raft_consensus.cc:2468] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:30.872485 14634 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:30.873409 14634 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:30.879271 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.872018 14732 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.860256 14479 consensus_queue.cc:1048] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:12:30.787433 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 54806.8us
I20260709 12:12:30.828379 14143 raft_consensus.cc:359] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:30.883764 14143 raft_consensus.cc:385] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.884203 14143 raft_consensus.cc:740] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.885032 14143 consensus_queue.cc:260] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:30.895267 14143 ts_tablet_manager.cc:1434] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 12:12:30.900261 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.917105 14142 ts_tablet_manager.cc:1434] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.544s	user 0.014s	sys 0.012s
W20260709 12:12:30.917483 14142 ts_tablet_manager.cc:1467] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Tablet startup took 544ms
W20260709 12:12:30.918761 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 298938us
W20260709 12:12:30.920565 14061 leader_election.cc:343] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.921676 14061 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:30.922498 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 379483us
I20260709 12:12:30.923499 13840 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:30.929739 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 318687us
W20260709 12:12:30.943974 14061 leader_election.cc:343] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.944820 14061 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:30.956103 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:30.950011 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:30.916407 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:30.917770 14142 ts_tablet_manager.cc:1469] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb: Trace:
0709 12:12:16.321467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.321649 (+   182us) service_pool.cc:224] Handling call
0709 12:12:16.324275 (+  2626us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.324372 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.599156 (+274784us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.616277 (+ 17121us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.626393 (+ 10116us) inbound_call.cc:177] Queueing success response
0709 12:12:29.445707 (+12819314us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:30.372770 (+927063us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:30.494379 (+121609us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:30.495119 (+   740us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":17208,"raft.queue_time_us":22175,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"tablet-open.queue_time_us":12828985,"thread_start_us":267929,"threads_started":1}
I20260709 12:12:30.950043 14637 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:30.989655 14142 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:30.952333 14680 consensus_queue.cc:1048] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:12:30.966604 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:30.971784 14688 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:12:30.989781 14095 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:31.077047 14616 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.205472 14616 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:31.137471 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 237341us
I20260709 12:12:31.207162 14143 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: Bootstrap starting.
I20260709 12:12:31.207482 13986 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:31.149972 13840 consensus_peers.cc:597] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb -> Peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Couldn't send request to peer 33ef851003ef478cac1897bfee45a8f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:31.208242 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 235589us
I20260709 12:12:31.217760 14146 tablet_bootstrap.cc:492] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:30.971963 14636 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:12:31.157857 13865 raft_consensus.cc:1275] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:30.967308 14661 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:30.964190 14604 consensus_queue.cc:1048] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 12:12:30.939011 14674 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:12:31.161758 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:31.161845 14097 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.167089 14756 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:31.172945 14687 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:30.963955 14744 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:12:30.953109 14745 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.936867 14475 consensus_queue.cc:1059] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:12:31.190425 14144 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:31.244263 14144 ts_tablet_manager.cc:1403] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 1.396s	user 0.034s	sys 0.040s
W20260709 12:12:31.191681 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 243402us
I20260709 12:12:31.194849 14062 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:31.245760 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 51025us
I20260709 12:12:31.246328 14061 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:31.246853 14062 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:31.198094 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.232656 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:31.196455 14550 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.202759 14750 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:31.203092 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:31.218381 14146 ts_tablet_manager.cc:1403] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.474s	user 0.012s	sys 0.036s
I20260709 12:12:31.227355 14088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 179) took 1133 ms. Trace:
I20260709 12:12:31.228022 14740 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:31.196623 14738 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.191286 14470 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.198657 14479 consensus_queue.cc:1048] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:12:31.195801 14716 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:31.224180 14661 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:31.235083 14721 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.233147 14577 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.252992 14637 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.252465 14737 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.256409 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:31.274669 14735 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.284562 14617 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:31.318437 14477 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.319294 14477 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.253568 14421 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:12:31.289533 14745 raft_consensus.cc:2804] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.290071 14767 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:31.306053 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 83512us
I20260709 12:12:31.326599 14097 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.328027 14023 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:31.289271 14738 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.328197 14776 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.268939 14550 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.249636 14756 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.294436 14661 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.295279 14509 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.302561 14778 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.329301 14637 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:12:31.359328 14477 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:31.354806 14091 raft_consensus.cc:2393] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:31.360232 14716 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:31.356469 14509 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.346500 14667 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.400946 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:31.351065 14776 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.402989 14740 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:31.294631 14721 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.403687 14756 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.354940 13948 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:31.302971 14737 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.363708 14778 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.300575 14577 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:31.345505 14604 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:31.404775 14738 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:31.444654 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 114235us
I20260709 12:12:31.355623 14745 raft_consensus.cc:697] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:31.404366 14687 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:31.452884 14142 tablet_bootstrap.cc:654] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:31.443310 14480 consensus_meta.cc:287] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.594s	user 0.016s	sys 0.000s
I20260709 12:12:31.440155 14477 raft_consensus.cc:3055] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:31.336771 14735 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:31.474323 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 189390us
I20260709 12:12:31.467420 14146 raft_consensus.cc:359] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.476219 14146 raft_consensus.cc:385] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.476671 14146 raft_consensus.cc:740] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.450979 14664 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.450357 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:31.451128 13946 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:31.463133 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:31.443406 14667 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.502225 13986 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:31.468744 14477 raft_consensus.cc:740] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:31.503221 14146 consensus_queue.cc:260] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.504621 14144 raft_consensus.cc:359] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.505483 14144 raft_consensus.cc:385] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.505788 14144 raft_consensus.cc:740] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.509045 14144 consensus_queue.cc:260] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.464325 14604 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.513792 14089 raft_consensus.cc:1240] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:31.514101 14776 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.514547 14470 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:31.514827 14604 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:31.515308 14745 consensus_queue.cc:237] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.516126 14577 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:31.516731 14667 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:31.520040 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:31.520725 14097 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:31.483431 14756 consensus_queue.cc:1048] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:12:31.492802 14664 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:31.666500 14144 ts_tablet_manager.cc:1434] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.422s	user 0.009s	sys 0.005s
I20260709 12:12:31.656819 14735 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.514142 14737 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:31.272491 14088 rpcz_store.cc:276] 0709 12:12:30.094470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.223219 (+128749us) service_pool.cc:224] Handling call
0709 12:12:30.223763 (+   544us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:30.687429 (+463666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.691532 (+  4103us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:30.756165 (+ 64633us) log.cc:844] Serialized 52 byte log entry
0709 12:12:30.938470 (+182305us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:31.225571 (+287101us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.226810 (+  1239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.226942 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.227002 (+    60us) raft_consensus.cc:1685] finished
0709 12:12:31.227027 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.227269 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":345917,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":32610,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":202,"thread_start_us":855843,"threads_started":3,"wal-append.queue_time_us":417219}
I20260709 12:12:31.506945 14767 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:31.667915 14300 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:31.570190 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:31.650183 14577 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.675959 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:31.706990 14509 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:31.866065 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 61013us
W20260709 12:12:31.867233 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.704296 14664 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:31.707960 14794 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.865998 14094 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.798300 14785 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.797935 14755 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:31.898413 14143 tablet_bootstrap.cc:700] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent opening tablet: real 0.140s	user 0.001s	sys 0.007s
I20260709 12:12:31.798013 14737 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.874881 14767 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.885720 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:31.758054 14300 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.798967 14577 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.912104 14143 tablet_bootstrap.cc:654] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.898008 14740 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.915690 14785 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.867851 14477 consensus_queue.cc:260] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:31.926088 14790 log.cc:927] Time spent T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:31.899245 14794 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.926378 14088 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:31.918593 14737 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.971212 14804 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:31.979897 14797 log.cc:927] Time spent T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:31.979604 14804 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.981671 14796 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.982430 14804 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.983222 14804 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:31.983750 14804 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:31.982296 14796 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:31.986063 14300 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.986469 14796 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:31.984452 14792 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 12:12:31.988615 14577 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:31.915555 14755 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:31.990259 14804 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:31.991833 14755 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:31.995299 14793 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:12:31.969152 14477 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.934172 14740 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:32.000167 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:31.921140 14767 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:31.975203 14795 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:32.012019 14090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.006s
I20260709 12:12:32.015230 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.083297 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 132) took 1140 ms. Trace:
I20260709 12:12:32.158521 13947 rpcz_store.cc:276] 0709 12:12:30.943126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.943279 (+   153us) service_pool.cc:224] Handling call
0709 12:12:32.044260 (+1100981us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:32.082484 (+ 38224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.082777 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.082818 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.082885 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:32.082931 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.083014 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.083193 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15167744}
W20260709 12:12:32.035530 14090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.003s	sys 0.007s
I20260709 12:12:32.162176 14094 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:32.098441 14737 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.100351 14778 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.100545 14740 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:32.103291 14142 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:32.172070 14142 ts_tablet_manager.cc:1403] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 1.201s	user 0.042s	sys 0.014s
I20260709 12:12:32.104712 14794 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:32.108371 14023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 138) took 1377 ms (client timeout 1516 ms). Trace:
W20260709 12:12:32.175414 14023 rpcz_store.cc:269] 0709 12:12:30.730773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.737394 (+  6621us) service_pool.cc:224] Handling call
0709 12:12:30.818005 (+ 80611us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:32.108099 (+1290094us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400871c54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:32.108286 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115187328}
I20260709 12:12:32.116242 14767 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:32.117687 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.125711 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.128684 14785 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.088843 14795 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.056593 14784 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:32.142969 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.154433 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:32.157044 14661 consensus_meta.cc:287] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.801s	user 0.014s	sys 0.000s
I20260709 12:12:32.162357 14789 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.199901 14789 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:32.200452 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.202509 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.202755 14789 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:32.098266 14146 ts_tablet_manager.cc:1434] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.831s	user 0.027s	sys 0.008s
I20260709 12:12:32.203751 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.204735 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 139) took 1318 ms. Trace:
I20260709 12:12:32.169258 13986 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:32.207187 13986 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:32.209010 14767 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:32.209514 14767 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:32.209981 14767 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:32.211416 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.213629 14667 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:32.214780 14667 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.215236 14667 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:32.203681 14146 ts_tablet_manager.cc:1467] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Tablet startup took 936ms
W20260709 12:12:32.218708 14146 ts_tablet_manager.cc:1469] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Trace:
0709 12:12:16.264263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.282599 (+ 18336us) service_pool.cc:224] Handling call
0709 12:12:16.292993 (+ 10394us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.293143 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.352432 (+ 59289us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.394468 (+ 42036us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.394993 (+   525us) inbound_call.cc:177] Queueing success response
0709 12:12:30.734637 (+14339644us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:31.266814 (+532177us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:31.400352 (+133538us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:31.401019 (+   667us) tablet_replica.cc:280] Starting consensus
0709 12:12:32.096501 (+695482us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003fdba0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce37ceb4bc 00007fce3503948b 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35053455 00007fce3813b060 00007fce38138d71 00007fce3bb35b2e
Metrics: {"mutex_wait_us":45803,"raft.queue_time_us":185817,"raft.run_cpu_time_us":8864,"raft.run_wall_time_us":94077,"spinlock_wait_cycles":4615040,"tablet-open.queue_time_us":14328540,"thread_start_us":130085,"threads_started":1}
I20260709 12:12:32.221719 14479 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.222258 14146 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:32.222359 14479 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.225044 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:32.225915 14089 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:32.226708 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.227109 14795 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.227281 14799 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:32.227960 14096 raft_consensus.cc:2393] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:32.227804 14799 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.225044 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.229462 13869 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:32.230131 14799 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:32.230537 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.195160 14784 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:32.181910 14740 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:32.197737 14142 raft_consensus.cc:359] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.232918 14142 raft_consensus.cc:385] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.205153 14015 rpcz_store.cc:276] 0709 12:12:30.886015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.886937 (+   922us) service_pool.cc:224] Handling call
0709 12:12:32.204000 (+1317063us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:32.204178 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.204366 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.204393 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.204435 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:32.204473 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.204543 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.204675 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7329664}
I20260709 12:12:32.233649 14142 raft_consensus.cc:740] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.234463 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:32.234516 14142 consensus_queue.cc:260] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.235781 14016 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:32.232961 14740 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.236790 14142 ts_tablet_manager.cc:1434] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 12:12:32.237901 14144 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:32.237828 14740 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:32.238922 13986 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:32.241791 14794 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:32.242451 14794 raft_consensus.cc:697] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:32.243743 14794 consensus_queue.cc:237] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.234792 14784 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.247201 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.250349 14785 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:32.250980 14785 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.254352 13866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 138) took 1033 ms. Trace:
W20260709 12:12:32.270656 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 52881us
I20260709 12:12:32.278689 14784 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:32.310905 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.312017 14095 raft_consensus.cc:2410] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:32.300086 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:32.310806 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:32.270483 14742 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:32.326236 14144 tablet_bootstrap.cc:654] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:32.329075 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 116616us
I20260709 12:12:32.331228 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:32.275383 14661 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.313619 14479 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.289314 14784 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.324342 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:32.327529 14778 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.341465 14800 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:32.254817 13866 rpcz_store.cc:276] 0709 12:12:31.220719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.222642 (+  1923us) service_pool.cc:224] Handling call
0709 12:12:31.292105 (+ 69463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.447877 (+155772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.450547 (+  2670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.456988 (+  6441us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:31.463342 (+  6354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.254072 (+790730us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b540050a354. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:32.254129 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.254280 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155352960}
I20260709 12:12:32.328814 14742 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.342278 14780 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:12:32.330470 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.332360 14737 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:32.360316 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:32.363030 14146 tablet_bootstrap.cc:654] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.344238 13867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 80) took 1121 ms. Trace:
I20260709 12:12:32.353643 14014 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:32.370735 13867 rpcz_store.cc:276] 0709 12:12:31.222841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.229405 (+  6564us) service_pool.cc:224] Handling call
0709 12:12:32.343436 (+1114031us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:32.343661 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.343869 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.343899 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.343945 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:32.343990 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.344058 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.344172 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6110592}
I20260709 12:12:32.382668 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.384835 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.374686 14477 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:32.396131 14477 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.398423 14477 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:32.385557 14761 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:32.399421 14761 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.401870 14761 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.355183 14785 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:32.385669 13941 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
W20260709 12:12:32.403096 14091 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 188) took 1217 ms (client timeout 1553 ms). Trace:
W20260709 12:12:32.403671 14091 rpcz_store.cc:269] 0709 12:12:31.186117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.186257 (+   140us) service_pool.cc:224] Handling call
0709 12:12:32.402840 (+1216583us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54002eefd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:32.403022 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86789376}
I20260709 12:12:32.405735 14785 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:32.406491 14785 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.392964 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:32.393433 14143 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: No bootstrap required, opened a new log
I20260709 12:12:32.394057 14634 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:32.413990 14643 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:32.395063 14742 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.409013 14143 ts_tablet_manager.cc:1403] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent bootstrapping tablet: real 1.217s	user 0.046s	sys 0.040s
I20260709 12:12:32.414650 14643 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.420222 14643 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.420410 14784 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.368556 14737 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:32.422848 14750 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:32.423337 14737 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.354874 14778 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.426312 14778 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.370412 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:32.427263 14015 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:32.428843 14021 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:32.429394 14667 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.411092 14785 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:32.365777 14800 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:32.423437 14750 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:32.432716 14143 raft_consensus.cc:359] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.433746 14143 raft_consensus.cc:385] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.434135 14143 raft_consensus.cc:740] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.435137 14143 consensus_queue.cc:260] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:32.450852 14143 ts_tablet_manager.cc:1434] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:12:32.417258 14661 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:32.466513 14800 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:32.466938 14090 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:32.702795 13868 raft_consensus.cc:1240] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:33.023849 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.024923 13873 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
W20260709 12:12:33.025614 13873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 136) took 1805 ms (client timeout 2149 ms). Trace:
W20260709 12:12:33.026291 13873 rpcz_store.cc:269] 0709 12:12:31.219989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.222299 (+  2310us) service_pool.cc:224] Handling call
0709 12:12:33.023631 (+1801332us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.025529 (+  1898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28844928}
I20260709 12:12:33.075248 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.076321 13870 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:33.076862 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 82) took 1569 ms. Trace:
I20260709 12:12:33.077158 13870 rpcz_store.cc:276] 0709 12:12:31.507481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.515121 (+  7640us) service_pool.cc:224] Handling call
0709 12:12:33.075034 (+1559913us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.076796 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14167296}
W20260709 12:12:33.173022 14767 consensus_meta.cc:287] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.963s	user 0.018s	sys 0.006s
I20260709 12:12:33.174055 14767 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.176741 14767 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.298753 14779 raft_consensus.cc:3055] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:33.300102 14779 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:33.302537 14779 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.304977 14779 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.314862 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.316813 13946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 135) took 1043 ms. Trace:
I20260709 12:12:33.317348 13946 rpcz_store.cc:276] 0709 12:12:32.273325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.280837 (+  7512us) service_pool.cc:224] Handling call
0709 12:12:33.314193 (+1033356us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.316578 (+  2385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6720768}
I20260709 12:12:33.335644 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.337174 14023 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:33.338013 14023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 148) took 1044 ms. Trace:
I20260709 12:12:33.338632 14767 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.339712 14767 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.343108 14767 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.344249 14767 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.338447 14023 rpcz_store.cc:276] 0709 12:12:32.293426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.293632 (+   206us) service_pool.cc:224] Handling call
0709 12:12:33.335006 (+1041374us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.337845 (+  2839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14176640}
I20260709 12:12:33.345103 14767 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.349344 14018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 150) took 1030 ms. Trace:
I20260709 12:12:33.350759 14018 rpcz_store.cc:276] 0709 12:12:32.318945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.320996 (+  2051us) service_pool.cc:224] Handling call
0709 12:12:33.347369 (+1026373us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:33.347912 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.348556 (+   644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.348588 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.348693 (+   105us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.348772 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.348847 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.349076 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4342016}
I20260709 12:12:33.349674 14767 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.355623 14767 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:33.356705 14767 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.359988 14767 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.379012 13989 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:33.379978 14837 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.386684 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.391435 14095 raft_consensus.cc:2393] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:33.397017 14838 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.384619 14837 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.399538 14767 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:33.400300 14767 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.405848 14767 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:33.411633 14837 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.424105 14550 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.401257 14838 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.432873 14840 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.434198 14840 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.437212 14760 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.438244 14760 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.448967 14840 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.451103 14760 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.458454 14767 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.461931 14767 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.467646 14094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 167) took 1007 ms. Trace:
I20260709 12:12:33.467609 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:33.469319 13865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 145) took 1976 ms (client timeout 1628 ms). Trace:
I20260709 12:12:33.469823 13868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 140) took 2500 ms. Trace:
I20260709 12:12:33.468359 14094 rpcz_store.cc:276] 0709 12:12:32.460254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.383257 (+923003us) service_pool.cc:224] Handling call
0709 12:12:33.384215 (+   958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.406459 (+ 22244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.407738 (+  1279us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.441785 (+ 34047us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.454840 (+ 13055us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.455249 (+   409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.456408 (+  1159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.467161 (+ 10753us) raft_consensus.cc:1685] finished
0709 12:12:33.467189 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.467385 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50176,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":386,"thread_start_us":21941,"threads_started":2,"wal-append.queue_time_us":23000}
I20260709 12:12:33.470449 13868 rpcz_store.cc:276] 0709 12:12:30.968936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.971125 (+  2189us) service_pool.cc:224] Handling call
0709 12:12:31.663149 (+692024us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:31.663400 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.703285 (+1039885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.468988 (+765703us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540012af54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:33.469523 (+   535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409218688}
I20260709 12:12:32.232951 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:33.469913 13865 rpcz_store.cc:269] 0709 12:12:31.492492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.496061 (+  3569us) service_pool.cc:224] Handling call
0709 12:12:33.462630 (+1966569us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.469098 (+  6468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3355392}
I20260709 12:12:33.474766 14142 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:33.478858 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.479936 13874 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:32.217700 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:33.475939 13869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 86) took 1452 ms (client timeout 1894 ms). Trace:
W20260709 12:12:33.480608 13874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 139) took 2259 ms (client timeout 1516 ms). Trace:
W20260709 12:12:33.487190 13874 rpcz_store.cc:269] 0709 12:12:31.221103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.222229 (+  1126us) service_pool.cc:224] Handling call
0709 12:12:33.478371 (+2256142us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.480508 (+  2137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12007808}
W20260709 12:12:33.482307 13871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 84) took 1597 ms (client timeout 1867 ms). Trace:
W20260709 12:12:33.488860 13871 rpcz_store.cc:269] 0709 12:12:31.885213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.216780 (+331567us) service_pool.cc:224] Handling call
0709 12:12:33.482072 (+1265292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.486511 14760 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.491189 14760 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:33.486644 13869 rpcz_store.cc:269] 0709 12:12:32.023690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.232263 (+208573us) service_pool.cc:224] Handling call
0709 12:12:33.475714 (+1243451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.495141 14760 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.485569 14142 tablet_bootstrap.cc:654] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:33.505189 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 1.04928e+06us
I20260709 12:12:33.509394 14142 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:33.509747 14063 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:33.510138 14142 ts_tablet_manager.cc:1403] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.003s
W20260709 12:12:33.511015 14063 leader_election.cc:343] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.512748 14760 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:33.513279 14760 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.513648 14760 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:33.514402 14142 raft_consensus.cc:359] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.515226 14142 raft_consensus.cc:385] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.515544 14142 raft_consensus.cc:740] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.516347 14142 consensus_queue.cc:260] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.521081 14142 ts_tablet_manager.cc:1434] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 12:12:33.522670 14142 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Bootstrap starting.
I20260709 12:12:33.527827 14837 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.533352 14142 tablet_bootstrap.cc:654] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.541605 14837 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.544816 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.546665 14837 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.560329 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:33.562111 14092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 196) took 2041 ms (client timeout 2023 ms). Trace:
W20260709 12:12:33.562685 14092 rpcz_store.cc:269] 0709 12:12:31.520238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.522464 (+  2226us) service_pool.cc:224] Handling call
0709 12:12:33.559699 (+2037235us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.561967 (+  2268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12630784}
I20260709 12:12:33.563275 14760 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.566069 14760 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.568863 14837 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.570041 14142 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: No bootstrap required, opened a new log
I20260709 12:12:33.569713 14837 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.570704 14142 ts_tablet_manager.cc:1403] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent bootstrapping tablet: real 0.049s	user 0.033s	sys 0.009s
I20260709 12:12:33.571331 14097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 197) took 1921 ms. Trace:
I20260709 12:12:33.571770 14097 rpcz_store.cc:276] 0709 12:12:31.649457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.650750 (+  1293us) service_pool.cc:224] Handling call
0709 12:12:31.989334 (+338584us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:31.989671 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.017420 (+ 27749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.017463 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.017529 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:32.017581 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.570767 (+1553186us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5400a2b054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:33.570842 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.571106 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80754304}
I20260709 12:12:33.572400 14837 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.574321 14142 raft_consensus.cc:359] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.575237 14142 raft_consensus.cc:385] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.575598 14142 raft_consensus.cc:740] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Initialized, Role: FOLLOWER
W20260709 12:12:33.576719 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb0e0 after lost signal to thread 7581
I20260709 12:12:33.576396 14142 consensus_queue.cc:260] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.574208 14020 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
W20260709 12:12:33.578471 14020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51094 (request call id 184) took 2105 ms (client timeout 1930 ms). Trace:
I20260709 12:12:33.579367 14142 ts_tablet_manager.cc:1434] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 12:12:33.580010 14020 rpcz_store.cc:269] 0709 12:12:31.472618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.474171 (+  1553us) service_pool.cc:224] Handling call
0709 12:12:33.544201 (+2070030us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.578310 (+ 34109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19820288}
I20260709 12:12:33.583549 14841 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.584682 14841 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.585770 14840 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.586525 14840 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:33.587082 14144 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.002s	sys 0.018s
W20260709 12:12:33.587497 14144 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.002s	sys 0.018s
I20260709 12:12:33.574292 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.589531 14091 raft_consensus.cc:2393] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:33.583467 14760 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.590364 14760 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.590869 14616 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.591248 14840 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.591610 14616 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.593135 14760 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:33.606801 14617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.031s	sys 0.067s
W20260709 12:12:33.609318 14617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.031s	sys 0.071s
I20260709 12:12:33.592389 14616 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.621405 14144 tablet_bootstrap.cc:492] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:33.622431 14144 ts_tablet_manager.cc:1403] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 1.385s	user 0.011s	sys 0.026s
I20260709 12:12:33.623485 14616 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.620036 14667 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.628402 14144 raft_consensus.cc:359] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.629565 14144 raft_consensus.cc:385] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.630010 14144 raft_consensus.cc:740] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.631163 14144 consensus_queue.cc:260] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.634013 14144 ts_tablet_manager.cc:1434] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:12:33.635381 14144 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:33.635794 14849 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.636732 14849 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.637199 14847 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.638151 14847 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.640259 14849 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.640261 14542 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:33.641021 14847 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.641386 14542 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.644250 14144 tablet_bootstrap.cc:654] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.645656 14847 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.645862 14542 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:33.641786 13837 connection.cc:256] RPC call timeout handler was delayed by -1.3114972129999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:12:33.648437 13940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 137) took 1374 ms. Trace:
I20260709 12:12:33.648962 13940 rpcz_store.cc:276] 0709 12:12:32.274057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.280053 (+  5996us) service_pool.cc:224] Handling call
0709 12:12:32.332706 (+ 52653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.340354 (+  7648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.647444 (+1307090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.647645 (+   201us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.647813 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.647944 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.648150 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.650063 14542 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:33.650772 14542 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.646379 14847 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.652701 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 140) took 1201 ms. Trace:
I20260709 12:12:33.653226 13947 rpcz_store.cc:276] 0709 12:12:32.451374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.650969 (+1199595us) service_pool.cc:224] Handling call
0709 12:12:33.651487 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.652118 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.652142 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.652217 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.652301 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.652357 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.652461 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.654572 14742 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:33.655264 14742 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.656293 14847 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:33.674393 13948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 126) took 3018 ms (client timeout 1516 ms). Trace:
W20260709 12:12:33.687031 13948 rpcz_store.cc:269] 0709 12:12:30.655336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.659316 (+  3980us) service_pool.cc:224] Handling call
0709 12:12:33.673857 (+3014541us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54001243d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:33.674122 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437241216}
I20260709 12:12:33.677277 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.679904 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:33.684934 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 188293us
W20260709 12:12:33.686224 14016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.324s	user 0.021s	sys 0.038s
W20260709 12:12:33.686510 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.688241 14091 raft_consensus.cc:1240] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:33.675745 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:33.691259 14554 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.699306 14509 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:33.700066 14509 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.702611 14801 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.702999 14509 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.703389 14801 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.700155 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.704531 14020 raft_consensus.cc:2368] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:33.698525 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.705021 13940 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:33.705252 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 154) took 1309 ms. Trace:
I20260709 12:12:33.705044 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.706377 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.694975 14016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.022s	sys 0.039s
I20260709 12:12:33.707549 13913 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:33.708969 14016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 144) took 1458 ms. Trace:
I20260709 12:12:33.704561 14554 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.696394 14847 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.705767 14020 rpcz_store.cc:276] 0709 12:12:32.395627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.679306 (+1283679us) service_pool.cc:224] Handling call
0709 12:12:33.705149 (+ 25843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.710840 14847 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:33.711589 14089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.005s	sys 0.009s
I20260709 12:12:33.712841 14554 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.713840 14729 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:33.717617 14849 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.718518 14849 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.721167 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.725971 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.726027 14841 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.726773 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.727279 13944 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:33.727736 14801 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.709915 14742 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.727793 14022 raft_consensus.cc:2468] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:33.728268 14018 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:33.729847 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.731346 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.732275 13940 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:33.732606 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:33.733343 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:33.733826 14737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.010s	sys 0.011s
I20260709 12:12:33.733496 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.734313 14737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.010s	sys 0.011s
I20260709 12:12:33.734629 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.726234 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.735522 13945 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:33.733513 13941 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:33.734788 13949 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:33.742928 14847 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.756410 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.756852 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.757592 14022 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:33.758205 14849 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.734339 14020 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:33.746672 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.747947 14542 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.766633 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.766899 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.758860 14847 consensus_queue.cc:1059] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:12:33.768721 14509 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.745682 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.762809 14089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.338s	user 0.005s	sys 0.012s
I20260709 12:12:33.773892 14018 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:33.772456 14742 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:33.770721 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.780321 14091 raft_consensus.cc:2410] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:33.781364 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:33.709416 14016 rpcz_store.cc:276] 0709 12:12:32.250811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.270457 (+ 19646us) service_pool.cc:224] Handling call
0709 12:12:32.313239 (+ 42782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.323456 (+ 10217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.328288 (+  4832us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.356748 (+ 28460us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.708368 (+1351620us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.708468 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.708604 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.708669 (+    65us) raft_consensus.cc:1685] finished
0709 12:12:33.708682 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.708877 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1407,"raft.queue_time_us":7530,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6197,"thread_start_us":1346121,"threads_started":1,"wal-append.queue_time_us":149513,"wal-append.run_cpu_time_us":2306,"wal-append.run_wall_time_us":1040968}
I20260709 12:12:33.783962 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.788257 14721 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.790518 14838 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:33.785125 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.793290 14022 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:33.775302 14509 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.795871 14509 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.785894 14095 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
W20260709 12:12:33.796341 13914 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.591s	user 0.007s	sys 0.019s
I20260709 12:12:33.778559 14742 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.805739 14015 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:33.807982 14742 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.802028 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:33.809300 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 43525.2us
I20260709 12:12:33.810040 14847 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:33.810043 14019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 128) took 2343 ms. Trace:
I20260709 12:12:33.810621 14847 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.811148 14847 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:33.810981 14019 rpcz_store.cc:276] 0709 12:12:31.466577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.469638 (+  3061us) service_pool.cc:224] Handling call
0709 12:12:33.808840 (+2339202us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:33.809170 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.809463 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.809494 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.809574 (+    80us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:33.809628 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.809695 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.809835 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7908608}
I20260709 12:12:33.811868 13941 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:33.801517 13913 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:33.814597 14146 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.014s	sys 0.028s
W20260709 12:12:33.815040 14146 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.421s	user 0.015s	sys 0.028s
W20260709 12:12:33.820782 13914 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.008s	sys 0.019s
W20260709 12:12:33.824995 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 1.61992e+06us
W20260709 12:12:33.857738 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 55384.2us
I20260709 12:12:33.858003 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.859980 13986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.863739 14144 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
W20260709 12:12:33.864602 13803 debug-util.cc:398] Leaking SignalData structure 0x7b080034c060 after lost signal to thread 13806
I20260709 12:12:33.867360 14146 tablet_bootstrap.cc:492] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:33.826900 14667 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.874145 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.880280 14699 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:33.880479 14019 raft_consensus.cc:2410] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:33.810999 14061 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:33.881176 14721 consensus_queue.cc:1059] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:33.881531 14554 raft_consensus.cc:2804] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:33.881927 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 71159.2us
I20260709 12:12:33.882046 14554 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.882566 14479 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:33.882628 14721 raft_consensus.cc:3055] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:33.883296 14479 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.883397 14721 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:33.883848 14479 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.884807 14841 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.884939 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.885684 14841 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:33.886159 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:33.886961 14091 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:33.887522 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.888229 14097 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:33.889302 14721 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.824958 14838 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:33.890079 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:33.890520 14838 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:33.891170 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.891572 14061 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:33.891942 14094 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:33.880965 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.892695 13941 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:33.892900 14639 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:33.893357 14639 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.887001 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:33.893880 14639 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.894652 14095 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:33.888430 14841 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:33.877591 14144 ts_tablet_manager.cc:1403] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.243s	user 0.009s	sys 0.019s
I20260709 12:12:33.893412 14023 raft_consensus.cc:2393] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:33.897717 13840 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:33.898552 14755 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:33.899360 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:33.899313 14755 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.882750 14554 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:33.900327 13943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48292 (request call id 143) took 2245 ms (client timeout 1628 ms). Trace:
W20260709 12:12:33.900887 13943 rpcz_store.cc:269] 0709 12:12:31.655391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.663636 (+  8245us) service_pool.cc:224] Handling call
0709 12:12:33.899001 (+2235365us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:33.900259 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128524032}
I20260709 12:12:33.901873 14849 raft_consensus.cc:3055] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:33.901605 14755 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:33.902364 14849 raft_consensus.cc:740] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:33.903561 14667 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:33.903957 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.875495 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 74137.6us
I20260709 12:12:33.905627 13913 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:33.905879 14667 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:33.906083 14787 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:12:33.907793 13840 leader_election.cc:343] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.907938 13913 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:33.908098 14741 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:33.908279 13840 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:33.908722 14741 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.909149 14741 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:33.909819 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.909070 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.881085 14699 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.913710 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:33.915010 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.915895 13874 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:33.917395 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.918372 14146 ts_tablet_manager.cc:1403] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 1.696s	user 0.028s	sys 0.036s
I20260709 12:12:33.919711 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.885999 14092 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:33.923650 14734 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.924372 14757 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:33.925232 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.938870 14021 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
W20260709 12:12:33.975243 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 67380.5us
I20260709 12:12:33.966840 14144 raft_consensus.cc:359] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.977847 14144 raft_consensus.cc:385] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.978160 14144 raft_consensus.cc:740] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.921249 14721 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.992163 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.988647 14837 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:33.970553 14734 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.992578 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:33.993193 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 85463.1us
I20260709 12:12:33.996315 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:33.994659 14849 consensus_queue.cc:260] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.008514 14849 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.008776 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.010126 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.000768 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:34.011822 14617 consensus_queue.cc:1175] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33ef851003ef478cac1897bfee45a8f2" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:12:34.012367 14699 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:33.995054 13988 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.517s	user 0.012s	sys 0.007s
I20260709 12:12:33.997195 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.013293 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.994450 14737 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:34.001112 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.014832 14737 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.015151 13865 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:33.999431 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.998574 14837 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.016912 13873 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:34.011402 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.019080 14837 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:34.019312 14750 consensus_meta.cc:287] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 1.578s	user 0.020s	sys 0.009s
I20260709 12:12:34.000010 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.019791 14750 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.020640 13866 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.002341 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.025667 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.026149 14144 consensus_queue.cc:260] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:33.972482 14667 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:34.014140 13867 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:34.016377 14091 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
W20260709 12:12:33.994926 14061 leader_election.cc:336] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Timed out: RequestConsensusVote RPC to 127.7.102.131:36455 timed out after 1.516s (SENT)
W20260709 12:12:34.042088 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 47224.9us
I20260709 12:12:34.036474 13913 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:34.016346 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:33.989287 14742 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:33.926275 14741 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.013142 14699 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:34.049224 13988 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.013s	sys 0.008s
I20260709 12:12:33.996891 14577 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:34.006742 14734 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.049233 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:33.998896 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.003548 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.041343 14146 raft_consensus.cc:359] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.058039 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.064134 14146 raft_consensus.cc:385] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:34.064580 14146 raft_consensus.cc:740] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
W20260709 12:12:34.058669 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 78254.9us
W20260709 12:12:34.055843 13914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.129:45927 timed out after 1.505s (SENT) [suppressed 6 similar messages]
I20260709 12:12:34.068969 13865 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:34.069199 14734 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.068867 14577 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.069754 14734 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.070183 14734 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.071493 14577 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.071729 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 142) took 2768 ms. Trace:
I20260709 12:12:34.048117 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.073480 14144 ts_tablet_manager.cc:1434] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.176s	user 0.005s	sys 0.004s
I20260709 12:12:34.011430 14847 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.067018 14063 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.063192 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.050350 14742 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.061204 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:34.079639 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 1.66959e+06us
I20260709 12:12:34.083913 13945 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:34.079780 13913 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.082731 14146 consensus_queue.cc:260] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.087909 13942 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:34.046597 14667 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.088898 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.092726 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:34.099123 14014 consensus_meta.cc:287] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 1.690s	user 0.013s	sys 0.009s
I20260709 12:12:34.099712 14014 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.100245 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.101681 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.102397 13940 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:34.067344 14699 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.103622 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.105106 13873 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:34.106210 14699 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:34.107424 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 57794.7us
I20260709 12:12:34.093711 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.110008 14063 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:34.111572 14848 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:34.112147 14848 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.112998 14848 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.113360 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.114894 14144 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
I20260709 12:12:34.114567 14639 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.083240 14742 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.072115 13872 rpcz_store.cc:276] 0709 12:12:31.303733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.358164 (+ 54431us) service_pool.cc:224] Handling call
0709 12:12:31.982780 (+624616us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:31.983083 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.990529 (+  7446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.990568 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.990617 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:31.990659 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.071245 (+2080586us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b5400509454. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:34.071333 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.071538 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126132224}
W20260709 12:12:34.128659 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 55372.1us
I20260709 12:12:34.129657 13913 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:34.130723 14740 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.131218 14740 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:34.131589 14740 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.130746 14509 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:34.132570 14509 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.132663 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.133133 14509 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.133313 14089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 164) took 1760 ms. Trace:
I20260709 12:12:34.133994 14550 consensus_queue.cc:1059] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:12:34.134637 13838 connection.cc:256] RPC call timeout handler was delayed by -1.432516878999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:12:34.135670 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.139382 14146 ts_tablet_manager.cc:1434] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.221s	user 0.008s	sys 0.000s
I20260709 12:12:34.140202 13913 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:34.146938 14616 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:34.149350 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.151443 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:34.152878 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 94365.6us
I20260709 12:12:34.154511 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.155905 14750 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.157084 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.157203 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.102440 14667 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.105127 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.112048 14554 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:34.100435 14014 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 147) took 1812 ms (client timeout 2134 ms). Trace:
W20260709 12:12:34.169090 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 98862.2us
I20260709 12:12:34.176666 14741 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.178299 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.179330 14015 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:34.158330 14019 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
W20260709 12:12:34.181357 13988 connection.cc:256] RPC call timeout handler was delayed by -1.2834942260001299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:12:34.181797 13988 connection.cc:256] RPC call timeout handler was delayed by -1.2339942260000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 12:12:34.181847 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:34.182230 13988 connection.cc:256] RPC call timeout handler was delayed by -1.1606951470000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:12:34.182555 13988 connection.cc:256] RPC call timeout handler was delayed by -1.1555671419998816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 12:12:34.182639 14019 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:34.133826 14089 rpcz_store.cc:276] 0709 12:12:32.373496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.374403 (+   907us) service_pool.cc:224] Handling call
0709 12:12:32.383432 (+  9029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.424462 (+ 41030us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:12:32.424852 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.801134 (+1376282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.801255 (+   121us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:33.801342 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.132907 (+331565us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54009a42d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:34.132968 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.133231 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4131,"prepare.queue_time_us":730,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":13902,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":93658496,"thread_start_us":1347713,"threads_started":1,"wal-append.queue_time_us":91309,"wal-append.run_cpu_time_us":1268,"wal-append.run_wall_time_us":1002208}
I20260709 12:12:34.187976 14802 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.188550 14802 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.188997 14802 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.195914 14554 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.196959 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.197942 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.199527 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.201227 13944 raft_consensus.cc:2393] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:34.205118 14146 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:34.205502 14737 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.206214 14479 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.207870 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.197980 13946 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:34.205108 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.210451 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.196951 14645 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:34.214130 14645 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.197105 14577 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:34.218024 14023 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:34.169654 14014 rpcz_store.cc:269] 0709 12:12:32.288131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.289422 (+  1291us) service_pool.cc:224] Handling call
0709 12:12:34.100297 (+1810875us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:34.225289 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 174972us
I20260709 12:12:34.173998 14780 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.175128 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.180531 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.216528 14645 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.252918 14479 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:34.274083 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.262657 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.266033 14554 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:34.295611 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.308885 14015 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
W20260709 12:12:34.296710 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 100918us
I20260709 12:12:34.297417 14018 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:34.310225 13986 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:34.311474 14860 log.cc:927] Time spent T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:12:34.311574 13986 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.295764 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.296290 14061 leader_election.cc:400] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:34.313189 14061 leader_election.cc:403] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:34.313587 14146 tablet_bootstrap.cc:654] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:34.313771 13949 raft_consensus.cc:1240] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:34.314111 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 49614.2us
I20260709 12:12:34.314774 14837 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.315261 14837 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.315641 14837 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:34.315979 14061 leader_election.cc:343] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:34.295666 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 185811us
I20260709 12:12:34.318904 14063 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:34.322194 14061 leader_election.cc:343] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:34.320858 13986 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.323055 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.261996 14577 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.323411 14061 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.325426 13989 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:34.291869 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.293618 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.268204 14849 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
W20260709 12:12:34.301345 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08001dbe00 after lost signal to thread 13898
I20260709 12:12:34.297868 14554 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.298517 14734 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.303393 13946 raft_consensus.cc:1240] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.305611 14019 raft_consensus.cc:1240] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:34.336100 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.319582 14479 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:34.332947 14862 log.cc:927] Time spent T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:34.302834 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.328920 14750 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:34.337981 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 153925us
I20260709 12:12:34.338140 14637 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.337591 14016 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:34.333729 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.341809 14144 tablet_bootstrap.cc:654] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:34.387050 13941 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
W20260709 12:12:34.389551 14855 log.cc:927] Time spent T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.532s	user 0.005s	sys 0.000s
I20260709 12:12:34.332289 14616 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:34.324942 14509 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.271601 14740 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.268121 14780 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.303719 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.303819 14847 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.362234 13947 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.305171 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.357582 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.337311 14577 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.354128 14062 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:34.350031 13949 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
W20260709 12:12:34.380159 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 113300us
W20260709 12:12:34.337317 14859 log.cc:927] Time spent T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:12:34.350366 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08001adba0 after lost signal to thread 13899
I20260709 12:12:34.355428 14092 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:34.385201 14637 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.357936 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.351155 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.359493 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.353039 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.363332 14734 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.355302 14554 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.351613 13869 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.378286 14849 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:34.398187 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 74847.7us
I20260709 12:12:34.385125 14645 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:34.348613 14848 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.384984 14750 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:34.414227 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.425797 14645 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:34.425927 14864 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:34.426342 13944 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.415086 14637 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.426506 14061 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.426965 14090 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:34.421928 13873 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.427901 13872 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:34.429483 14838 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:34.429998 14780 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.431646 14740 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.431715 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.432866 14509 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.432807 14867 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:34.422269 13940 raft_consensus.cc:2368] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:34.467978 14479 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:34.464083 14577 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:34.446403 14645 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.465915 14848 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:34.467469 14095 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:34.468237 14089 raft_consensus.cc:1240] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
W20260709 12:12:34.468724 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 57188.8us
I20260709 12:12:34.478924 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.463476 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.446647 14750 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:34.473559 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 119714us
W20260709 12:12:34.449556 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08000daa40 after lost signal to thread 13973
I20260709 12:12:34.456321 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.499362 14144 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:34.500327 14144 ts_tablet_manager.cc:1403] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.386s	user 0.019s	sys 0.004s
I20260709 12:12:34.500824 13989 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:34.503756 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 112085us
I20260709 12:12:34.511359 14639 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:34.505962 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 178374us
I20260709 12:12:34.506894 14577 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:34.503885 13989 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.446427 14802 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.529173 14802 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.528465 13873 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.532907 14742 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.534354 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.512305 13988 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.523277 13986 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.535640 14742 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.525743 14680 consensus_queue.cc:1059] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:12:34.522425 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 194142us
I20260709 12:12:34.561151 14063 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.562521 14063 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.563577 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.538260 14864 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.540684 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.540872 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.540980 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.552739 14062 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:34.568373 14063 leader_election.cc:343] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:34.569347 14063 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:34.570490 14063 leader_election.cc:343] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:34.571035 14063 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:34.555302 13913 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:34.557047 14756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.023s
W20260709 12:12:34.573071 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 49922.5us
W20260709 12:12:34.572305 14756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.000s	sys 0.023s
I20260709 12:12:34.575079 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.517241 14479 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.577934 13986 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:34.580411 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68201.1us
I20260709 12:12:34.579288 14063 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.583629 14144 raft_consensus.cc:359] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.584131 14873 raft_consensus.cc:2804] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.584370 14144 raft_consensus.cc:385] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:34.572640 14779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.034s	sys 0.031s
I20260709 12:12:34.584762 14144 raft_consensus.cc:740] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
W20260709 12:12:34.585034 14779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.035s	sys 0.031s
I20260709 12:12:34.585032 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.580878 14667 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.586246 14667 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:34.586686 14667 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.586723 14779 raft_consensus.cc:3055] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.587355 14779 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:34.584604 14873 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.588567 14674 raft_consensus.cc:3055] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:34.588907 14873 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.589175 14674 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:34.589808 13988 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.590190 14674 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.575127 14879 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:34.591439 14674 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.591578 14750 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.609174 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.609383 14479 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.610699 14750 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.610936 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.611474 14750 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:34.611688 14479 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:34.612051 14750 raft_consensus.cc:697] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:34.612223 14841 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:34.612763 14841 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.613119 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.613590 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.613829 13946 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
I20260709 12:12:34.614269 14849 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.610738 13941 raft_consensus.cc:1240] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.612241 14146 tablet_bootstrap.cc:492] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:34.615893 14146 ts_tablet_manager.cc:1403] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.411s	user 0.009s	sys 0.018s
I20260709 12:12:34.575465 14838 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:34.617303 14838 raft_consensus.cc:697] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:34.617126 14873 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.588191 14779 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.618229 14779 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.618366 14838 consensus_queue.cc:237] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.595567 14637 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.595748 14645 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.573773 14577 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:34.573556 14639 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:34.622169 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 97511.1us
I20260709 12:12:34.599453 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.601683 13949 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
W20260709 12:12:34.601665 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 97876.4us
I20260709 12:12:34.586467 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.608563 14879 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:34.585573 14144 consensus_queue.cc:260] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.567116 14864 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.574056 14867 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:34.615164 13943 raft_consensus.cc:1240] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.634310 13837 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:34.633580 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 56193.5us
W20260709 12:12:34.637717 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 176475us
W20260709 12:12:34.639405 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 78196.4us
W20260709 12:12:34.647585 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 94998.8us
I20260709 12:12:34.643537 13989 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:34.643286 14879 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.579043 14094 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 0.
W20260709 12:12:34.633522 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5720 after lost signal to thread 14047
I20260709 12:12:34.613114 14841 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.655963 14146 raft_consensus.cc:359] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.660368 14146 raft_consensus.cc:385] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:34.660666 14146 raft_consensus.cc:740] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:34.639966 14639 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.641052 14802 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:34.661816 13840 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:34.667831 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 94113.2us
I20260709 12:12:34.644656 14867 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:34.658643 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0120 after lost signal to thread 14048
I20260709 12:12:34.672324 14146 consensus_queue.cc:260] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.660831 14699 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.651337 14879 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.659471 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.678584 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.696393 14146 ts_tablet_manager.cc:1434] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
W20260709 12:12:34.694156 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:34.696834 13914 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.669874 13873 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:34.667011 14095 raft_consensus.cc:1240] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.666767 14639 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:34.712430 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 122724us
I20260709 12:12:34.670260 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.701210 14699 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:34.674285 14577 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:34.676112 14616 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.745024 14883 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.745434 14750 consensus_queue.cc:237] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.745971 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.746876 14802 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.747035 14090 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:34.747855 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:34.780558 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08001ade60 after lost signal to thread 14121
W20260709 12:12:34.781013 13803 debug-util.cc:398] Leaking SignalData structure 0x7b0800216920 after lost signal to thread 14122
I20260709 12:12:34.781400 14645 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:34.748994 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:34.781860 13803 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8ea0 after lost signal to thread 14688
I20260709 12:12:34.782243 14019 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.783504 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.784226 14016 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:34.775029 14616 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.784940 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.785144 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.749529 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.786765 13869 raft_consensus.cc:2393] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:34.787132 14616 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:34.787235 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.787597 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.788415 13869 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:34.750698 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:34.750705 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.751415 14089 raft_consensus.cc:1240] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.751760 14146 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:34.751986 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.753228 14876 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:34.753477 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.753630 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:34.754135 14680 consensus_queue.cc:1059] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:34.738976 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:34.756420 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 74986.6us
I20260709 12:12:34.808238 14740 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.808343 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.809024 14740 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:34.788424 14884 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:34.810906 14884 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.811223 14740 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.700861 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.694726 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.697446 14757 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:34.764451 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 129295us
I20260709 12:12:34.804750 14023 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.676617 14867 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.736960 14801 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:34.697654 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:34.742128 14848 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:34.786046 14802 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.750511 14637 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.762072 14699 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:34.795543 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 147145us
I20260709 12:12:34.697670 14667 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:34.781890 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.804100 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.811308 14884 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.696835 13770 catalog_manager.cc:5697] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.814153 13989 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:34.832973 13912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.828593 13840 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:34.823311 13988 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:34.835305 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 137940us
I20260709 12:12:34.859419 14061 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.826690 14873 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:34.895323 14023 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.819556 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.818275 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.898142 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.819294 14848 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:34.899869 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68736.3us
I20260709 12:12:34.814239 14017 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:34.778324 14883 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:34.815814 14837 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:34.897660 14061 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:34.918582 14061 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:34.906809 14062 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:34.902848 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:34.812608 14019 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:34.817648 14645 consensus_queue.cc:1048] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.078s
I20260709 12:12:34.819641 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:34.915504 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 121421us
I20260709 12:12:34.892084 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.861972 14637 consensus_queue.cc:1048] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
W20260709 12:12:34.925184 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 111155us
I20260709 12:12:34.926081 13840 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.905704 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.900776 14886 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.894318 14737 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.915138 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:34.947754 14097 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.901978 14876 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.906317 14848 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:34.932456 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.938731 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:34.925370 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 123356us
I20260709 12:12:34.952798 14014 raft_consensus.cc:1240] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:34.954224 13769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38490 (request call id 47) took 7023 ms. Trace:
W20260709 12:12:34.955250 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 48520.3us
I20260709 12:12:34.959733 14062 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:34.923326 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:34.954918 13770 catalog_manager.cc:5697] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.929570 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.922894 14887 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:34.942081 14617 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:34.984261 14144 ts_tablet_manager.cc:1434] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.471s	user 0.043s	sys 0.038s
I20260709 12:12:34.942262 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.955638 14015 raft_consensus.cc:1240] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:34.993907 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 67956.1us
I20260709 12:12:34.993830 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:34.990608 14061 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:34.950591 14737 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:34.982795 13870 raft_consensus.cc:2468] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:34.994187 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.999220 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:34.999773 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.000288 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:35.000659 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:35.001592 14019 raft_consensus.cc:2410] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:35.001070 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.002790 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.004504 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:34.999275 14890 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:35.005390 14890 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:35.005764 14890 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:35.008895 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.010234 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.996717 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.011898 14018 raft_consensus.cc:1240] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:34.996409 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:35.013160 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.013715 14740 consensus_queue.cc:1059] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:35.016007 14740 raft_consensus.cc:3055] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:34.992556 14849 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:34.992168 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:34.989367 14887 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.018308 14849 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:35.018520 14887 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.018800 14849 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.012501 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:35.001152 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.021998 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.022663 14837 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.022313 14144 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: Bootstrap starting.
W20260709 12:12:35.008927 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 49271.6us
I20260709 12:12:35.026350 14062 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:34.980791 14721 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.016381 14740 raft_consensus.cc:740] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:35.052414 14091 raft_consensus.cc:2393] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:34.989328 14479 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:35.040942 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.041837 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.042668 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.002802 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:34.985026 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:34.956568 14873 consensus_queue.cc:1048] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
W20260709 12:12:35.058246 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 67724.1us
I20260709 12:12:35.063944 13840 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:35.024827 14737 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.069700 13840 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:34.995608 13868 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:34.992385 14645 consensus_queue.cc:1048] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
W20260709 12:12:35.077260 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.048452 14847 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:35.074628 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 79650.2us
I20260709 12:12:35.053164 14740 consensus_queue.cc:260] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.055526 14479 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:35.061911 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.126015 13988 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:35.131708 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 50034.8us
I20260709 12:12:35.078068 14787 raft_consensus.cc:2804] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:35.083158 14847 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.138206 13770 catalog_manager.cc:5697] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:35.143293 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 201920us
I20260709 12:12:35.149802 13989 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.124939 14479 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:35.151448 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 81957.3us
I20260709 12:12:35.147974 13770 catalog_manager.cc:5697] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.086016 14886 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.155277 14888 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:35.157135 14674 consensus_meta.cc:287] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.008s
I20260709 12:12:35.129637 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.163329 14756 raft_consensus.cc:3055] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:35.126493 13867 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:35.164114 14756 raft_consensus.cc:740] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:34.958899 13769 rpcz_store.cc:276] 0709 12:12:27.990538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.002901 (+ 12363us) service_pool.cc:224] Handling call
0709 12:12:34.953974 (+6951073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:31.030939 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:31.159064 (+128125us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:31.159104 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:12:31.159125 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:31.159916 (+   791us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:31.188397 (+ 28481us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:31.189700 (+  1303us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:31.267347 (+ 77647us) tablet.cc:701] Row locks acquired
0709 12:12:31.267382 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:12:31.291693 (+ 24311us) write_op.cc:270] Start()
0709 12:12:31.304990 (+ 13297us) write_op.cc:276] Timestamp: P: 1783599151290129 usec, L: 0
0709 12:12:31.305042 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:12:31.360844 (+ 55802us) log.cc:844] Serialized 1705 byte log entry
0709 12:12:32.414534 (+1053690us) op_driver.cc:464] REPLICATION: finished
0709 12:12:32.916431 (+501897us) write_op.cc:301] APPLY: starting
0709 12:12:32.916563 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:32.916794 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:32.916952 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:32.917683 (+   731us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:32.917941 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:12:32.918012 (+    71us) write_op.cc:312] APPLY: finished
0709 12:12:32.918353 (+   341us) log.cc:844] Serialized 40 byte log entry
0709 12:12:32.919447 (+  1094us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:32.919595 (+   148us) write_op.cc:454] Released schema lock
0709 12:12:32.919664 (+    69us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6951,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":501449,"apply.run_cpu_time_us":2877,"apply.run_wall_time_us":3724,"num_ops":4,"prepare.queue_time_us":249525,"prepare.run_cpu_time_us":18698,"prepare.run_wall_time_us":463019,"raft.queue_time_us":247083,"raft.run_cpu_time_us":6119,"raft.run_wall_time_us":144733,"replication_time_us":1075864,"thread_start_us":572077,"threads_started":4,"wal-append.queue_time_us":662173,"wal-append.run_cpu_time_us":74128,"wal-append.run_wall_time_us":1897510}]]}
I20260709 12:12:35.177112 14097 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:35.078585 14667 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:35.147437 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 80751.9us
I20260709 12:12:35.163532 13866 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:35.073926 14721 consensus_queue.cc:1059] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:12:35.169920 14883 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:35.193076 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 49320.3us
I20260709 12:12:35.193418 13989 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:35.194489 13912 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:35.194489 14062 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:35.122992 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:35.077875 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:35.205269 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 80258.7us
I20260709 12:12:35.139938 14787 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:35.149415 14750 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:35.150292 14847 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:35.209425 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 140909us
I20260709 12:12:35.191926 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.219658 14062 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:35.224731 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:35.197207 14837 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.219610 13840 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:35.228837 14864 consensus_meta.cc:287] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.001s
I20260709 12:12:35.217101 14787 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.251051 14864 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.251534 14895 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.252005 14895 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.252326 14895 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.240334 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.254249 13871 raft_consensus.cc:2393] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:35.254802 14864 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.227696 14699 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.229568 13989 leader_election.cc:400] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
W20260709 12:12:35.261875 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 44323.4us
I20260709 12:12:35.196998 14674 consensus_queue.cc:1059] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:12:35.217304 14779 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:35.201241 14780 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:35.212276 14889 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.258308 14144 tablet_bootstrap.cc:654] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:35.269327 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 49728.8us
W20260709 12:12:35.270936 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 46319.2us
I20260709 12:12:35.284902 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.289647 14061 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:35.258738 14873 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.296846 14061 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:35.278687 14841 consensus_meta.cc:287] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.004s
I20260709 12:12:35.297938 14061 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:35.298193 14062 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:35.299088 14061 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:35.259956 14886 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:35.305505 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.299492 14062 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:35.310819 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 46785.8us
I20260709 12:12:35.313753 14904 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.291497 14514 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.291584 14890 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.316162 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:35.317152 14890 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.317317 14721 consensus_queue.cc:1059] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:35.317795 14756 consensus_queue.cc:260] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.279670 14616 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:35.294014 14879 consensus_meta.cc:287] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.002s
I20260709 12:12:35.320947 14617 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:35.292208 14780 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.325404 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.296492 14873 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.343046 14617 raft_consensus.cc:697] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:35.343395 14873 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.344709 14699 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:35.347246 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:35.349613 14867 consensus_meta.cc:287] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.002s
I20260709 12:12:35.350111 14867 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.351001 13865 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:35.303766 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.342257 14616 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:35.352532 14616 raft_consensus.cc:697] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:35.331032 14838 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:35.353916 14838 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:35.353657 14616 consensus_queue.cc:237] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.353830 14848 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.354593 14838 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.342756 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.337829 14888 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:35.355754 14017 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:35.319577 14841 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.321810 14721 consensus_queue.cc:1059] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:12:35.362222 14699 raft_consensus.cc:3055] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:35.362677 14699 raft_consensus.cc:740] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:35.362848 14740 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.363741 14699 consensus_queue.cc:260] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.344319 14617 consensus_queue.cc:237] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.365463 14903 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:35.366281 14902 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.366742 14876 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.366864 14902 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.335364 14886 raft_consensus.cc:697] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:35.329180 14637 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:35.385102 14637 raft_consensus.cc:697] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:35.386360 14637 consensus_queue.cc:237] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.387333 14146 tablet_bootstrap.cc:654] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:35.380872 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 92418.2us
I20260709 12:12:35.382484 14699 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.382875 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.364146 14849 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.409318 13840 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:35.399582 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 100602us
I20260709 12:12:35.332460 14514 raft_consensus.cc:3055] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:12:35.383952 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.399184 14016 raft_consensus.cc:1240] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:35.420229 13914 leader_election.cc:336] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Timed out: RequestConsensusVote RPC to 127.7.102.129:45927 timed out after 1.524s (SENT)
I20260709 12:12:35.339320 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.430907 13914 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.428730 13986 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.422912 14023 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:35.430826 13838 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:35.295641 14889 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.431875 14779 raft_consensus.cc:697] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:35.453249 13989 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.398360 14895 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.460558 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.332280 14879 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.421695 14514 raft_consensus.cc:740] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:35.472469 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 63258.4us
W20260709 12:12:35.475354 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 175909us
I20260709 12:12:35.476737 14062 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:35.477422 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 57250.8us
I20260709 12:12:35.478751 13989 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.480189 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:35.479530 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.450749 14876 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:35.462592 14639 consensus_meta.cc:287] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.002s
W20260709 12:12:35.487092 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 65477.8us
I20260709 12:12:35.490593 13838 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.463766 14900 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:35.504184 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.475350 14897 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.483335 14899 raft_consensus.cc:2804] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:35.510052 13838 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:35.451998 14737 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.471431 14911 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.491335 14756 raft_consensus.cc:3060] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.425127 14887 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.492514 14645 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:12:35.527527 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 56460.6us
I20260709 12:12:35.544267 13913 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:35.540570 14884 consensus_meta.cc:287] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
W20260709 12:12:35.556963 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 74810.4us
I20260709 12:12:35.434989 14886 consensus_queue.cc:237] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.524739 14680 raft_consensus.cc:3055] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:35.562932 14884 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:35.564100 14909 log.cc:927] Time spent T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:12:35.564250 14849 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:35.565093 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 55149.6us
I20260709 12:12:35.565171 14921 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:35.566220 14884 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:35.567955 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.568987 13874 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:35.569563 14912 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:35.570163 14912 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.571805 14017 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:35.523002 14787 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.574290 14920 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:35.574438 14879 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:35.574935 14920 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.575775 14787 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:35.577214 14680 raft_consensus.cc:740] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:35.578250 14680 consensus_queue.cc:260] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.579816 14680 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.582111 14144 tablet_bootstrap.cc:492] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: No bootstrap required, opened a new log
I20260709 12:12:35.536867 14899 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:35.582916 14144 ts_tablet_manager.cc:1403] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent bootstrapping tablet: real 0.561s	user 0.015s	sys 0.016s
I20260709 12:12:35.583098 14899 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.561902 14514 consensus_queue.cc:260] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.585731 14873 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.590794 14917 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.587869 13946 raft_consensus.cc:1275] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:35.493217 14639 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.568452 14921 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:35.561213 14888 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:12:35.627030 13988 leader_election.cc:336] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927): Timed out: RequestConsensusVote RPC to 127.7.102.129:45927 timed out after 1.516s (SENT)
I20260709 12:12:35.627897 13837 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:35.630539 13988 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:35.608395 14802 consensus_meta.cc:287] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.789s	user 0.017s	sys 0.002s
I20260709 12:12:35.637368 14097 raft_consensus.cc:1240] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:35.600975 14911 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:35.638607 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 72521.9us
I20260709 12:12:35.641018 14093 raft_consensus.cc:2368] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:35.608726 14912 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:35.612386 14734 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
W20260709 12:12:35.665979 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.639912 13873 raft_consensus.cc:2393] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:35.646206 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:35.635567 14902 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:35.652204 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.539917 14897 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.653421 14895 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:35.650135 14780 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.636587 14479 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.555935 14779 consensus_queue.cc:237] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:35.649681 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 96832.5us
I20260709 12:12:35.635159 14849 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:35.658120 14889 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:35.710813 14849 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:35.666903 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.665115 14144 raft_consensus.cc:359] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.712579 14144 raft_consensus.cc:385] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.712955 14144 raft_consensus.cc:740] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.639644 14674 consensus_queue.cc:1059] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:12:35.713891 14144 consensus_queue.cc:260] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:35.705317 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.659497 14639 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:35.657740 14737 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.748375 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.752027 14514 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:35.754060 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:35.758780 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.760246 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.747062 14849 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.761973 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.744971 14091 raft_consensus.cc:1240] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:35.657388 14920 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.725510 14887 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:35.777132 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:35.744199 14897 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:35.742087 14479 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:35.711740 14913 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:35.770790 13986 leader_election.cc:400] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:35.699363 14097 raft_consensus.cc:1240] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:35.760254 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:35.707710 14911 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.705945 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.779028 14093 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:35.650504 14884 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:35.742776 14780 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:35.797585 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 170636us
I20260709 12:12:35.826046 14144 ts_tablet_manager.cc:1434] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent starting tablet: real 0.243s	user 0.019s	sys 0.000s
I20260709 12:12:35.771096 14757 raft_consensus.cc:3055] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:12:35.799237 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 45102.3us
W20260709 12:12:35.834296 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 290088us
I20260709 12:12:35.653862 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.657799 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.700291 14838 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.804335 13986 leader_election.cc:403] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:12:35.771559 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:35.856953 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 91440.3us
I20260709 12:12:35.833405 14757 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:35.858283 14889 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:35.810334 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 211946us
I20260709 12:12:35.863087 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.863804 13945 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.871138 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.786394 14925 consensus_queue.cc:1059] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:12:35.778041 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 156) took 1155 ms. Trace:
I20260709 12:12:35.872128 13865 rpcz_store.cc:276] 0709 12:12:34.622885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.633077 (+ 10192us) service_pool.cc:224] Handling call
0709 12:12:35.726787 (+1093710us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540026e654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:35.775964 (+ 49177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032021376}
I20260709 12:12:35.872728 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:35.873917 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.874884 13865 raft_consensus.cc:2393] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
W20260709 12:12:35.875296 14847 consensus_meta.cc:287] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.003s
I20260709 12:12:35.875803 14847 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:35.836731 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 197284us
I20260709 12:12:35.791410 13946 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
W20260709 12:12:35.838304 14063 leader_election.cc:343] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.837664 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.878881 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:35.880240 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.875869 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.640822 14802 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:35.815429 14911 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.659791 14734 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.871487 14841 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:35.885727 13912 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:35.889065 13945 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:35.819723 14906 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.903015 14063 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:35.905386 14096 raft_consensus.cc:2368] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2.
I20260709 12:12:35.906637 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.914507 13989 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:35.908056 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.910256 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.919911 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:35.920430 13838 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:35.920806 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:35.812486 14913 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:35.890228 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:35.921490 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:35.921972 13989 leader_election.cc:343] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.924347 13945 raft_consensus.cc:2393] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:35.816792 14899 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:35.930688 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 103711us
I20260709 12:12:35.836887 14780 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:35.946991 13838 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:35.911450 14911 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.924916 14849 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:35.926407 14873 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:35.927490 14645 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.959856 13949 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:35.887722 14929 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 12:12:35.962083 14740 consensus_meta.cc:287] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.005s
I20260709 12:12:35.973811 14146 tablet_bootstrap.cc:492] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:35.981827 14146 ts_tablet_manager.cc:1403] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 1.230s	user 0.013s	sys 0.010s
I20260709 12:12:35.951009 14921 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.942080 14022 raft_consensus.cc:2468] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:35.926033 14925 consensus_queue.cc:1059] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 12:12:35.926956 14906 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:35.963171 14849 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.967191 14939 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.009142 13949 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:35.969311 14674 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:36.017665 13913 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:35.955063 14930 consensus_queue.cc:1059] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.194s
W20260709 12:12:36.040458 13838 leader_election.cc:343] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:36.010607 14849 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:35.995296 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:35.998098 14944 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:36.011390 14864 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:35.996300 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.014776 14645 raft_consensus.cc:697] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:36.017246 14889 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:36.055955 13865 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:36.034466 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.075730 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.032840 14938 raft_consensus.cc:2804] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:12:36.075820 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.990856 14921 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.092312 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:36.061710 14787 consensus_queue.cc:1059] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:12:36.077935 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.082957 14876 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.103266 14927 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:36.109367 14938 raft_consensus.cc:697] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:36.125099 14905 consensus_queue.cc:1059] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:12:36.128369 14937 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.128961 14937 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.131505 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.133163 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.136587 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.137609 13940 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:36.138453 14930 raft_consensus.cc:3055] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:36.138911 14930 raft_consensus.cc:740] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.139782 14930 consensus_queue.cc:260] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.140712 14022 raft_consensus.cc:2393] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:36.140854 14645 consensus_queue.cc:237] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.141819 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.143177 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.098146 13872 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:36.144469 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.110010 14020 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:36.145125 13947 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.146910 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:36.129295 14921 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.147679 14093 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:36.149353 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 57217.4us
I20260709 12:12:36.147121 14899 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:36.167253 13988 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:36.168644 13988 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:36.170027 14950 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:36.170693 14950 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.131927 14938 consensus_queue.cc:237] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.173382 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.080135 14939 consensus_queue.cc:1059] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:12:36.174778 14939 raft_consensus.cc:3055] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:36.175189 14939 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.084299 14864 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.174782 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.179201 13945 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.116995 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.124390 14889 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:36.146931 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:36.179601 13840 leader_election.cc:343] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:36.183967 14930 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.167256 14899 raft_consensus.cc:3055] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:36.123812 14927 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:36.190081 14937 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:36.193156 14146 raft_consensus.cc:359] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.237108 14146 raft_consensus.cc:385] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:36.193379 14939 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.126732 14876 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.195134 14838 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.195221 14849 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.195848 14913 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:36.199904 14911 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.250200 13945 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:36.201076 14016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 199) took 1448 ms. Trace:
I20260709 12:12:36.201575 14906 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.126129 13943 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:36.203428 14864 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.182394 13947 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:36.131548 14847 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.183264 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:36.144483 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.237425 14146 raft_consensus.cc:740] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.252388 14063 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:36.229269 13871 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:36.238392 14128 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.7.102.190:35547, user_credentials={real_user=slave}} blocked reactor thread for 53768.2us
I20260709 12:12:36.227171 14899 raft_consensus.cc:740] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.239703 14927 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:36.380421 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 128154us
W20260709 12:12:36.378309 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 195242us
I20260709 12:12:36.368585 14018 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:36.363453 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.403537 14063 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:36.377101 14019 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:36.391674 14146 consensus_queue.cc:260] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.379966 14889 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:36.412701 14847 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:36.392928 14838 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:36.403337 14639 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.413332 14921 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.507659 13943 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:36.497761 14756 consensus_meta.cc:287] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.003s
I20260709 12:12:36.363938 14016 rpcz_store.cc:276] 0709 12:12:34.753052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.837912 (+ 84860us) service_pool.cc:224] Handling call
0709 12:12:34.908621 (+ 70709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.439744 (+531123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.200784 (+761040us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54008e80d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:36.201004 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046593920}
W20260709 12:12:36.526047 14680 consensus_meta.cc:287] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.005s
I20260709 12:12:36.541870 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:36.517218 14838 raft_consensus.cc:697] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:36.543442 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.530759 14895 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.544495 14838 consensus_queue.cc:237] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.545109 14895 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.546656 14015 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:36.547497 14895 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.547892 13869 raft_consensus.cc:1275] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:36.548462 14954 log.cc:927] Time spent T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:12:36.522307 14921 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.511655 14899 consensus_queue.cc:260] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.552002 14899 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.553037 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51076 (request call id 158) took 1231 ms. Trace:
I20260709 12:12:36.553632 14020 rpcz_store.cc:276] 0709 12:12:35.321758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.327221 (+  5463us) service_pool.cc:224] Handling call
0709 12:12:35.503890 (+176669us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:36.552771 (+1048881us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54004326d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.552945 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604893312}
I20260709 12:12:36.533852 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.557631 13866 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:36.563851 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.566414 13865 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:36.530275 14801 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.567696 14801 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.569901 14801 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.573786 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.574553 14022 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:36.584128 13988 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:36.585994 13988 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:36.506295 14146 ts_tablet_manager.cc:1434] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.524s	user 0.009s	sys 0.000s
I20260709 12:12:36.424579 14864 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.511401 14847 raft_consensus.cc:697] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:36.507805 14639 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:36.608237 14146 ts_tablet_manager.cc:1467] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Tablet startup took 626ms
I20260709 12:12:36.612691 14950 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:36.609421 14750 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:36.552044 14094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 168) took 1100 ms. Trace:
I20260709 12:12:36.633884 14921 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.639494 14734 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.639364 14927 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.641551 14750 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.661059 14750 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:36.619728 14146 ts_tablet_manager.cc:1469] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Trace:
0709 12:12:16.405969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.406182 (+   213us) service_pool.cc:224] Handling call
0709 12:12:16.433488 (+ 27306us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:12:16.433583 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:12:16.454439 (+ 20856us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:16.583129 (+128690us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:16.725706 (+142577us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501f1a2 00007fce3df60889 00007fce3d091d88 00007fce3d158973 00007fce3d15470f 00007fce3d154ecd 00007fce3d103400 00007fce36588af4 00007fce36588a82
0709 12:12:16.725978 (+   272us) inbound_call.cc:177] Queueing success response
0709 12:12:34.751267 (+18025289us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:35.982257 (+1230990us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:36.129312 (+147055us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:36.129944 (+   632us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":25317,"raft.queue_time_us":245,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":46326,"spinlock_wait_cycles":3503872,"tablet-open.queue_time_us":18025323}
I20260709 12:12:36.646466 14849 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.641916 14094 rpcz_store.cc:276] 0709 12:12:35.451216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.455606 (+  4390us) service_pool.cc:224] Handling call
0709 12:12:35.509958 (+ 54352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.606625 (+ 96667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.612826 (+  6201us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.718181 (+105355us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.175833 (+457652us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:12:36.182525 (+  6692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.205428 (+ 22903us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.551787 (+346359us) raft_consensus.cc:1685] finished
0709 12:12:36.551809 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.551977 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6902,"raft.queue_time_us":36008,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":11171,"thread_start_us":242815,"threads_started":1,"wal-append.queue_time_us":430148}
I20260709 12:12:36.613242 14864 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:36.670158 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 73268.7us
I20260709 12:12:36.664922 14876 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:36.678174 14146 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:36.680311 14018 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:36.673352 14911 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.672188 14514 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:36.683306 13942 raft_consensus.cc:1240] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.726045 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.727891 14934 raft_consensus.cc:3055] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:36.728369 14934 raft_consensus.cc:740] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.676158 14847 consensus_queue.cc:237] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.731315 14092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 171) took 1275 ms. Trace:
I20260709 12:12:36.688472 14514 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.741490 14023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 183) took 1305 ms. Trace:
I20260709 12:12:36.742075 14023 rpcz_store.cc:276] 0709 12:12:35.435992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.436520 (+   528us) service_pool.cc:224] Handling call
0709 12:12:35.436998 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.455138 (+ 18140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.455192 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.455761 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.204033 (+748272us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b180025bf40. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35038e07 00007fce3de939a9 00007fce3505569b 00007fce3505393f 00007fce35055c02 00007fce37cdd20b 00007fce37ce2d23 00007fce37ce30d1 00007fce380fea0f
0709 12:12:36.643415 (+439382us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:12:36.643467 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.643545 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.738312 (+ 94767us) raft_consensus.cc:1685] finished
0709 12:12:36.738349 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.741393 (+  3044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17630,"raft.queue_time_us":17793,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7522,"spinlock_wait_cycles":2964736,"thread_start_us":439184,"threads_started":1,"wal-append.queue_time_us":1223084}
I20260709 12:12:36.734300 14092 rpcz_store.cc:276] 0709 12:12:35.456178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.459931 (+  3753us) service_pool.cc:224] Handling call
0709 12:12:36.729618 (+1269687us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:36.729826 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.730050 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.730084 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.730155 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:36.730195 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.730258 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.731230 (+   972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7031552}
I20260709 12:12:36.747604 14864 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.748222 14904 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.748945 14757 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.749758 14927 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:36.749230 14904 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.750476 14757 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.752760 14017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 187) took 1161 ms. Trace:
I20260709 12:12:36.753216 14017 rpcz_store.cc:276] 0709 12:12:35.591711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.618599 (+ 26888us) service_pool.cc:224] Handling call
0709 12:12:36.751917 (+1133318us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:36.752133 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.752332 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.752358 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.752420 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:36.752451 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.752538 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.752692 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5389056}
I20260709 12:12:36.754752 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.755427 14017 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:36.759341 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.759456 14849 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.760277 14849 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:36.761729 14964 log.cc:927] Time spent T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:12:36.762305 14514 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.762790 14849 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:36.756929 14904 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:36.764299 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.765116 14802 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:36.765892 14023 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:36.766430 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 185) took 1101 ms. Trace:
W20260709 12:12:36.767273 14930 consensus_meta.cc:287] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:12:36.766901 13865 rpcz_store.cc:276] 0709 12:12:35.664796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.875563 (+210767us) service_pool.cc:224] Handling call
0709 12:12:36.766208 (+890645us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400884ad4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.766361 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311274752}
I20260709 12:12:36.768275 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.769574 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.770709 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.771874 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:36.763839 14953 log.cc:927] Time spent T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.557s	user 0.000s	sys 0.013s
I20260709 12:12:36.767273 14023 raft_consensus.cc:1275] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:36.778278 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.779218 13866 raft_consensus.cc:2393] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:36.779870 14146 tablet_bootstrap.cc:654] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:36.780109 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.780424 14088 raft_consensus.cc:1240] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.772290 14019 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:36.780848 14639 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:36.781199 14088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 187) took 1307 ms. Trace:
I20260709 12:12:36.781579 14088 rpcz_store.cc:276] 0709 12:12:35.474121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.482592 (+  8471us) service_pool.cc:224] Handling call
0709 12:12:36.779935 (+1297343us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:36.780142 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.780949 (+   807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.781147 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19875584}
I20260709 12:12:36.782441 14023 raft_consensus.cc:1275] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:36.783505 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.793702 13865 raft_consensus.cc:2393] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:36.791097 14934 consensus_queue.cc:260] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:36.791846 14886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.007s	sys 0.041s
W20260709 12:12:36.797672 14886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.007s	sys 0.042s
I20260709 12:12:36.802472 14780 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.803236 13871 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:36.803838 13871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 179) took 1160 ms. Trace:
I20260709 12:12:36.796505 14934 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.809551 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 189) took 1148 ms. Trace:
I20260709 12:12:36.809993 14015 rpcz_store.cc:276] 0709 12:12:35.661613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.813126 (+151513us) service_pool.cc:224] Handling call
0709 12:12:36.809355 (+996229us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400063954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.809486 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541866880}
I20260709 12:12:36.790776 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.815021 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.815855 14014 raft_consensus.cc:2393] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:36.816277 14014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 188) took 1158 ms. Trace:
I20260709 12:12:36.816620 14014 rpcz_store.cc:276] 0709 12:12:35.658325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.658546 (+   221us) service_pool.cc:224] Handling call
0709 12:12:36.814853 (+1156307us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:36.816216 (+  1363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9044736}
I20260709 12:12:36.817179 13872 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
W20260709 12:12:36.818204 14096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37108 (request call id 184) took 1874 ms (client timeout 1506 ms). Trace:
W20260709 12:12:36.818728 14096 rpcz_store.cc:269] 0709 12:12:34.943374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.980102 (+ 36728us) service_pool.cc:224] Handling call
0709 12:12:36.817970 (+1837868us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54002eefd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.818128 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585554688}
W20260709 12:12:36.820063 13840 leader_election.cc:343] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:36.822515 14514 consensus_queue.cc:1059] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:36.823632 14867 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:36.823745 14514 raft_consensus.cc:3055] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:36.824297 14514 raft_consensus.cc:740] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.825210 14514 consensus_queue.cc:260] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.825747 13872 raft_consensus.cc:1240] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.826508 14514 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.826581 13869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 182) took 1163 ms. Trace:
I20260709 12:12:36.827281 13872 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:36.831136 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.831913 14020 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.834782 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:36.835620 14089 raft_consensus.cc:2368] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:36.836026 14089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37120 (request call id 167) took 1385 ms. Trace:
I20260709 12:12:36.836321 14089 rpcz_store.cc:276] 0709 12:12:35.450921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.455882 (+  4961us) service_pool.cc:224] Handling call
0709 12:12:36.834618 (+1378736us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:36.835968 (+  1350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16285568}
I20260709 12:12:36.837914 14848 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:36.839007 13873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 113) took 1771 ms (client timeout 2124 ms). Trace:
W20260709 12:12:36.839417 13873 rpcz_store.cc:269] 0709 12:12:35.067638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.085448 (+ 17810us) service_pool.cc:224] Handling call
0709 12:12:36.838782 (+1753334us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540074ead4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.838949 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776731520}
I20260709 12:12:36.804167 13871 rpcz_store.cc:276] 0709 12:12:35.643202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.963074 (+319872us) service_pool.cc:224] Handling call
0709 12:12:36.146843 (+183769us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ef8c 00007fce3501eef6 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:36.803776 (+656933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44938624}
I20260709 12:12:36.842705 13865 raft_consensus.cc:1240] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.848260 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.850538 13912 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:36.851154 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.851320 14734 consensus_queue.cc:1059] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:36.851878 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.852100 13944 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.853072 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.853991 13943 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 0.
I20260709 12:12:36.854429 14750 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.855172 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:36.855682 14016 raft_consensus.cc:2393] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:36.855547 14802 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:36.856444 14802 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.856858 14802 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.857271 14927 raft_consensus.cc:3055] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:36.857722 14927 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:36.858709 14927 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.860038 14927 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.827210 13869 rpcz_store.cc:276] 0709 12:12:35.663629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.992644 (+329015us) service_pool.cc:224] Handling call
0709 12:12:36.057040 (+ 64396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.548328 (+491288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.826242 (+277914us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540078b754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:36.826471 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108647808}
I20260709 12:12:36.863469 14019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51082 (request call id 192) took 1005 ms. Trace:
I20260709 12:12:36.863934 14019 rpcz_store.cc:276] 0709 12:12:35.858030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.071453 (+213423us) service_pool.cc:224] Handling call
0709 12:12:36.863272 (+791819us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400433fd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.863401 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385428352}
I20260709 12:12:36.853183 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:36.869501 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.870501 13870 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
W20260709 12:12:36.873924 13989 leader_election.cc:343] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:36.874046 14886 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.874701 14886 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:36.877127 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.877555 13989 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:36.878067 13868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 180) took 1234 ms (client timeout 1553 ms). Trace:
I20260709 12:12:36.878490 14864 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:36.878973 14864 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.879343 14864 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:36.878456 13868 rpcz_store.cc:269] 0709 12:12:35.643469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.818402 (+174933us) service_pool.cc:224] Handling call
0709 12:12:36.876929 (+1058527us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:36.878008 (+  1079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31943424}
I20260709 12:12:36.881471 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:36.882051 13874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 99) took 1952 ms (client timeout 2132 ms). Trace:
W20260709 12:12:36.882612 13874 rpcz_store.cc:269] 0709 12:12:34.930238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.938901 (+  8663us) service_pool.cc:224] Handling call
0709 12:12:36.881815 (+1942914us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54003cc8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:36.881980 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265241472}
I20260709 12:12:36.883177 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.884120 13872 raft_consensus.cc:1240] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:36.885207 14021 raft_consensus.cc:1275] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:36.888720 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 155672us
I20260709 12:12:36.891578 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.892237 13865 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.894744 14020 raft_consensus.cc:2468] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:36.895684 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:36.897260 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.897696 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.897941 14014 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:36.900903 13913 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:36.900928 14021 raft_consensus.cc:1240] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.902019 14734 consensus_queue.cc:1059] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:36.902766 14864 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.903889 14017 raft_consensus.cc:2368] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:36.904822 14780 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:36.905110 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.905349 14921 raft_consensus.cc:3055] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:36.905906 14921 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:36.906131 13874 raft_consensus.cc:2393] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:36.906507 14864 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.864447 14802 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.905200 14780 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.908034 14780 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.908218 14917 raft_consensus.cc:3055] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:36.905687 14699 raft_consensus.cc:3055] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:36.908934 14699 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.909428 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.909763 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.910316 13867 raft_consensus.cc:2393] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:36.910039 14699 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:36.910651 13869 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.908887 14917 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:36.911549 14699 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.912178 14917 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.913386 14917 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:36.882279 14019 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:36.906914 14921 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:36.904381 14734 consensus_queue.cc:1048] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:12:36.916905 14802 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.925181 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:36.953658 14091 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 0.
I20260709 12:12:36.925901 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:36.955397 14096 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:36.930967 14939 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.931356 14062 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:36.931404 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:36.962163 13868 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:36.908215 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:36.974777 13868 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:36.975711 14841 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:12:36.976845 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 45604.1us
I20260709 12:12:36.977473 14903 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.019407 14913 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:37.019965 14913 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.021601 14479 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.022233 14913 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.022498 14479 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.024536 14062 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.025534 14617 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:37.025852 14062 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.026010 14479 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:37.027088 14062 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.027935 14479 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.978271 13838 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:36.988116 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.031713 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 53617.6us
I20260709 12:12:37.031898 14699 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.032539 13838 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.033520 14699 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.997529 14920 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:36.999612 14867 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:37.034024 13838 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.034771 14934 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.035837 13838 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.036717 14934 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.038725 13838 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:36.932116 14911 consensus_queue.cc:1059] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:12:37.045352 14886 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:37.046161 14911 raft_consensus.cc:3055] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:36.932181 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.047081 13871 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:36.932229 13867 raft_consensus.cc:1275] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:36.934341 14097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 190) took 1218 ms. Trace:
I20260709 12:12:36.935632 14088 raft_consensus.cc:1240] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:36.936748 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.049909 14092 raft_consensus.cc:2393] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:37.050768 14617 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.937520 13866 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:36.938107 14921 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.048455 14097 rpcz_store.cc:276] 0709 12:12:35.715574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.813482 (+ 97908us) service_pool.cc:224] Handling call
0709 12:12:35.813887 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.867796 (+1053909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.867841 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.867902 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:36.867947 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.934064 (+ 66117us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540057f654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:36.934112 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.934263 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423087360}
I20260709 12:12:37.046557 14911 raft_consensus.cc:740] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:37.054576 14911 consensus_queue.cc:260] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:37.056223 14911 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:36.942139 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.944044 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.057597 14094 raft_consensus.cc:2410] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:36.945024 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:37.058526 14017 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.059669 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.946461 14016 raft_consensus.cc:1275] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:36.945240 14897 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.061573 14897 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:36.943586 14734 consensus_queue.cc:1059] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:12:36.950155 14780 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.064777 14965 raft_consensus.cc:3055] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.065410 14965 raft_consensus.cc:740] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:37.066612 14965 consensus_queue.cc:260] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.068512 14965 raft_consensus.cc:3060] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.069902 14897 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.072082 13768 catalog_manager.cc:5697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 2, leader changed from 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131) to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 2 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.947582 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:36.924171 14089 raft_consensus.cc:1275] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:12:36.949797 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 92677.4us
I20260709 12:12:37.077916 14802 consensus_queue.cc:1059] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.079378 14089 raft_consensus.cc:1275] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:37.083062 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.083737 14089 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:37.085322 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.085770 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.084748 14020 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 0.
I20260709 12:12:37.086818 13986 leader_election.cc:400] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:37.087404 13986 leader_election.cc:403] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.091078 14780 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:36.943403 13913 leader_election.cc:400] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.092875 13913 leader_election.cc:403] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:12:37.093917 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 150638us
I20260709 12:12:37.096418 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:37.097081 14021 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.099954 14146 tablet_bootstrap.cc:492] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:37.100687 14146 ts_tablet_manager.cc:1403] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.425s	user 0.049s	sys 0.073s
I20260709 12:12:37.101011 14780 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:37.102180 13913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.102631 13869 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
W20260709 12:12:37.103636 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 47413.7us
I20260709 12:12:37.028306 14062 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.040818 14750 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.041464 13870 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.104529 13988 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.076061 13768 catalog_manager.cc:5697] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:37.106329 14920 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:37.106475 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 78254.3us
I20260709 12:12:37.003645 14061 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:37.058171 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:37.107682 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 107177us
I20260709 12:12:37.107856 14018 raft_consensus.cc:2393] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:37.109433 14061 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:37.079488 14802 raft_consensus.cc:3055] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.110285 14802 raft_consensus.cc:740] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:37.110491 14867 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:37.111168 14867 raft_consensus.cc:697] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:37.111402 14802 consensus_queue.cc:260] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.042429 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.112169 14867 consensus_queue.cc:237] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:37.112812 14802 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.109453 14920 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:37.113912 14062 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.114606 14920 raft_consensus.cc:697] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:37.114785 14848 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.116946 13944 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:37.120081 14950 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:37.106513 13768 catalog_manager.cc:5697] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.122716 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.122905 13768 catalog_manager.cc:5697] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 3, leader changed from 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131) to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.123792 14094 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:37.115981 14920 consensus_queue.cc:237] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.130367 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.131604 14097 raft_consensus.cc:2368] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.132299 13770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38496 (request call id 54) took 8875 ms. Trace:
I20260709 12:12:37.133361 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.126288 13988 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.144308 13986 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:37.151633 13988 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.124435 14897 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.137873 13768 catalog_manager.cc:5697] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } }
W20260709 12:12:37.130627 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.015746 14925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.009s	sys 0.018s
I20260709 12:12:37.155862 14063 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:37.159754 13768 catalog_manager.cc:5697] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 reported cstate change: term changed from 1 to 2, leader changed from 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 2 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:37.162040 14062 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:36.931793 13865 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:37.165242 14061 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.173467 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.174691 14062 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.173185 14757 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.181856 14757 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.179875 14950 consensus_queue.cc:1059] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:12:37.184933 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.185990 13947 raft_consensus.cc:2393] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
W20260709 12:12:37.180152 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.139750 13770 rpcz_store.cc:276] 0709 12:12:28.256441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.256700 (+   259us) service_pool.cc:224] Handling call
0709 12:12:37.132196 (+8875496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:35.364958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:35.365540 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:35.365589 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:12:35.365612 (+    23us) tablet.cc:662] Decoding operations
0709 12:12:35.366284 (+   672us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:35.366378 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:35.366416 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:35.366895 (+   479us) tablet.cc:701] Row locks acquired
0709 12:12:35.366934 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:12:35.367110 (+   176us) write_op.cc:270] Start()
0709 12:12:35.367268 (+   158us) write_op.cc:276] Timestamp: P: 1783599155367049 usec, L: 0
0709 12:12:35.367310 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:12:35.367996 (+   686us) log.cc:844] Serialized 1705 byte log entry
0709 12:12:36.113270 (+745274us) op_driver.cc:464] REPLICATION: finished
0709 12:12:36.471366 (+358096us) write_op.cc:301] APPLY: starting
0709 12:12:36.494710 (+ 23344us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:36.508840 (+ 14130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:36.508992 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:36.509853 (+   861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:36.510155 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:12:36.510226 (+    71us) write_op.cc:312] APPLY: finished
0709 12:12:36.510618 (+   392us) log.cc:844] Serialized 40 byte log entry
0709 12:12:36.510851 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:36.510964 (+   113us) write_op.cc:454] Released schema lock
0709 12:12:36.511075 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:36.534111 (+ 23036us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:36.537419 (+  3308us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":162120,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":270434,"apply.run_cpu_time_us":3320,"apply.run_wall_time_us":99778,"num_ops":4,"prepare.queue_time_us":118120,"prepare.run_cpu_time_us":29363,"prepare.run_wall_time_us":125186,"raft.queue_time_us":306254,"raft.run_cpu_time_us":21093,"raft.run_wall_time_us":143636,"replication_time_us":717279,"thread_start_us":420624,"threads_started":4,"wal-append.queue_time_us":339836}]]}
I20260709 12:12:37.180217 14884 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:12:37.173678 14841 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.185938 14950 raft_consensus.cc:3055] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.192072 14950 raft_consensus.cc:740] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:37.193143 13988 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:37.193050 14950 consensus_queue.cc:260] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:37.159977 14925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.010s	sys 0.018s
W20260709 12:12:37.195039 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 156374us
I20260709 12:12:37.196201 14146 raft_consensus.cc:359] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.197042 14146 raft_consensus.cc:385] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:37.197381 14146 raft_consensus.cc:740] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.197784 13913 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:37.198365 14062 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.199790 14063 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:37.159220 14750 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.170010 14847 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:37.203620 13912 leader_election.cc:400] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.155180 14886 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.165001 14889 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:37.214047 14146 consensus_queue.cc:260] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.170349 14913 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.224277 13912 leader_election.cc:403] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.207695 13838 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:37.233060 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:37.234596 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52945.1us
I20260709 12:12:37.180755 14905 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.202543 14639 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.251977 14617 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:37.249267 13838 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.215842 14699 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:37.223495 14740 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:37.184578 14757 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:37.247359 14903 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.224072 14847 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.252198 14975 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.234978 14884 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:37.270393 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 207244us
I20260709 12:12:37.223786 14950 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.215188 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.271956 14740 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.250412 14889 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:37.275614 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 82545.9us
I20260709 12:12:37.216095 14734 consensus_queue.cc:1048] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:12:37.257179 14021 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:37.270535 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.252485 14876 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.255368 14930 raft_consensus.cc:2804] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.223170 14927 consensus_queue.cc:1048] T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:12:37.234247 14645 consensus_queue.cc:1059] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:12:37.260646 14849 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.284195 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.234511 14966 consensus_queue.cc:1048] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:12:37.301941 14889 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:37.299371 14089 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:37.298807 14740 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:37.313560 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:37.317405 14978 log.cc:927] Time spent T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:12:37.317857 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.308794 14886 consensus_queue.cc:1059] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:37.319463 14886 raft_consensus.cc:3055] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:37.319850 14886 raft_consensus.cc:740] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:37.320818 14886 consensus_queue.cc:260] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.258054 14905 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.270448 14699 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.303504 13913 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:37.305533 14876 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.357667 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.358736 13948 raft_consensus.cc:2393] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:37.359887 14876 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.284561 14847 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:37.284883 14884 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:37.364962 14884 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.365173 14966 raft_consensus.cc:3055] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.365610 14966 raft_consensus.cc:740] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:37.366595 14966 consensus_queue.cc:260] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.310046 14849 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.270184 14674 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:37.300622 13988 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:37.369306 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68773us
W20260709 12:12:37.372315 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.296231 14146 ts_tablet_manager.cc:1434] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.195s	user 0.013s	sys 0.000s
I20260709 12:12:37.273645 14801 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.329133 14514 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.329604 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.382933 13914 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.402772 13947 raft_consensus.cc:2393] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:37.329829 14930 raft_consensus.cc:697] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:37.329988 13943 raft_consensus.cc:1240] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:37.321841 14934 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.355345 14699 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.410244 14849 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.411559 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:37.359935 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.412652 14934 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:37.413187 14091 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.413975 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.414180 14921 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.374307 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.415150 14934 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.287415 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.308089 14017 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:37.333473 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.416071 13948 raft_consensus.cc:2410] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:37.334643 14780 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.292032 14975 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.415189 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:37.402269 14927 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:37.418442 14966 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.418823 14975 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.335413 14740 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.420974 14740 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.339814 13871 raft_consensus.cc:1275] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.340572 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.422801 14092 raft_consensus.cc:3060] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.401995 14864 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.425112 14864 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:37.413296 14930 consensus_queue.cc:237] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.425550 14864 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.341233 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.345806 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.421141 14146 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: Bootstrap starting.
I20260709 12:12:37.344940 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:37.429858 13874 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:37.416098 13868 raft_consensus.cc:2393] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:37.341768 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.347508 14941 raft_consensus.cc:3055] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.430810 14941 raft_consensus.cc:740] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:37.432217 14927 raft_consensus.cc:697] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:37.345386 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:37.432610 14847 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:37.357301 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 53937.1us
I20260709 12:12:37.433274 14927 consensus_queue.cc:237] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.348194 14905 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:37.323377 14757 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.437022 14757 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.414700 14096 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.439481 14757 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.409657 14889 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.406885 14514 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:37.299737 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.431824 14941 consensus_queue.cc:260] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.433152 13867 raft_consensus.cc:2368] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.348938 14886 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.379247 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.441509 13914 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:37.468196 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 217977us
I20260709 12:12:37.464290 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.469122 13914 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.444084 13913 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:37.468381 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 264922us
I20260709 12:12:37.470317 13912 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.406800 14617 raft_consensus.cc:697] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:37.461441 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.476683 13912 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.477020 13914 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.479472 13914 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.471782 14740 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.487262 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:37.487387 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.488654 14014 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
W20260709 12:12:37.484246 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.490986 14514 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.467849 14950 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.497718 13914 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.471956 14780 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:37.468158 14985 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.507784 14063 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.479044 14801 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.479274 14802 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.513321 14941 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.536849 14617 consensus_queue.cc:237] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.539443 14699 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:37.540870 14740 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.542364 14884 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.512213 14950 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.547869 14674 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.551213 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.552100 14018 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:37.483807 14915 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.530824 14985 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.542423 14780 raft_consensus.cc:697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:37.555362 14985 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.556005 14645 consensus_queue.cc:1048] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:37.556242 14780 consensus_queue.cc:237] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.534942 13914 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.562394 13988 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:37.566529 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 59003.8us
I20260709 12:12:37.567706 14062 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:37.563517 13838 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:37.572758 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 65073.8us
I20260709 12:12:37.581420 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.585378 14146 tablet_bootstrap.cc:654] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:37.586004 14097 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:37.584354 13838 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:37.591528 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 56713.9us
I20260709 12:12:37.592700 13914 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:37.595019 13913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.513959 14965 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.602916 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.602075 14920 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:37.613492 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.610123 13914 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.621853 14062 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.625857 14062 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:37.634343 13914 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.639950 13914 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.589735 14802 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.598294 14750 raft_consensus.cc:2749] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.597939 14930 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:37.606696 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.613866 14096 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:37.614954 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:37.648620 14740 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.649322 14091 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:37.609340 14801 raft_consensus.cc:2764] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:37.608256 14847 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:37.635293 14903 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.635613 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.614159 14921 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.609928 14920 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:37.607237 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.653167 14092 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:37.613893 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.613384 14993 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:37.635361 14911 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.658259 14950 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.612259 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:37.613015 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:37.648487 14884 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.611814 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:37.660009 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:37.675007 13940 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:37.629772 14848 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:37.629521 14915 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:37.603726 14987 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:37.615236 14639 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:12:37.680472 14986 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.680212 14988 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:37.681780 14904 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:37.708469 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68591.8us
I20260709 12:12:37.733291 13914 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.707064 14993 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.740111 14993 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.717680 14889 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.760035 13914 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.719513 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:37.761843 13866 raft_consensus.cc:2410] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:12:37.734982 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 109220us
W20260709 12:12:37.754225 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 191897us
I20260709 12:12:37.769822 13986 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:37.743645 14987 raft_consensus.cc:697] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:37.729442 14780 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.723871 13868 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:37.714859 14911 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.736826 14988 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:37.729281 13867 raft_consensus.cc:2376] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2. Re-sending same reply.
W20260709 12:12:37.739097 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 114759us
I20260709 12:12:37.758510 14928 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.771481 14889 raft_consensus.cc:2804] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:37.773138 13914 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.768406 14915 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.797523 14062 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:37.803061 13914 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.759516 14699 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:37.766513 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.774957 14801 consensus_queue.cc:1048] T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:12:37.808837 13914 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.807742 13988 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:37.854142 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 54756.9us
I20260709 12:12:37.800791 14988 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:37.804419 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.796681 13946 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:37.808621 14802 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:37.862155 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 64743.8us
I20260709 12:12:37.867926 14062 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:37.864916 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 57326us
I20260709 12:12:37.861433 15009 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.815724 14911 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:37.850069 14889 raft_consensus.cc:697] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
W20260709 12:12:37.877040 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.868677 14838 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:12:37.852471 14092 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:37.876245 14479 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.852540 14965 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.801810 14780 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.807741 14849 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:12:37.862020 14915 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.889022 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 80244.6us
W20260709 12:12:37.877192 15015 log.cc:927] Time spent T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:12:37.866694 14985 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:37.912910 15002 log.cc:927] Time spent T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.324s	user 0.005s	sys 0.000s
I20260709 12:12:37.907099 13914 leader_election.cc:400] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:37.883845 14928 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.922972 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:37.924163 14015 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
W20260709 12:12:37.925197 15005 log.cc:927] Time spent T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:12:37.928660 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.929610 13943 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:37.929713 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:37.931447 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.932073 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:37.912833 14985 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.933421 14886 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.933647 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:37.933970 14966 consensus_queue.cc:1048] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:37.902168 14094 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:37.887465 14987 consensus_queue.cc:237] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.935061 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:37.938922 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.940348 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:37.942447 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.944010 14740 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:37.966265 14097 raft_consensus.cc:1240] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:37.945103 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.946059 14089 raft_consensus.cc:1240] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:37.898985 15012 log.cc:927] Time spent T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.127s	user 0.001s	sys 0.001s
I20260709 12:12:37.973259 14780 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:37.974210 13941 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:37.947134 14915 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:37.900453 13988 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:37.977376 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 76997.2us
I20260709 12:12:37.978044 14889 consensus_queue.cc:237] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:37.910691 15013 log.cc:927] Time spent T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:12:37.908618 15004 log.cc:927] Time spent T f415f012981848b3aedcb29bc5e00e4b P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:12:37.966454 14928 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:37.982967 14928 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:37.962256 14093 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:37.964123 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:37.899173 15009 raft_consensus.cc:697] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:37.945271 14091 raft_consensus.cc:1240] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:37.952090 14985 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:37.969455 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.978456 14886 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:12:37.949079 13989 leader_election.cc:343] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.950196 14921 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:37.969334 14920 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:37.949225 14950 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:37.998605 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 49566.8us
I20260709 12:12:37.997064 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:37.977448 14915 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:38.015187 13989 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.010329 13943 raft_consensus.cc:2393] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:38.006557 14921 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.021059 13989 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:38.022593 13989 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.019116 14876 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.013512 14886 raft_consensus.cc:697] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
W20260709 12:12:38.024735 14864 consensus_meta.cc:287] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.003s
I20260709 12:12:38.025187 14950 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:38.024787 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.032166 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.041836 14015 raft_consensus.cc:1275] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.028779 14966 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:38.040799 14864 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.034807 13870 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
W20260709 12:12:38.047488 14999 log.cc:927] Time spent T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.437s	user 0.003s	sys 0.000s
I20260709 12:12:38.048616 14864 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:38.051014 13869 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:38.057922 14886 consensus_queue.cc:237] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.062076 13912 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.069486 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.072558 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:38.074512 15003 log.cc:927] Time spent T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.218s	user 0.000s	sys 0.003s
I20260709 12:12:38.073534 14965 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:38.041899 15009 consensus_queue.cc:237] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:38.077769 15014 log.cc:927] Time spent T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260709 12:12:38.044116 14950 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.038311 14928 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.082280 14950 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:38.109604 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.112426 13949 raft_consensus.cc:1275] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.113036 13988 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:38.114214 13988 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:38.117339 14146 tablet_bootstrap.cc:492] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: No bootstrap required, opened a new log
I20260709 12:12:38.117821 14146 ts_tablet_manager.cc:1403] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: Time spent bootstrapping tablet: real 0.697s	user 0.019s	sys 0.035s
I20260709 12:12:38.098266 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:38.119892 14750 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:38.120535 14091 raft_consensus.cc:1275] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.121587 13837 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.129504 13986 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.134737 14757 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.118857 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:38.119174 14864 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:38.141916 14876 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:38.147621 15016 log.cc:927] Time spent T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:12:38.148509 13948 raft_consensus.cc:1275] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.151089 14802 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.157158 14674 raft_consensus.cc:2749] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:38.157618 14017 raft_consensus.cc:1275] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.157974 14911 consensus_queue.cc:1048] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:38.164773 14802 consensus_queue.cc:1048] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:38.168072 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:38.133136 14941 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:38.169925 14750 raft_consensus.cc:697] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:38.128118 14989 consensus_queue.cc:1048] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:12:38.170419 14802 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.174893 13943 raft_consensus.cc:2393] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:38.137975 14930 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.137538 14905 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:38.139532 14757 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.171682 13944 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 1: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:38.177809 14993 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.185616 14930 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.187721 14146 raft_consensus.cc:359] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.195814 14146 raft_consensus.cc:385] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:38.196080 14146 raft_consensus.cc:740] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.193061 13945 raft_consensus.cc:1275] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:12:38.193111 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 62269.4us
I20260709 12:12:38.203235 14146 consensus_queue.cc:260] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.180943 14941 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.242296 14146 ts_tablet_manager.cc:1434] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.003s
W20260709 12:12:38.243986 15021 log.cc:927] Time spent T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:12:38.246093 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 46600.2us
W20260709 12:12:38.247004 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 125484us
I20260709 12:12:38.177767 14750 consensus_queue.cc:237] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.191215 14802 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:38.193442 14905 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:38.244059 15022 log.cc:927] Time spent T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:12:38.253664 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.267072 13945 raft_consensus.cc:1275] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.268392 15025 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:38.269146 15025 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.271353 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:38.246615 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.244977 14699 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.273313 14699 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.275539 14699 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.258249 14930 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.258982 14867 consensus_queue.cc:1048] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:38.277804 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.278600 13869 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:38.280612 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.280797 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:38.281579 13870 raft_consensus.cc:2393] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:38.285050 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.285455 14802 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:38.259419 14986 consensus_meta.cc:287] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:12:38.287161 14986 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.240092 14514 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.288718 14514 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.290992 14514 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:38.306777 13914 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.271564 15025 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.293641 14063 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:38.239684 14864 raft_consensus.cc:697] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:38.205705 14985 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:38.314442 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 60849.7us
I20260709 12:12:38.319365 13837 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.321805 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.322714 13949 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:38.253235 14915 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:38.338310 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.349511 14021 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:38.336898 14734 consensus_queue.cc:1048] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:12:38.342232 14911 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:38.285454 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.344910 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.345649 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.345731 14921 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.346388 14757 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.337766 13869 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:38.347783 14993 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:38.350839 13840 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:38.322373 14987 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:38.330390 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.363915 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.330502 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.339674 14801 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:38.314292 15010 consensus_queue.cc:1048] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 12:12:38.419399 14022 raft_consensus.cc:1240] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
W20260709 12:12:38.437534 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 118274us
W20260709 12:12:38.438572 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 87820.1us
I20260709 12:12:38.410408 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.419109 15025 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:38.446131 13837 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.451689 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.373482 14514 consensus_queue.cc:1048] T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:12:38.428372 14801 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:38.355278 14915 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:38.374159 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:38.466138 13945 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:38.436769 14089 raft_consensus.cc:2393] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:38.459762 13872 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:38.441105 13942 raft_consensus.cc:1240] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:38.462725 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.433269 14090 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:38.462054 13837 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.474045 14021 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:38.348989 15011 consensus_queue.cc:1048] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.145s
I20260709 12:12:38.465382 14801 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.431989 13874 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:38.437413 14674 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:38.488232 14674 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:38.472730 14988 consensus_meta.cc:287] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 12:12:38.486523 15027 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:38.466641 15025 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.460582 14018 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:38.506553 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:38.507158 14757 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.507730 14921 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.475041 14017 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:38.489358 13870 raft_consensus.cc:2393] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:38.485049 14088 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:38.511206 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.511654 14645 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.512502 14645 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.513401 14802 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.458652 14930 consensus_queue.cc:1059] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:12:38.493774 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:38.496979 13945 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:38.477032 14993 raft_consensus.cc:2749] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:38.495611 14674 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.516168 15006 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.500272 15028 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:38.481633 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.500205 14988 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.502538 14915 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.503953 14985 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.504801 14941 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.469964 14905 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.366161 14864 consensus_queue.cc:237] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.525239 14876 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.525914 15028 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.527697 13865 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:38.527601 15006 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.507090 15025 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:38.529913 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.599735 14097 raft_consensus.cc:1275] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:38.638036 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 176055us
I20260709 12:12:38.640092 13837 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.615866 14645 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.657195 13837 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.658031 13840 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:38.659121 15033 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.640043 14096 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:38.627182 14876 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.676697 14905 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.670074 14757 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:38.678267 14617 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.668602 13837 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.668083 14941 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.641276 14020 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:38.679347 14617 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.679814 14941 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:38.679962 14876 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.677552 15033 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:38.677316 15027 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:38.682857 15033 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:38.683053 15027 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:38.683455 13868 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:38.656891 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.684587 14094 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:38.684916 14915 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.676180 15028 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.685381 14915 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.687714 14915 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:38.654261 14897 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.653487 14015 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:38.629097 15008 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:12:38.689340 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.642195 14930 consensus_queue.cc:1059] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:12:38.694303 15027 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.678574 14905 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.692440 14617 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.674158 14674 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.690929 14897 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.722234 14986 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.730090 14986 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:38.737010 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 68471.2us
I20260709 12:12:38.740154 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.740924 13872 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:38.728384 13946 raft_consensus.cc:1275] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.750610 13874 raft_consensus.cc:1275] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:38.750856 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.751471 13945 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:38.751581 14905 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.752353 14617 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.752770 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.752970 14617 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.753592 13945 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:38.755182 13989 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:38.756460 14876 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:38.757022 14876 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.757368 14876 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.758594 14674 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:38.758734 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 407332us
I20260709 12:12:38.760227 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.761279 13988 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.761629 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.762511 14062 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:38.763094 14966 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:38.763458 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.764174 13914 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.765439 13914 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.766476 14915 raft_consensus.cc:2764] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:38.767163 15006 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.767956 14639 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:38.768399 14639 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.755339 14617 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.767230 14915 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:38.763512 14966 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:38.716804 15027 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.738646 14801 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:38.772382 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.777565 13914 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.794463 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.802222 14062 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:38.774796 13988 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:38.789434 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:38.818023 13945 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.777710 13837 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.797353 14941 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.825560 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 48302.2us
I20260709 12:12:38.813355 14093 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:38.769084 13840 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:38.797807 15037 raft_consensus.cc:3055] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:38.801432 13838 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:38.791010 13871 consensus_meta.cc:287] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
W20260709 12:12:38.768599 14950 consensus_meta.cc:287] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 12:12:38.790710 15036 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.835180 14950 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:38.835280 15036 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.797523 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.793355 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.837909 15036 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:38.815222 14757 raft_consensus.cc:697] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:38.773072 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.787492 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:38.776552 14966 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.824198 15028 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:38.782948 14876 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.769702 14915 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:38.773301 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.791433 14988 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.769268 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.791200 14674 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.865057 14094 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:38.865092 14674 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:38.866739 14095 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:38.867565 14674 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.790228 14801 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.829653 15037 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:38.768782 14639 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.869138 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.868850 15037 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:38.857503 15028 raft_consensus.cc:697] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:38.869817 13941 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:38.870431 15037 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:38.870611 15028 consensus_queue.cc:237] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.810426 14921 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:38.843365 13838 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:38.844334 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:38.874630 13949 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.774600 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:38.849354 13946 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:38.839350 14757 consensus_queue.cc:237] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.830832 15010 consensus_queue.cc:1048] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:12:38.878698 14094 raft_consensus.cc:1240] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:38.801697 14841 consensus_queue.cc:1048] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:12:38.823925 14884 consensus_queue.cc:1048] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:12:38.772092 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:38.772975 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.889295 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:38.889993 14091 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:38.787865 14986 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.895015 14921 raft_consensus.cc:2749] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:38.897948 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:38.901823 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:38.905771 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:38.898743 13940 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.839926 14015 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:38.781544 15027 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:38.920132 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 76856.4us
I20260709 12:12:38.920909 13838 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:38.826046 15008 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.775475 14897 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:38.832651 14699 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.860997 14876 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:38.832145 13871 raft_consensus.cc:2468] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:38.863860 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:38.858402 14915 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.881448 13837 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:38.882218 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 113226us
I20260709 12:12:38.882989 13989 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:38.838066 14950 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:38.832603 14941 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:38.909219 13768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38478 (request call id 51) took 4613 ms. Trace:
I20260709 12:12:38.849177 13945 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
I20260709 12:12:38.890048 14094 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.017493 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.055341 14093 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:12:39.057166 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 174260us
I20260709 12:12:39.058123 13989 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:39.059005 13840 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:38.928736 13838 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.001310 14063 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:38.923884 13949 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
W20260709 12:12:39.052315 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 170940us
I20260709 12:12:39.048827 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.000174 13912 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:39.062317 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 62269.3us
I20260709 12:12:39.011024 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.062667 13837 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:39.063010 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 61915.4us
I20260709 12:12:39.063776 14023 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:39.064662 15036 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:39.064976 14905 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:39.065343 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.065651 14905 raft_consensus.cc:697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:39.065201 14966 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:39.024506 15042 log.cc:927] Time spent T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:12:39.071864 13949 raft_consensus.cc:1240] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:38.899225 15040 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:38.989881 15044 log.cc:927] Time spent T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:38.921608 14645 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.075760 14986 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:12:39.102478 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.076275 13869 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:38.919029 14930 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:38.925145 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:38.943518 15027 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:38.986347 13771 catalog_manager.cc:5697] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:39.076043 14921 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:38.983026 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.101222 14905 consensus_queue.cc:237] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.070434 14920 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:38.997911 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.006965 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:38.924333 15041 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:39.161265 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:39.015586 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.154963 14645 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.165795 13941 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:38.919471 15006 consensus_queue.cc:1048] T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.221s
I20260709 12:12:39.052892 13768 rpcz_store.cc:276] 0709 12:12:34.297149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.297375 (+   226us) service_pool.cc:224] Handling call
0709 12:12:38.909135 (+4611760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:37.359370 (+     0us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b54005b96a8. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3e4ff9e1 00007fce3e4fe64c 00007fce3bb8dadc 00007fce3bb790a6 00007fce3bb78d58 00007fce3bb7d9f1 00007fce3bb7d9a9 00007fce3bb7d939 00007fce3bb7d901 00007fce3bb7cb2d 0000000000388634
0709 12:12:37.359472 (+   102us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:37.360069 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:37.360100 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:12:37.360116 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:37.365000 (+  4884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:37.365087 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:37.365118 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:12:37.365662 (+   544us) tablet.cc:701] Row locks acquired
0709 12:12:37.365680 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:37.365832 (+   152us) write_op.cc:270] Start()
0709 12:12:37.366031 (+   199us) write_op.cc:276] Timestamp: P: 1783599157365781 usec, L: 0
0709 12:12:37.366054 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:37.366750 (+   696us) log.cc:844] Serialized 2481 byte log entry
0709 12:12:37.495010 (+128260us) op_driver.cc:464] REPLICATION: finished
0709 12:12:37.556375 (+ 61365us) write_op.cc:301] APPLY: starting
0709 12:12:37.556480 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:37.556716 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:37.556739 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:37.720206 (+163467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:37.758848 (+ 38642us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:12:37.764546 (+  5698us) write_op.cc:312] APPLY: finished
0709 12:12:37.800502 (+ 35956us) log.cc:844] Serialized 52 byte log entry
0709 12:12:37.808834 (+  8332us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:37.862004 (+ 53170us) write_op.cc:454] Released schema lock
0709 12:12:37.865245 (+  3241us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:37.904402 (+ 39157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:37.904466 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":276539,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":61081,"apply.run_cpu_time_us":7505,"apply.run_wall_time_us":331559,"num_ops":6,"prepare.queue_time_us":105524,"prepare.run_cpu_time_us":6222,"prepare.run_wall_time_us":68497,"replication_time_us":128743,"spinlock_wait_cycles":5298944,"thread_start_us":113230,"threads_started":2}]]}
I20260709 12:12:39.166193 14921 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.085119 14950 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:39.135847 14093 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:39.137526 15040 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.193840 14699 raft_consensus.cc:2804] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.060698 14674 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.190007 13989 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:39.234969 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 49910.7us
I20260709 12:12:39.219771 13948 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.161968 14930 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.067452 14897 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:39.211500 15047 log.cc:927] Time spent T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:12:39.190058 15025 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:39.186364 13871 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:39.204386 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.209149 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.230823 14921 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.209671 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.221359 15041 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.221534 14645 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.197784 14017 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:39.226437 13868 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.211781 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.265853 13840 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.241786 13771 catalog_manager.cc:5697] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb reported cstate change: term changed from 1 to 2, leader changed from f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132) to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 2 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:39.249493 14867 consensus_queue.cc:1048] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:39.253841 15037 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.256770 13869 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:39.257524 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.229351 14639 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.233399 14699 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.250880 14966 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.249653 14884 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:39.259686 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.292897 13872 raft_consensus.cc:1240] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:12:39.241060 14674 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.247136 14089 raft_consensus.cc:2393] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:39.240751 14897 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:39.283869 15049 log.cc:927] Time spent T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.004s
I20260709 12:12:39.241264 14930 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.233331 15040 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.261471 14988 consensus_queue.cc:1059] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:12:39.230257 14950 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.271554 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:39.258188 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.247327 15025 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:39.292008 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.265686 15041 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:39.266764 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 338090us
W20260709 12:12:39.304425 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 63915.2us
I20260709 12:12:39.280712 13944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 211) took 1015 ms. Trace:
I20260709 12:12:39.285842 15033 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:39.266518 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 197450us
I20260709 12:12:39.306684 13948 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.288519 14699 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.280545 13940 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:39.299527 14674 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.302153 14897 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.364297 13988 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:39.283897 15037 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:39.361649 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 91256.8us
I20260709 12:12:39.336058 15053 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.368479 13914 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:39.369632 13837 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:39.370949 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:39.371569 13840 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.303846 14884 raft_consensus.cc:697] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:39.377952 13914 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.308331 14950 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.365499 14094 raft_consensus.cc:2368] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:39.359092 15033 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.383442 13989 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:39.386171 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 45603us
I20260709 12:12:39.393152 15006 raft_consensus.cc:2804] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:39.393729 15006 raft_consensus.cc:697] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:39.394737 15006 consensus_queue.cc:237] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.373826 15032 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.373323 14966 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:39.376529 15028 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:39.386027 14757 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.385782 15027 raft_consensus.cc:2804] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.391655 15033 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.409268 15032 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.392158 13869 raft_consensus.cc:1275] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:39.364065 14915 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.391361 14941 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.379586 14905 consensus_queue.cc:1059] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:12:39.428419 14016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 223) took 1132 ms. Trace:
I20260709 12:12:39.429090 14016 rpcz_store.cc:276] 0709 12:12:38.295546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.295681 (+   135us) service_pool.cc:224] Handling call
0709 12:12:39.427297 (+1131616us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:39.427621 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.427898 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.427945 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:39.428008 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:39.428064 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.428163 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.428339 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19436416}
I20260709 12:12:39.432312 13943 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:39.433161 13943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 212) took 1167 ms. Trace:
I20260709 12:12:39.410624 14022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 214) took 1210 ms. Trace:
I20260709 12:12:39.409965 14757 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.418045 15027 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.418618 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:39.413648 15056 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:39.377410 15053 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.419823 14514 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:39.422660 14889 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.446028 14757 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.440447 15065 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:39.456769 15032 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.457649 13870 raft_consensus.cc:1275] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:39.440002 14884 consensus_queue.cc:237] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:39.446380 15051 log.cc:927] Time spent T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:12:39.448881 15027 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.461176 15056 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.474329 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.441979 14022 rpcz_store.cc:276] 0709 12:12:38.197648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.201360 (+  3712us) service_pool.cc:224] Handling call
0709 12:12:38.244370 (+ 43010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.455397 (+211027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.388270 (+932873us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540047f9d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:39.408230 (+ 19960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255924096}
I20260709 12:12:39.444512 14986 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:39.468252 15057 log.cc:927] Time spent T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:39.462944 14514 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:39.460917 15052 log.cc:927] Time spent T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:39.433519 13943 rpcz_store.cc:276] 0709 12:12:38.265850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.305256 (+ 39406us) service_pool.cc:224] Handling call
0709 12:12:39.397195 (+1091939us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:39.407770 (+ 10575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.432854 (+ 25084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.433097 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11593472}
I20260709 12:12:39.498212 14091 raft_consensus.cc:1275] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:39.498860 15037 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.501648 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:39.502911 14015 consensus_meta.cc:287] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.005s
I20260709 12:12:39.503355 14015 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
I20260709 12:12:39.355957 13944 rpcz_store.cc:276] 0709 12:12:38.265546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.784210 (+518664us) service_pool.cc:224] Handling call
0709 12:12:38.785917 (+  1707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.791803 (+  5886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.791845 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.792516 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.858925 (+ 66409us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:38.887873 (+ 28948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.912874 (+ 25001us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.262635 (+349761us) raft_consensus.cc:1685] finished
0709 12:12:39.264608 (+  1973us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.273995 (+  9387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5206,"raft.queue_time_us":6836,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":37556,"threads_started":1,"wal-append.queue_time_us":62646}
I20260709 12:12:39.487206 14639 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.504941 15056 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.498952 15025 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.508811 14096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 188) took 1747 ms. Trace:
I20260709 12:12:39.485786 14986 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:39.509306 14096 rpcz_store.cc:276] 0709 12:12:37.760978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.767850 (+  6872us) service_pool.cc:224] Handling call
0709 12:12:37.807338 (+ 39488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.677852 (+870514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.508501 (+830649us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54000dbe54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:39.508739 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887046912}
I20260709 12:12:39.492771 15058 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.510094 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:39.510885 14014 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.510123 14986 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.510427 15058 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.516038 15053 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.462241 13940 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.529906 13942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 198) took 1219 ms. Trace:
I20260709 12:12:39.530411 13942 rpcz_store.cc:276] 0709 12:12:38.310928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.313664 (+  2736us) service_pool.cc:224] Handling call
0709 12:12:38.366992 (+ 53328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.479238 (+112246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.529661 (+1050423us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54001243d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:39.529844 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123953536}
I20260709 12:12:39.531834 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:39.533844 14993 raft_consensus.cc:3055] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:39.534353 14993 raft_consensus.cc:740] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:39.537137 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:39.537926 14993 consensus_queue.cc:260] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.539669 14993 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.540351 14514 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.465066 14889 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.543594 14889 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.543291 15041 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.544476 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.545491 13874 raft_consensus.cc:2393] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 1: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:39.545382 13942 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
W20260709 12:12:39.545938 15048 log.cc:927] Time spent T 9419dc9ec23f4da88393bda7056bff9e P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.390s	user 0.002s	sys 0.000s
I20260709 12:12:39.538584 13948 raft_consensus.cc:1240] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:39.548190 15061 log.cc:927] Time spent T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:12:39.544811 13871 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:39.544353 14699 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.527794 14920 consensus_queue.cc:1059] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:12:39.549690 13867 raft_consensus.cc:2368] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:39.550479 14920 raft_consensus.cc:3055] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:39.550884 14920 raft_consensus.cc:740] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:39.552176 13947 raft_consensus.cc:1275] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:39.551811 14920 consensus_queue.cc:260] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.553325 14920 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.557164 14699 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.547796 15033 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.564427 15033 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.565603 15058 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.557814 13948 raft_consensus.cc:1275] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:39.569264 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.571074 13914 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:39.572793 14966 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.573390 14966 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.574112 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.574867 14017 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.575599 14966 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.575394 14645 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.576402 15008 raft_consensus.cc:3055] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:39.576952 15008 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:39.577471 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.578150 14018 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:39.577785 15008 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.531895 14930 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.561163 13946 raft_consensus.cc:1275] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:39.528411 15073 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.596457 15008 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:39.596925 15070 consensus_queue.cc:1059] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:39.601423 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:39.611127 14021 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.606567 14061 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:39.606544 13840 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.613667 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.616333 14061 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:39.609561 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.623994 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.612519 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.576411 15040 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:39.637681 13840 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.637802 13874 raft_consensus.cc:1240] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:39.650426 14757 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.652343 14645 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:39.637104 14841 consensus_queue.cc:1059] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:12:39.653947 14841 raft_consensus.cc:3055] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:39.654312 13868 raft_consensus.cc:2468] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:39.655480 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.655970 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.626607 14987 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.657227 14987 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.657671 14987 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.659462 14930 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.659818 13873 raft_consensus.cc:2393] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:39.637161 15036 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.660946 15036 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.661365 15036 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.661469 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.662487 13873 raft_consensus.cc:2368] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:39.663295 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.659462 15040 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.666759 14950 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:39.643651 14915 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:39.669915 15028 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:39.670334 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.671609 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.672062 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.672768 14639 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.673342 14639 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.673565 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.674041 13988 leader_election.cc:400] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:39.674408 13988 leader_election.cc:403] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:39.674803 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.675182 13988 leader_election.cc:400] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:39.675583 13988 leader_election.cc:403] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:12:39.675628 14639 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.609588 15025 consensus_queue.cc:1048] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:12:39.605257 15069 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:12:39.679216 15069 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.680241 13866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 131) took 1399 ms. Trace:
I20260709 12:12:39.610550 15073 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.680732 13866 rpcz_store.cc:276] 0709 12:12:38.280332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.304881 (+ 24549us) service_pool.cc:224] Handling call
0709 12:12:39.069377 (+764496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.186328 (+116951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.187195 (+   867us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.251986 (+ 64791us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.337783 (+ 85797us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:39.339100 (+  1317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.361148 (+ 22048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.547557 (+186409us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:39.549267 (+  1710us) raft_consensus.cc:1685] finished
0709 12:12:39.549296 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.680030 (+130734us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54004ebbd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:39.680151 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1539,"raft.queue_time_us":83316,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":32080,"spinlock_wait_cycles":1642972800,"thread_start_us":79467,"threads_started":2,"wal-append.queue_time_us":124167}
I20260709 12:12:39.682156 15027 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:39.627478 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.682964 15073 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.683192 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.624866 14913 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:39.683868 14913 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.627337 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:39.684689 15041 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.684873 14617 consensus_queue.cc:1048] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:39.685567 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.656769 13867 raft_consensus.cc:3060] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:39.687821 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 50237.3us
I20260709 12:12:39.688498 13873 raft_consensus.cc:2393] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:39.689563 13914 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:39.690627 14020 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:12:39.683403 14017 raft_consensus.cc:2393] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:39.589139 15058 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:39.684935 13943 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.716970 14021 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:39.718933 13874 raft_consensus.cc:2393] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:39.719130 13912 leader_election.cc:400] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
W20260709 12:12:39.738924 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 50683.8us
I20260709 12:12:39.684401 15027 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:39.676286 14639 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:12:39.684418 14913 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:39.642282 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:39.693097 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:39.725086 14915 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:39.654322 14841 raft_consensus.cc:740] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:39.722025 14699 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.683919 13866 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:39.757897 14023 raft_consensus.cc:1240] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:39.759262 13912 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:39.680248 14989 consensus_queue.cc:1059] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 12:12:39.810388 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 47079.5us
I20260709 12:12:39.741451 13871 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:39.749183 13870 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:39.741247 15025 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:39.763901 14018 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.721824 14921 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:39.756969 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:39.740716 14617 consensus_queue.cc:1048] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:12:39.834900 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.762990 14014 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:39.838868 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.839064 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:39.722198 15010 consensus_queue.cc:1048] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
W20260709 12:12:39.841373 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 82201.8us
I20260709 12:12:39.827114 14699 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.873289 13874 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:39.849841 13914 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.840322 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:39.750383 14988 consensus_queue.cc:1048] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.079s
I20260709 12:12:39.880738 13914 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:39.883172 13838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.131:36455 timed out after 1.534s (SENT) [suppressed 29 similar messages]
I20260709 12:12:39.888104 13874 raft_consensus.cc:1275] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:39.889775 13949 raft_consensus.cc:1275] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:39.892143 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 202102us
I20260709 12:12:39.842937 14950 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:39.918776 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 227749us
I20260709 12:12:39.860495 14915 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:39.938519 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:39.945649 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.862185 15073 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:39.943220 14062 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:39.830020 14876 consensus_queue.cc:1048] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:12:39.878986 14699 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.875006 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:39.860388 15070 consensus_queue.cc:1059] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:12:39.885059 13871 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:39.906749 15058 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:39.966921 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 74952.1us
I20260709 12:12:39.879334 13942 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.832546 14897 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:39.892388 14014 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51094 (request call id 235) took 1540 ms (client timeout 1534 ms). Trace:
I20260709 12:12:39.963631 14989 raft_consensus.cc:3055] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:39.886178 14841 consensus_queue.cc:260] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:39.952864 15032 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.961722 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:40.031247 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:39.978541 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:39.992566 13943 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
W20260709 12:12:39.988508 14674 consensus_meta.cc:287] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
W20260709 12:12:40.035250 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 152129us
W20260709 12:12:40.031136 15057 log.cc:927] Time spent T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:39.980801 15058 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.962605 14986 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.037315 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:40.068780 15074 log.cc:927] Time spent T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:12:39.991336 14757 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:39.995101 14897 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:39.969276 15073 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.070575 13914 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:40.030885 14989 raft_consensus.cc:740] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:40.043079 15032 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.069135 14674 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.076939 13869 raft_consensus.cc:1275] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:40.077394 15089 raft_consensus.cc:2804] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:40.073743 15037 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.078619 14867 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.063623 15058 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.080120 13840 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:39.971310 15055 consensus_queue.cc:1048] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:12:40.049346 15070 raft_consensus.cc:3055] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:39.996753 14015 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:40.068909 14986 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.074668 13940 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.073499 14841 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:39.998760 14014 rpcz_store.cc:269] 0709 12:12:38.351971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.359084 (+  7113us) service_pool.cc:224] Handling call
0709 12:12:39.390727 (+1031643us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:39.509954 (+119227us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:39.882202 (+372248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26181248}
I20260709 12:12:40.090552 15032 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.118003 15040 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.084111 14876 consensus_queue.cc:1048] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 12:12:40.113663 15070 raft_consensus.cc:740] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:40.128208 15089 raft_consensus.cc:697] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:40.115792 15037 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.118911 14867 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:40.178596 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 180702us
I20260709 12:12:40.157348 13866 raft_consensus.cc:1240] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:40.166225 14993 consensus_meta.cc:287] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.000s
W20260709 12:12:40.174449 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 299896us
I20260709 12:12:40.182381 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 212) took 1437 ms. Trace:
I20260709 12:12:40.163316 15040 raft_consensus.cc:697] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:40.193706 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.194645 14097 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.195931 13838 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:40.187638 13872 rpcz_store.cc:276] 0709 12:12:38.744950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.294790 (+549840us) service_pool.cc:224] Handling call
0709 12:12:39.295120 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.301335 (+  6215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.301383 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.302479 (+  1096us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.588584 (+286105us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:39.613854 (+ 25270us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.621426 (+  7572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.621500 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.182133 (+560633us) raft_consensus.cc:1685] finished
0709 12:12:40.182155 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.182311 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19345,"prepare.queue_time_us":23212,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":17677,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":44017,"thread_start_us":211753,"threads_started":1,"wal-append.queue_time_us":286731}
I20260709 12:12:40.200228 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:40.201807 13838 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:40.183126 14921 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.180888 14884 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:12:40.215214 15076 log.cc:927] Time spent T d00fe8bc507b4059ad259285c1183c92 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 12:12:40.215431 15084 log.cc:927] Time spent T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:12:40.160593 14989 consensus_queue.cc:260] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.215745 15092 consensus_queue.cc:1059] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:12:40.193625 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:40.193632 14864 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:40.212829 15079 log.cc:927] Time spent T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:12:40.214267 14993 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:40.229802 15080 log.cc:927] Time spent T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:12:40.233299 14097 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:40.232946 15040 consensus_queue.cc:237] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:40.236814 15075 log.cc:927] Time spent T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Append to log took a long time: real 0.374s	user 0.000s	sys 0.004s
W20260709 12:12:40.238665 15078 log.cc:927] Time spent T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:12:40.263020 15077 log.cc:927] Time spent T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:12:40.239197 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.239521 14986 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:40.239985 15086 log.cc:927] Time spent T bbd1ba95f0984c21adf769032d2facd7 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:12:40.214599 14930 raft_consensus.cc:2804] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.217283 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.257750 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 232) took 1343 ms. Trace:
I20260709 12:12:40.240257 15090 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.152s
I20260709 12:12:40.296473 14020 rpcz_store.cc:276] 0709 12:12:38.914725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.101673 (+186948us) service_pool.cc:224] Handling call
0709 12:12:39.546805 (+445132us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:39.546972 (+   167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.722641 (+175669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.257383 (+534742us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400063954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:40.257665 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406102272}
I20260709 12:12:40.310297 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.214308 15070 consensus_queue.cc:260] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:40.333278 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 262790us
I20260709 12:12:40.250505 14864 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.301749 14930 raft_consensus.cc:697] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:40.354022 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 396943us
I20260709 12:12:40.341130 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.358129 14062 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:40.358162 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.326983 14092 raft_consensus.cc:2368] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:40.388597 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.357592 15070 raft_consensus.cc:3060] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.252179 15089 consensus_queue.cc:237] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.353003 15073 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:40.376124 14920 consensus_meta.cc:287] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.005s
W20260709 12:12:40.401105 15036 consensus_meta.cc:287] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.003s
I20260709 12:12:40.385591 15102 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:40.432592 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 74539.1us
I20260709 12:12:40.386103 14018 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:40.442227 13989 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:40.445859 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 224) took 1056 ms. Trace:
I20260709 12:12:40.446234 13989 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:40.446422 13947 rpcz_store.cc:276] 0709 12:12:39.389563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.555018 (+165455us) service_pool.cc:224] Handling call
0709 12:12:39.555452 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.555890 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.555924 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.556392 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.750216 (+193824us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:12:39.750268 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.750352 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.445602 (+695250us) raft_consensus.cc:1685] finished
0709 12:12:40.445621 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.445786 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":165165,"threads_started":1,"wal-append.queue_time_us":305927}
I20260709 12:12:40.447932 13989 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:40.445254 14090 raft_consensus.cc:1275] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:40.452782 15104 raft_consensus.cc:3060] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.459399 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:40.473141 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:40.473608 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 89576.5us
I20260709 12:12:40.414100 15036 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.474972 13947 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.439895 15037 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:40.438516 15102 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.450724 14897 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:40.451529 14867 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:40.470645 13867 consensus_meta.cc:287] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 12:12:40.450605 15090 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.467016 15006 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:40.493458 15032 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.487267 14699 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.498286 13912 leader_election.cc:400] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:40.511909 13912 leader_election.cc:403] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:12:40.492898 15069 consensus_meta.cc:287] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.813s	user 0.015s	sys 0.000s
I20260709 12:12:40.520982 13868 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:40.523315 15036 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:40.524071 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.491034 15037 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.436743 14930 consensus_queue.cc:237] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.568198 13873 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:40.505887 13867 raft_consensus.cc:2468] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:40.578187 13947 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:40.580703 14905 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.524734 15069 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:40.581151 14966 raft_consensus.cc:3055] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:40.581980 15124 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:40.582952 15082 log.cc:927] Time spent T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.606s	user 0.000s	sys 0.001s
I20260709 12:12:40.582818 15113 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.583917 15105 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:12:40.589721 15107 log.cc:927] Time spent T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 12:12:40.573150 15037 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.597874 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:40.574605 14913 consensus_meta.cc:287] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.006s
I20260709 12:12:40.573231 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:40.618337 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.512071 15090 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:40.625566 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 135823us
I20260709 12:12:40.629815 13989 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:40.627626 13948 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:40.584614 13940 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:40.631484 14801 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:40.631659 14897 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.632071 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.632426 14897 raft_consensus.cc:697] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:40.634270 14897 consensus_queue.cc:237] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.636121 14884 consensus_queue.cc:1059] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:40.637190 14876 raft_consensus.cc:3055] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:40.637656 14876 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:40.638662 14876 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:40.639480 13942 consensus_meta.cc:287] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.008s
I20260709 12:12:40.639942 13942 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:40.640095 14876 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.641917 14699 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:40.642598 15090 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:40.647190 13871 consensus_meta.cc:287] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260709 12:12:40.647655 13871 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:40.600142 14864 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.601063 13867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 213) took 1035 ms. Trace:
I20260709 12:12:40.628232 15124 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.651847 15124 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.611229 14966 raft_consensus.cc:740] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:40.612016 14905 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.653662 15032 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:40.655020 14905 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.655630 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:40.656780 14987 consensus_meta.cc:287] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.003s
I20260709 12:12:40.657346 14987 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.659883 14987 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.660024 15102 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.660979 14096 raft_consensus.cc:2368] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:40.661145 15113 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.662151 15109 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:40.662796 15109 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.649093 13867 rpcz_store.cc:276] 0709 12:12:39.565480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.655673 (+ 90193us) service_pool.cc:224] Handling call
0709 12:12:40.597774 (+942101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:40.664551 13948 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:40.665043 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:40.666038 14020 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:40.656333 14966 consensus_queue.cc:260] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.667106 14966 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.667958 13913 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:40.669589 15037 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.670260 15037 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.670810 15037 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.675712 13947 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:40.624541 15105 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.663908 15113 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.686195 13869 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.690356 15032 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.694248 15102 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:40.689929 15105 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.629228 14913 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.722040 14913 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.728878 14093 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:40.715065 15102 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.718207 15109 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:40.739313 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:40.740187 13944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48298 (request call id 333) took 1024 ms. Trace:
I20260709 12:12:40.740530 13944 rpcz_store.cc:276] 0709 12:12:39.716257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.719589 (+  3332us) service_pool.cc:224] Handling call
0709 12:12:40.739143 (+1019554us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:40.740126 (+   983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11747072}
I20260709 12:12:40.734016 15037 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.742045 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.742404 13944 raft_consensus.cc:1275] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:40.744135 15105 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.716030 15032 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.734057 15102 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.746636 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 203) took 1947 ms. Trace:
I20260709 12:12:40.746825 15032 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.747123 13870 rpcz_store.cc:276] 0709 12:12:38.798890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.488911 (+690021us) service_pool.cc:224] Handling call
0709 12:12:39.718502 (+229591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.842070 (+123568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.746391 (+904321us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540026e650. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:40.746572 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456014208}
I20260709 12:12:40.717046 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 220) took 1294 ms. Trace:
I20260709 12:12:40.749020 15105 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:40.749359 13865 rpcz_store.cc:276] 0709 12:12:39.421353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.562301 (+140948us) service_pool.cc:224] Handling call
0709 12:12:39.562607 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.614541 (+ 51934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.625162 (+ 10621us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.663314 (+ 38152us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.828072 (+164758us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:12:39.828137 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.828270 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.582079 (+753809us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:40.701212 (+119133us) raft_consensus.cc:1685] finished
0709 12:12:40.703787 (+  2575us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.715404 (+ 11617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45025,"raft.queue_time_us":47019,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":15848,"spinlock_wait_cycles":47905152,"thread_start_us":160671,"threads_started":1,"wal-append.queue_time_us":243269}
W20260709 12:12:40.733361 15058 consensus_meta.cc:287] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.605s	user 0.014s	sys 0.000s
I20260709 12:12:40.753340 15058 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.755564 13945 raft_consensus.cc:1240] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:40.758767 13840 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:40.760828 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:40.759995 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.755575 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.764452 14088 raft_consensus.cc:3060] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.763438 15104 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:40.769891 14920 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.770488 14920 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.773491 14920 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:40.774194 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.760109 15037 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.775656 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.775746 15037 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.776705 15109 raft_consensus.cc:2804] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.777283 15109 raft_consensus.cc:697] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:40.778323 15037 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.778227 15109 consensus_queue.cc:237] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:40.775703 14088 raft_consensus.cc:2468] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
W20260709 12:12:40.781309 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 347852us
I20260709 12:12:40.782440 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.783284 13946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48298 (request call id 334) took 1066 ms. Trace:
I20260709 12:12:40.783632 13946 rpcz_store.cc:276] 0709 12:12:39.716673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.719792 (+  3119us) service_pool.cc:224] Handling call
0709 12:12:40.782281 (+1062489us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:40.783204 (+   923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042624}
W20260709 12:12:40.783301 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 308267us
I20260709 12:12:40.784849 15119 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.785499 15119 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.787714 15119 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:40.788724 15060 raft_consensus.cc:3055] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:40.789122 15060 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:40.790781 15102 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.791746 14063 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:40.792670 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51094 (request call id 243) took 1216 ms. Trace:
I20260709 12:12:40.763904 14966 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:12:40.790138 15060 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:40.795722 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.757014 15058 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:40.732913 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:40.793177 14015 rpcz_store.cc:276] 0709 12:12:39.576124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.589135 (+ 13011us) service_pool.cc:224] Handling call
0709 12:12:39.671889 (+ 82754us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:40.792444 (+1120555us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54008e80d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:40.792583 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750718720}
I20260709 12:12:40.825037 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.805943 15041 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.829186 13949 raft_consensus.cc:2468] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:40.805742 15118 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:40.814044 15102 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.811338 15106 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.812287 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:40.811470 13871 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:40.841578 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.832553 13946 raft_consensus.cc:1275] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:40.841141 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:40.845774 14015 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.829276 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.847142 14920 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:40.847657 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:40.848560 13941 raft_consensus.cc:2393] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
W20260709 12:12:40.848687 13987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.849578 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:40.850198 13941 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.852794 15118 raft_consensus.cc:697] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:40.853777 15118 consensus_queue.cc:237] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.837003 15041 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.860180 15041 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:40.860795 14022 raft_consensus.cc:2410] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:40.832805 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:40.872284 14063 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:40.874704 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.867254 14913 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:40.875705 13942 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:40.875783 14913 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.877238 14090 raft_consensus.cc:2393] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:40.847687 14920 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.878401 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:40.879369 14090 raft_consensus.cc:2468] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
W20260709 12:12:40.882642 15132 log.cc:927] Time spent T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:12:40.884080 14015 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:40.893337 13869 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:40.893579 13913 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:40.898526 15112 log.cc:927] Time spent T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 12:12:40.904860 15124 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:40.901783 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.905468 15124 raft_consensus.cc:697] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:40.906060 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:40.906463 15124 consensus_queue.cc:237] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.907541 14089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 206) took 1317 ms. Trace:
I20260709 12:12:40.908107 14089 rpcz_store.cc:276] 0709 12:12:39.590540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.594995 (+  4455us) service_pool.cc:224] Handling call
0709 12:12:39.628945 (+ 33950us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:39.954084 (+325139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.965414 (+ 11330us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:40.092041 (+126627us) log.cc:844] Serialized 52 byte log entry
0709 12:12:40.319666 (+227625us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:40.396973 (+ 77307us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.768980 (+372007us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b18004a7340. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce35058a40 00007fce350534e4 00007fce35053455 00007fce3813b060 00007fce3814d716 00007fce3815e287 00007fce3815e208
0709 12:12:40.769176 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.769290 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.897837 (+128547us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:40.907231 (+  9394us) raft_consensus.cc:1685] finished
0709 12:12:40.907276 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.907470 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8062,"prepare.queue_time_us":49875,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4724,"raft.queue_time_us":474655,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"spinlock_wait_cycles":167057024,"thread_start_us":325851,"threads_started":2,"wal-append.queue_time_us":360912}
I20260709 12:12:40.911075 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.912021 14089 raft_consensus.cc:2393] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:40.913187 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.913807 13866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 212) took 1348 ms. Trace:
I20260709 12:12:40.913866 14089 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.914448 13866 rpcz_store.cc:276] 0709 12:12:39.565237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.879218 (+313981us) service_pool.cc:224] Handling call
0709 12:12:39.969995 (+ 90777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.198564 (+228569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.913543 (+714979us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400533754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:40.913738 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358115712}
I20260709 12:12:40.888276 15092 raft_consensus.cc:2804] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:40.917078 15092 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.917470 15092 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.902573 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:40.937408 14092 raft_consensus.cc:2368] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:40.937143 14645 consensus_queue.cc:1059] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:40.867175 14617 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.938237 14645 raft_consensus.cc:3055] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:40.938769 14645 raft_consensus.cc:740] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:40.938647 14617 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.844552 15106 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:40.925642 14089 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:40.942364 14096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37120 (request call id 205) took 1352 ms. Trace:
I20260709 12:12:40.942466 15106 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:40.942921 14096 rpcz_store.cc:276] 0709 12:12:39.590224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.590375 (+   151us) service_pool.cc:224] Handling call
0709 12:12:40.942148 (+1351773us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540059a1d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:40.942306 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349118208}
I20260709 12:12:40.948910 15060 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.927580 14674 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:40.928705 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:40.935257 13912 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:40.950847 13989 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:40.931582 15092 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:40.957386 13912 leader_election.cc:400] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:40.961730 13912 leader_election.cc:403] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:40.960685 14091 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:40.959031 14966 raft_consensus.cc:2764] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:40.960919 14802 raft_consensus.cc:2804] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:40.963783 14802 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:40.964169 14802 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:40.966957 15130 log.cc:927] Time spent T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 12:12:40.954982 15028 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:12:40.968324 15028 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:40.968880 15028 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:40.972167 14913 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:40.939917 14645 consensus_queue.cc:260] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:41.002204 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 45106us
I20260709 12:12:41.011585 15088 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:41.012238 15088 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:41.013427 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.014185 14095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 254) took 1091 ms. Trace:
I20260709 12:12:41.014344 15088 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:41.014529 14095 rpcz_store.cc:276] 0709 12:12:39.922808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.935106 (+ 12298us) service_pool.cc:224] Handling call
0709 12:12:41.013265 (+1078159us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:41.014128 (+   863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6169856}
I20260709 12:12:41.021034 13872 raft_consensus.cc:1240] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:41.021492 14645 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.996173 14987 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:41.022447 14987 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:41.025452 14987 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:41.027982 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.029101 13866 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:41.029232 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.031534 13873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 211) took 1466 ms. Trace:
I20260709 12:12:41.032089 13873 rpcz_store.cc:276] 0709 12:12:39.564881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.840057 (+275176us) service_pool.cc:224] Handling call
0709 12:12:41.031298 (+1191241us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400508a54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:41.031461 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586357504}
I20260709 12:12:41.039719 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.042358 14063 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:41.043767 14987 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:41.044291 14987 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.044718 14987 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.048805 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.050611 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.051311 14018 raft_consensus.cc:3060] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.055166 13944 raft_consensus.cc:1240] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:41.057381 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.059305 14093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 260) took 1116 ms. Trace:
I20260709 12:12:41.059900 14093 rpcz_store.cc:276] 0709 12:12:39.942848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.947468 (+  4620us) service_pool.cc:224] Handling call
0709 12:12:40.238970 (+291502us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:41.028608 (+789638us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000b7cd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:41.059220 (+ 30612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038772352}
I20260709 12:12:41.062752 14920 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:41.063287 14022 raft_consensus.cc:1275] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:41.064893 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.007264 14617 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:41.067502 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.068806 13873 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:41.071110 14094 raft_consensus.cc:2376] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2. Re-sending same reply.
W20260709 12:12:41.075276 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.075670 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.077983 13914 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.078366 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.085279 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.087109 13873 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:41.079375 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.089668 14023 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:41.092485 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.093335 14023 raft_consensus.cc:2410] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:12:41.092243 13914 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.103340 13914 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.105610 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.108103 13914 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.111495 13914 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.106566 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.086603 14920 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.116504 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.113128 13874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 218) took 1546 ms. Trace:
I20260709 12:12:41.118372 14021 raft_consensus.cc:2393] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:41.085700 14921 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:41.086289 14617 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.112145 14965 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:12:41.086355 13868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 138) took 1456 ms (client timeout 1528 ms). Trace:
I20260709 12:12:41.118238 13874 rpcz_store.cc:276] 0709 12:12:39.566756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.889383 (+322627us) service_pool.cc:224] Handling call
0709 12:12:39.889729 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.116465 (+226736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.116489 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.116523 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:40.116542 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.112776 (+996234us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540009c9d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:41.112834 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.113033 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520865024}
I20260709 12:12:41.107468 15111 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:41.114637 15129 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:41.125388 14018 raft_consensus.cc:2468] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:41.109663 15028 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:41.112592 15032 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:41.113298 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.116822 15113 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:41.113391 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.113090 15070 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:41.140117 15106 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:41.110306 15104 consensus_queue.cc:1059] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:12:41.131748 14018 raft_consensus.cc:1275] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:41.130137 15111 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:41.157121 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 224) took 1435 ms. Trace:
W20260709 12:12:41.161051 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.168260 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.168042 13872 rpcz_store.cc:276] 0709 12:12:39.721252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.208900 (+487648us) service_pool.cc:224] Handling call
0709 12:12:41.020764 (+811864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.021646 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.156770 (+135124us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540078ad50. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:41.157019 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866153216}
I20260709 12:12:41.171468 13838 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:41.146425 14014 raft_consensus.cc:2393] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:41.137116 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.123157 14920 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:41.127480 14617 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.122623 14921 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:41.182435 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.183550 13838 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.147002 15070 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.160260 14989 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.145284 15027 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.185968 14093 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:41.187551 13838 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.169495 15032 raft_consensus.cc:697] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:41.175071 15111 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:41.122452 13868 rpcz_store.cc:269] 0709 12:12:39.563527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.655170 (+ 91643us) service_pool.cc:224] Handling call
0709 12:12:41.019665 (+1364495us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540078ad54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:41.019899 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946028416}
I20260709 12:12:41.197082 15125 raft_consensus.cc:2804] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:12:41.201731 15142 log.cc:927] Time spent T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:41.202385 14987 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.205142 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.183171 14091 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:41.208282 14921 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:41.209337 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.209724 15032 consensus_queue.cc:237] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.161183 15106 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.196099 15027 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.215899 15006 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.217351 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.172408 14674 consensus_queue.cc:1048] T c212f97a40314d1dbb07943ef4722563 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:12:41.190915 14993 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:41.228036 15028 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:41.229264 15083 log.cc:927] Time spent T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 1.150s	user 0.007s	sys 0.002s
I20260709 12:12:41.233467 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:41.160920 15101 consensus_queue.cc:1059] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:12:41.181715 15068 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:41.191048 15070 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.253785 13942 raft_consensus.cc:1275] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:41.278302 13941 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:41.279085 15058 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:41.282877 14617 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.255729 14091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37108 (request call id 230) took 1070 ms. Trace:
I20260709 12:12:41.283638 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.283914 14091 rpcz_store.cc:276] 0709 12:12:40.185340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.186990 (+  1650us) service_pool.cc:224] Handling call
0709 12:12:40.928520 (+741530us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:41.255640 (+327120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11738880}
I20260709 12:12:41.256235 15025 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.285792 15025 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:41.287977 15025 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:41.256147 15141 log.cc:927] Time spent T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:41.268929 15006 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.292258 15006 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.269403 14014 raft_consensus.cc:2393] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:41.292845 14017 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:41.297079 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.298738 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.299540 13872 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:41.300987 13988 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.288287 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.302510 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.303318 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.293818 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:41.258062 15140 log.cc:927] Time spent T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:12:41.293823 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.323639 15101 consensus_queue.cc:1059] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:41.324350 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.324568 15101 raft_consensus.cc:3055] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:41.325080 15101 raft_consensus.cc:740] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:41.325922 15101 consensus_queue.cc:260] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.282878 14987 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:41.268864 15106 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.307873 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:41.271027 15028 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.334478 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.270313 14920 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:41.335209 15028 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.273463 14802 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.336418 15027 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:41.271718 14015 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:41.270812 14993 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.337397 14993 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.337641 13949 raft_consensus.cc:1240] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:41.338491 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:41.339658 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:41.340436 13942 raft_consensus.cc:2393] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:41.274605 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:41.351666 14016 raft_consensus.cc:2376] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3. Re-sending same reply.
I20260709 12:12:41.351823 14966 raft_consensus.cc:3055] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:41.254983 15125 raft_consensus.cc:697] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:41.257361 15139 log.cc:927] Time spent T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:41.347765 14097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 211) took 1032 ms. Trace:
I20260709 12:12:41.362728 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.314275 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.362883 14097 rpcz_store.cc:276] 0709 12:12:40.315079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.317314 (+  2235us) service_pool.cc:224] Handling call
0709 12:12:40.356067 (+ 38753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.374706 (+ 18639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.374754 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.059593 (+684839us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b2c00200538. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:12:41.060073 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:12:41.167630 (+107557us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:41.167673 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.167744 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.347504 (+179760us) raft_consensus.cc:1685] finished
0709 12:12:41.347522 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.347709 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348846,"raft.queue_time_us":36514,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":20387,"spinlock_wait_cycles":7219584,"thread_start_us":121191,"threads_started":2,"wal-append.queue_time_us":280170}
I20260709 12:12:41.316366 14905 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:12:41.284286 15092 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:41.344385 14022 raft_consensus.cc:2468] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:41.312870 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.353425 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:41.250684 15089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.012s	sys 0.017s
I20260709 12:12:41.355502 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.358140 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.375909 13874 raft_consensus.cc:2393] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:41.358886 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.372776 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.377605 13986 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.308854 15006 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:41.352246 14966 raft_consensus.cc:740] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:41.379875 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:41.379837 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.380890 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.381677 13986 leader_election.cc:400] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:41.381858 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.374926 14617 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.385123 14897 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:12:41.379107 15089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.018s
I20260709 12:12:41.361406 14757 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.389348 15081 consensus_queue.cc:1048] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:41.400281 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.361827 15058 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.389268 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.404142 14023 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:41.404410 14020 raft_consensus.cc:1275] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:41.397853 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:41.405661 14097 raft_consensus.cc:2393] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:41.398633 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.387010 14920 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:41.400161 14617 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.419623 14617 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:41.410422 14757 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.386423 15006 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.421200 15006 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:41.374482 15060 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.423055 14757 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:41.423532 15060 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.399377 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.425829 13874 raft_consensus.cc:2393] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 5: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:41.426123 15113 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:41.405794 14897 raft_consensus.cc:697] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:41.385298 15025 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:12:41.410426 15070 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.427958 14920 raft_consensus.cc:697] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:41.427737 14897 consensus_queue.cc:237] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.428846 14018 raft_consensus.cc:1240] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:41.428901 14920 consensus_queue.cc:237] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.406423 13873 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.432037 14091 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:41.416219 15111 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.436250 14095 raft_consensus.cc:1240] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:41.403056 13837 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.417454 15058 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.438290 13837 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.438720 14801 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.439108 15068 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:41.439420 15058 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.410303 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.440868 13837 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.441629 14097 raft_consensus.cc:2410] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:12:41.442461 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:41.442689 13837 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.443118 14097 raft_consensus.cc:2368] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4.
I20260709 12:12:41.446300 14093 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:41.426698 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.447460 13874 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:41.450129 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.451648 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:41.458768 13874 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:41.439877 15068 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:41.460433 13914 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:41.468305 15069 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.469076 15069 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:41.469326 15068 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:41.472316 13837 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.474815 13837 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.476617 13874 raft_consensus.cc:1240] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:41.477381 13873 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:41.479789 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.480461 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:41.481905 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:41.490114 13838 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.488211 14061 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:41.497020 13837 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:41.499032 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.496781 14020 raft_consensus.cc:1275] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:41.500177 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.500795 14097 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:41.508121 14061 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:41.448781 15111 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.473810 14089 raft_consensus.cc:1275] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:41.461297 14801 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.517647 15091 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:41.519373 13941 raft_consensus.cc:1275] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:41.519954 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.476974 15068 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:41.482977 15113 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:41.480993 15053 raft_consensus.cc:2749] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:41.477777 15070 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.513339 14061 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:41.514492 13838 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:41.533004 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:41.514328 14989 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:41.540032 14989 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:41.541659 14989 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.522799 14801 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:41.540895 13838 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:41.545130 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:41.529753 15113 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.523151 14757 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:41.498952 15109 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:12:41.506888 14674 consensus_queue.cc:1048] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:12:41.414811 15125 consensus_queue.cc:237] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.537782 15091 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:41.559747 13838 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:41.659297 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.675886 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.540597 15068 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:41.569244 15027 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:41.658366 15124 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.569828 15053 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:41.797849 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.807895 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 248254us
W20260709 12:12:41.802208 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 175892us
I20260709 12:12:41.617244 14993 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:41.567785 15113 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:41.536540 15041 consensus_queue.cc:1048] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:12:41.801277 15073 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:41.817466 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 320520us
I20260709 12:12:41.822186 14062 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.826570 14062 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.827420 14617 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:41.828147 14617 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:12:41.811856 15108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.008s	sys 0.014s
I20260709 12:12:41.806218 15091 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.839022 14062 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:41.841660 13873 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:41.850077 14062 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:41.820955 15068 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:12:41.842693 15108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.008s	sys 0.014s
I20260709 12:12:41.845062 15091 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:41.868549 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 58879.7us
I20260709 12:12:41.814517 15124 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:41.851475 14920 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:41.844420 15053 consensus_queue.cc:1048] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:12:41.922601 15088 raft_consensus.cc:2804] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:41.844753 15073 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:41.926052 15108 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.062919 15158 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:41.952951 15068 raft_consensus.cc:697] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:42.080657 15149 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:12:42.095141 14905 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:42.110970 15006 consensus_meta.cc:287] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.689s	user 0.020s	sys 0.000s
I20260709 12:12:42.111660 15006 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:42.113888 15150 log.cc:927] Time spent T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 12:12:42.067445 14920 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.066090 15088 raft_consensus.cc:697] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:42.031975 15156 consensus_queue.cc:1048] T 4c9db182bf36444d875b066aec0dd8b8 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 12:12:42.030988 15041 consensus_queue.cc:1048] T 1030856707044fac9c27c8699f2e770c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 12:12:42.065061 15108 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.066881 15158 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:42.150653 14989 consensus_meta.cc:287] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.609s	user 0.004s	sys 0.017s
I20260709 12:12:42.155995 14993 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.176712 15108 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.167112 15068 consensus_queue.cc:237] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.177639 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:42.179785 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.181113 14020 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 5: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:42.182665 14097 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:42.128859 14920 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.182914 14897 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.183665 14897 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.184659 13948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 232) took 1370 ms. Trace:
I20260709 12:12:42.185846 14897 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:42.186589 15088 consensus_queue.cc:237] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.185060 13948 rpcz_store.cc:276] 0709 12:12:40.813940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.858303 (+ 44363us) service_pool.cc:224] Handling call
0709 12:12:40.858624 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.859050 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.859079 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.230200 (+371121us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b480019ac58. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3d06caa1 00007fce3d063b37 00007fce3d0639ca 00007fce3d15b26f 00007fce3d15af37 00007fce3d16f55c 00007fce3d16f508 00007fce3d16f488 00007fce3d16f443 00007fce3d16e6ec 00007fce3c098a96
0709 12:12:41.568246 (+338046us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b2c00012878. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:12:41.586281 (+ 18035us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.067529 (+481248us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.067585 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.067697 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.184439 (+116742us) raft_consensus.cc:1685] finished
0709 12:12:42.184461 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.184586 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4067,"raft.run_cpu_time_us":2398,"raft.run_wall_time_us":367260,"spinlock_wait_cycles":16097536,"thread_start_us":248895,"threads_started":1,"wal-append.queue_time_us":349923}
I20260709 12:12:42.189848 15124 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:42.191233 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.192937 14920 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:42.193318 15147 log.cc:927] Time spent T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 12:12:42.194098 15154 log.cc:927] Time spent T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:12:42.197450 15073 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:42.192456 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.199097 14020 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:42.167677 14989 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.201778 13949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48298 (request call id 345) took 1384 ms. Trace:
I20260709 12:12:42.204571 13949 rpcz_store.cc:276] 0709 12:12:40.817072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.974393 (+157321us) service_pool.cc:224] Handling call
0709 12:12:40.994960 (+ 20567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.338123 (+343163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.201525 (+863402us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54001261d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:42.201717 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787587328}
I20260709 12:12:42.205399 14897 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:42.206248 14897 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.207100 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.207757 13874 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:42.208690 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.209643 15006 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.209826 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.205613 15060 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:42.225919 14062 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:42.227146 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.180974 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:42.226442 15155 log.cc:927] Time spent T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 12:12:42.227757 15060 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:42.234866 15060 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.235235 15060 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.235720 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:42.237674 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:42.223577 15151 log.cc:927] Time spent T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:12:42.210584 14989 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:42.242277 15040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.601s	user 0.032s	sys 0.051s
W20260709 12:12:42.242889 15040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.032s	sys 0.051s
I20260709 12:12:42.244199 13840 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:42.245268 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.245551 15164 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:42.246143 14088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37120 (request call id 217) took 1070 ms. Trace:
I20260709 12:12:42.246513 14088 rpcz_store.cc:276] 0709 12:12:41.175904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.244984 (+1069080us) service_pool.cc:224] Handling call
0709 12:12:42.246078 (+  1094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:42.217427 14897 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:42.249462 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 102712us
I20260709 12:12:42.258030 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:42.238454 14993 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.275765 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.229975 15073 consensus_queue.cc:1059] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:12:42.276873 14097 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:42.251039 13943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 234) took 1273 ms. Trace:
I20260709 12:12:42.291133 14757 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:42.256548 15113 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.303469 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:42.311476 15153 log.cc:927] Time spent T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:12:42.316788 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.320919 15124 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.342695 15108 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.344137 15113 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.348361 15164 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.355602 15099 raft_consensus.cc:3055] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:42.356118 15164 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.355796 13837 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:42.356837 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:42.358197 15109 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:42.356459 15099 raft_consensus.cc:740] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:42.360105 15099 consensus_queue.cc:260] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.363317 15099 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:42.358659 15164 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.367439 15158 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:42.368366 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.369354 15117 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:42.370069 15117 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.370934 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.373771 15152 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.374626 15152 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.329331 14757 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.286108 14993 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.353688 15108 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.351559 13871 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:42.351472 15055 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.349184 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.353047 15124 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.328552 15091 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.375385 14966 consensus_queue.cc:260] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.417250 14966 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.417743 14801 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.418409 14801 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.372318 13867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 234) took 1013 ms. Trace:
I20260709 12:12:42.420855 13867 rpcz_store.cc:276] 0709 12:12:41.358617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.361687 (+  3070us) service_pool.cc:224] Handling call
0709 12:12:42.370684 (+1008997us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.372224 (+  1540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10142976}
I20260709 12:12:42.395387 14093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 271) took 1072 ms. Trace:
I20260709 12:12:42.401178 13874 raft_consensus.cc:1240] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:42.410873 14095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 213) took 1272 ms. Trace:
I20260709 12:12:42.425177 14018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 239) took 1241 ms. Trace:
I20260709 12:12:42.447196 14095 rpcz_store.cc:276] 0709 12:12:41.138592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.138818 (+   226us) service_pool.cc:224] Handling call
0709 12:12:41.148612 (+  9794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.436914 (+288302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.410596 (+973682us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54000dbe54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:42.410802 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658869632}
I20260709 12:12:42.447353 14018 rpcz_store.cc:276] 0709 12:12:41.183463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.183654 (+   191us) service_pool.cc:224] Handling call
0709 12:12:41.184069 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.429753 (+245684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.424829 (+995076us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400871754. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:42.425093 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562324352}
I20260709 12:12:42.435945 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.385247 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.401667 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.382036 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.412716 14062 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:42.445894 14093 rpcz_store.cc:276] 0709 12:12:41.323368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.379418 (+ 56050us) service_pool.cc:224] Handling call
0709 12:12:42.395113 (+1015695us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5400540e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:42.395288 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102501120}
I20260709 12:12:42.452201 14094 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:42.454746 14094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 268) took 1157 ms. Trace:
I20260709 12:12:42.455188 14094 rpcz_store.cc:276] 0709 12:12:41.297236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.301150 (+  3914us) service_pool.cc:224] Handling call
0709 12:12:42.401515 (+1100365us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.454672 (+ 53157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27800448}
I20260709 12:12:42.432003 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.457195 13945 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:42.454033 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.472177 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 243) took 1086 ms. Trace:
I20260709 12:12:42.472939 13872 rpcz_store.cc:276] 0709 12:12:41.385448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.393635 (+  8187us) service_pool.cc:224] Handling call
0709 12:12:42.385030 (+991395us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.472073 (+ 87043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7073536}
I20260709 12:12:42.474619 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:42.475471 13872 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:42.468331 15113 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.484292 15113 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.487432 15113 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:42.491549 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.420493 14801 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.394690 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:42.533620 13871 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:12:42.434508 14091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 273) took 1110 ms. Trace:
I20260709 12:12:42.534597 14091 rpcz_store.cc:276] 0709 12:12:41.323885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.334176 (+ 10291us) service_pool.cc:224] Handling call
0709 12:12:42.434250 (+1100074us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b5400541d54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:42.434412 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222324480}
I20260709 12:12:42.536353 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.521788 15113 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.537304 15113 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.539557 15113 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.539644 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48298 (request call id 353) took 1210 ms. Trace:
I20260709 12:12:42.412930 15164 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.387116 15108 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.540228 15164 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.543663 15164 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.546168 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.422823 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:42.549118 13867 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.425071 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.401175 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.551736 13870 raft_consensus.cc:2376] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4. Re-sending same reply.
I20260709 12:12:42.552510 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 230) took 1195 ms. Trace:
I20260709 12:12:42.552946 13870 rpcz_store.cc:276] 0709 12:12:41.357261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.362037 (+  4776us) service_pool.cc:224] Handling call
0709 12:12:42.400989 (+1038952us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.552419 (+151430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20035456}
I20260709 12:12:42.554093 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:42.554600 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.555078 13869 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:42.555862 13870 raft_consensus.cc:2393] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:42.479803 15092 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:42.556991 15092 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.557478 15092 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.557651 15040 raft_consensus.cc:3055] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:42.558287 15040 raft_consensus.cc:740] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:42.559333 15040 consensus_queue.cc:260] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.400727 13946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 247) took 1397 ms. Trace:
I20260709 12:12:42.560849 13946 rpcz_store.cc:276] 0709 12:12:41.003446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.007241 (+  3795us) service_pool.cc:224] Handling call
0709 12:12:42.316509 (+1309268us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.400659 (+ 84150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174508416}
I20260709 12:12:42.403625 14802 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.399119 15124 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.563264 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.383852 14993 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.524935 13770 catalog_manager.cc:5697] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 2 to 3, leader changed from 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 3 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:42.402312 15152 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.405728 15117 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:42.380604 14757 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:42.405238 15091 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.529786 13768 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:38506 (request call id 43) took 2090 ms. Trace:
I20260709 12:12:42.494406 14897 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.395865 15055 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.531745 13866 raft_consensus.cc:1275] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:42.568929 13768 rpcz_store.cc:276] 0709 12:12:40.452680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.453408 (+   728us) service_pool.cc:224] Handling call
0709 12:12:41.024293 (+570885us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54005b9854. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ad090 00007fce3814bf3a 00007fce3df01e9c 00007fce3e001706 00007fce3c4ca8a4 00007fce3c4ca832 00007fce3c4ca761 00007fce3c4ca6dc 00007fce3c4c9992 00007fce3647e48c 00007fce3647d8c6
0709 12:12:41.024490 (+   197us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 12:12:42.528705 (+1504215us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=5c203191cf5d4c66a380510923aa713b]
0709 12:12:42.529686 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1503918,"spinlock_wait_cycles":397047680}
I20260709 12:12:42.532986 13941 raft_consensus.cc:1275] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:42.536592 14096 raft_consensus.cc:1240] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:42.574244 14096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 262) took 1730 ms. Trace:
I20260709 12:12:42.574716 14096 rpcz_store.cc:276] 0709 12:12:40.843399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.535881 (+1692482us) service_pool.cc:224] Handling call
0709 12:12:42.536396 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.573933 (+ 37537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.574172 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45568}
I20260709 12:12:42.540000 13947 rpcz_store.cc:276] 0709 12:12:41.328868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.329058 (+   190us) service_pool.cc:224] Handling call
0709 12:12:42.538954 (+1209896us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:42.539154 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.539325 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.539349 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.539391 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.539431 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.539483 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.539591 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26299136}
I20260709 12:12:42.412460 15129 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.405463 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.328960 13943 rpcz_store.cc:276] 0709 12:12:40.977750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.996292 (+ 18542us) service_pool.cc:224] Handling call
0709 12:12:41.564582 (+568290us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:41.564843 (+   261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:41.802811 (+237968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.805325 (+  2514us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:41.921275 (+115950us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.156811 (+235536us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.163316 (+  6505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.171864 (+  8548us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.217541 (+ 45677us) raft_consensus.cc:1685] finished
0709 12:12:42.217575 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.248888 (+ 31313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7573,"raft.queue_time_us":20438,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":40983,"spinlock_wait_cycles":174669568,"thread_start_us":208327,"threads_started":1,"wal-append.queue_time_us":289583}
I20260709 12:12:42.566975 13770 catalog_manager.cc:5697] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } }
I20260709 12:12:42.520061 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.585599 13874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 236) took 1226 ms. Trace:
I20260709 12:12:42.586220 13874 rpcz_store.cc:276] 0709 12:12:41.359196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.223353 (+864157us) service_pool.cc:224] Handling call
0709 12:12:42.400852 (+177499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.446187 (+ 45335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.585307 (+139120us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400883bd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:42.585500 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407211904}
W20260709 12:12:42.588613 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.589097 13873 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:42.592654 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:42.584525 13940 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:42.585330 15040 raft_consensus.cc:3060] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.605957 13872 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
F20260709 12:12:42.600524  7578 test_workload.cc:382] Timed out: Timed out waiting for Table Creation
*** Check failure stack trace: ***
I20260709 12:12:42.592187 14987 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
*** Aborted at 1783599162 (unix time) try "date -d @1783599162" if you are using GNU date ***
I20260709 12:12:42.833982 14987 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.836203 14987 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:42.592828 13866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 232) took 1498 ms. Trace:
I20260709 12:12:42.836597 15110 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.836843 13866 rpcz_store.cc:276] 0709 12:12:41.094397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.095707 (+  1310us) service_pool.cc:224] Handling call
0709 12:12:42.531069 (+1435362us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:42.531326 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.572283 (+ 40957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.590815 (+ 18532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5486848}
I20260709 12:12:42.837599 15110 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.574369 14897 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.841001 15110 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:42.842937 14897 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.584257 15129 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:42.614496 13940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48292 (request call id 235) took 1636 ms (client timeout 1644 ms). Trace:
W20260709 12:12:42.843753 13940 rpcz_store.cc:269] 0709 12:12:40.978276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.996383 (+ 18107us) service_pool.cc:224] Handling call
0709 12:12:42.405308 (+1408925us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.614398 (+209090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140950400}
I20260709 12:12:42.612780 14757 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.844908 14757 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.845338 15129 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:42.847338 14757 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:42.644327 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.848285 13870 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:42.850328 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 153) took 1439 ms. Trace:
I20260709 12:12:42.850795 13870 rpcz_store.cc:276] 0709 12:12:41.411407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.849194 (+1437787us) service_pool.cc:224] Handling call
0709 12:12:42.849627 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.849867 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.849911 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.849979 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.850028 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.850114 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.850260 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:42.658766 15025 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.853284 15025 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.853631 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 237) took 1427 ms. Trace:
I20260709 12:12:42.854298 13870 rpcz_store.cc:276] 0709 12:12:41.426586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.852368 (+1425782us) service_pool.cc:224] Handling call
0709 12:12:42.852891 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.853148 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.853189 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.853258 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:42.853306 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.853386 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.853547 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:42.856052 15025 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:42.696923 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 275727us
I20260709 12:12:42.705165 15152 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:42.714733 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.721174 13869 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:42.727876 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.705199 15179 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.722625 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.731549 14674 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.765218 15055 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:42.770021 15172 log.cc:927] Time spent T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:12:42.770783 15027 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.775367 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:42.778491 13868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 228) took 1422 ms. Trace:
I20260709 12:12:42.779084 15178 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:42.779467 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.756210 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.782044 15069 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:42.783396 15101 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.784838 13872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 238) took 1425 ms. Trace:
I20260709 12:12:42.789561 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:42.796207 14062 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:42.801991 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.805334 13770 catalog_manager.cc:5697] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 2 to 3, leader changed from 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130) to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 3 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.806931 13873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 239) took 1446 ms. Trace:
W20260709 12:12:42.809626 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:42.822021 13867 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:42.777355 15060 consensus_meta.cc:287] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.000s
I20260709 12:12:42.737418 15118 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:42.862638 14095 raft_consensus.cc:3060] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:42.869746 13873 rpcz_store.cc:276] 0709 12:12:41.360116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.806114 (+1445998us) service_pool.cc:224] Handling call
0709 12:12:42.806426 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.806610 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.806635 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.806679 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.806709 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.806772 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.806878 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:42.828101 13771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38470 (request call id 51) took 13151 ms (client timeout 15000 ms). Trace:
I20260709 12:12:42.870283 13947 raft_consensus.cc:1240] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:42.673102 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.858193 13913 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:42.858888 13869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52332 (request call id 233) took 1500 ms. Trace:
I20260709 12:12:42.887727 13869 rpcz_store.cc:276] 0709 12:12:41.358324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.361297 (+  2973us) service_pool.cc:224] Handling call
0709 12:12:42.553886 (+1192589us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501ee9c 00007fce3501ea5b 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.858811 (+304925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29107968}
W20260709 12:12:42.862859 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.891125 13988 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:42.863476 14093 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:42.864843 13872 rpcz_store.cc:276] 0709 12:12:41.359790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.636582 (+1276792us) service_pool.cc:224] Handling call
0709 12:12:42.784113 (+147531us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:42.784306 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.784477 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.784500 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.784539 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.784569 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.784620 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.784757 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5998336}
I20260709 12:12:42.894182 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.895097 13872 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:42.865077 14097 raft_consensus.cc:2376] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5. Re-sending same reply.
W20260709 12:12:42.865655 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 69549.1us
I20260709 12:12:42.869617 13770 catalog_manager.cc:5697] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.897886 14062 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:42.898387 13770 catalog_manager.cc:5697] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
W20260709 12:12:42.884331 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 429888us
I20260709 12:12:42.827224 14021 raft_consensus.cc:2410] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:42.901975 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.902832 14022 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:42.904537 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:42.905493 14020 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:42.896445 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.902755 14062 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:42.912681 13770 catalog_manager.cc:5697] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 4, leader changed from f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132) to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 4 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.915129 13988 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:42.915400 13869 raft_consensus.cc:1275] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:42.919706 13837 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:42.915254 13770 catalog_manager.cc:5697] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 1 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.924997 13873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 248) took 1085 ms. Trace:
I20260709 12:12:42.925412 13873 rpcz_store.cc:276] 0709 12:12:41.839702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.916315 (+1076613us) service_pool.cc:224] Handling call
0709 12:12:42.916588 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.924650 (+  8062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.924683 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.924730 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:42.924763 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.924831 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.924945 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7678}
I20260709 12:12:42.923985 13770 catalog_manager.cc:5697] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 1 to 3, leader changed from f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132) to 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130). New cstate: current_term: 3 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:42.926926 15053 raft_consensus.cc:2764] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:12:42.928722 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:42.866011 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:42.931133 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:42.861606 13987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:42.937386 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 79296.6us
I20260709 12:12:42.932858 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.856585 13870 raft_consensus.cc:1240] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:42.927942 13770 catalog_manager.cc:5697] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:42.866138 14987 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:42.851135 13871 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:42.867426 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:42.949615 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:42.924229 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:42.958220 13872 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:42.948071 13770 catalog_manager.cc:5697] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129). New cstate: current_term: 1 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
W20260709 12:12:42.950590 14021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51094 (request call id 263) took 1829 ms (client timeout 1975 ms). Trace:
I20260709 12:12:42.865978 14089 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:42.922016 15069 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:42.907473 15025 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.955834 13913 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:42.969277 13837 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:42.923061 15060 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.913682 15099 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.913094 15091 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:42.935366 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.965243 14015 raft_consensus.cc:1275] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:42.931376 14913 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:42.976688 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.947878 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.945361 13943 raft_consensus.cc:3060] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:42.858472 15152 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.862571 15027 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:42.930495 15117 raft_consensus.cc:2804] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:42.998334 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.929895 15089 consensus_queue.cc:1059] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:12:42.973834 13947 raft_consensus.cc:1275] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:12:42.960091 14021 rpcz_store.cc:269] 0709 12:12:41.121535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.127018 (+  5483us) service_pool.cc:224] Handling call
0709 12:12:42.257805 (+1130787us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:42.950310 (+692505us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54009b50d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:42.950509 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312790144}
W20260709 12:12:42.884619 13771 rpcz_store.cc:269] 0709 12:12:29.692941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.698028 (+  5087us) service_pool.cc:224] Handling call
0709 12:12:42.828020 (+13129992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:39.451036 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:39.468159 (+ 17123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:39.468208 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:12:39.468225 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:39.468751 (+   526us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:39.468818 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:39.468846 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:39.469206 (+   360us) tablet.cc:701] Row locks acquired
0709 12:12:39.469221 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:12:39.469378 (+   157us) write_op.cc:270] Start()
0709 12:12:39.469506 (+   128us) write_op.cc:276] Timestamp: P: 1783599159469325 usec, L: 0
0709 12:12:39.469524 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:12:39.470258 (+   734us) log.cc:844] Serialized 928 byte log entry
0709 12:12:40.236037 (+765779us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:40.428347 (+192310us) op_driver.cc:464] REPLICATION: finished
0709 12:12:40.626717 (+198370us) write_op.cc:301] APPLY: starting
0709 12:12:40.626821 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:40.626954 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:40.626974 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:40.627475 (+   501us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:40.627675 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:12:40.627732 (+    57us) write_op.cc:312] APPLY: finished
0709 12:12:40.627938 (+   206us) log.cc:844] Serialized 28 byte log entry
0709 12:12:40.637416 (+  9478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:40.637501 (+    85us) write_op.cc:454] Released schema lock
0709 12:12:40.637547 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:40.637922 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:40.637949 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":620617,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":192281,"apply.run_cpu_time_us":2022,"apply.run_wall_time_us":11203,"num_ops":2,"prepare.queue_time_us":134363,"prepare.run_cpu_time_us":22633,"prepare.run_wall_time_us":299633,"raft.queue_time_us":115476,"raft.run_cpu_time_us":40999,"raft.run_wall_time_us":248083,"replication_time_us":941797,"spinlock_wait_cycles":22847872,"thread_start_us":468874,"threads_started":4,"wal-append.queue_time_us":287092,"wal-append.run_cpu_time_us":58115,"wal-append.run_wall_time_us":2032866}]]}
I20260709 12:12:43.005693 14021 raft_consensus.cc:1275] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:42.974135 15104 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:42.861281 14674 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.944648 15110 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:42.983951 13944 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:42.966874 14093 raft_consensus.cc:1275] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:42.982491 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:42.999359 13948 raft_consensus.cc:2468] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:43.021729 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.973349 15111 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:42.967420 15069 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.912906 15118 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:42.931699 15055 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.922606 14088 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:43.009359 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.006373 15124 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.070060 13869 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:42.988714 15053 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:42.980813 14757 raft_consensus.cc:2764] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:12:43.026571 13914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.012s	sys 0.022s
I20260709 12:12:43.018894 15011 raft_consensus.cc:3055] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:12:43.041706 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 114578us
I20260709 12:12:42.995499 14913 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:42.989631 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.035472 13867 raft_consensus.cc:1275] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:43.040906 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.012044 15104 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.074769 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:42.976511 15181 consensus_queue.cc:1048] T dcf784ecd514417286b3130eab79f085 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.073s
W20260709 12:12:43.077137 13914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.022s
I20260709 12:12:43.035212 13941 raft_consensus.cc:2393] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:43.017308 13872 raft_consensus.cc:1275] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:42.982132 15025 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.082890 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.100414 14023 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:43.011200 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 229) took 1654 ms. Trace:
I20260709 12:12:43.015769 15117 raft_consensus.cc:697] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:43.025152 15111 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.087160 14062 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:43.074239 15053 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:42.988406 15099 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.047820 15069 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.090817 15129 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.095889 13947 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:43.129236 14020 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:43.000397 13870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 238) took 1569 ms. Trace:
I20260709 12:12:43.078266 14966 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.085904 15011 raft_consensus.cc:740] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:43.087961 13866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 246) took 1681 ms. Trace:
I20260709 12:12:43.102942 14092 raft_consensus.cc:2410] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:43.108451 14802 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.127081 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.103497 15104 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.096493 15008 consensus_queue.cc:1048] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:12:43.102463 15113 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:43.102574 15108 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.137894 14023 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
W20260709 12:12:43.139365 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52323.5us
I20260709 12:12:43.121022 15111 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.077858 15055 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.863106 15178 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.125525 15053 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:43.083865 15124 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.108436 14014 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:43.143710 13914 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:43.144301 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.190284 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.145236 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.191509 13947 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:43.125108 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:42.860016 15179 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.195328 15179 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:43.129120 15092 consensus_meta.cc:287] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.571s	user 0.015s	sys 0.001s
I20260709 12:12:43.196506 15092 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.199285 15092 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.133396 15101 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.201568 15101 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.145557 14802 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:42.862754 13868 rpcz_store.cc:276] 0709 12:12:41.356289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.361662 (+  5373us) service_pool.cc:224] Handling call
0709 12:12:42.312786 (+951124us) spinlock_profiling.cc:243] Waited 9.99 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:42.313124 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.313701 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.313762 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.314541 (+   779us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.658168 (+343627us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:42.668033 (+  9865us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.694899 (+ 26866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.698733 (+  3834us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.778044 (+ 79311us) raft_consensus.cc:1685] finished
0709 12:12:42.778167 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.778398 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2792,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":7411,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":5006,"spinlock_wait_cycles":22972160,"thread_start_us":335225,"threads_started":1,"wal-append.queue_time_us":398145}
I20260709 12:12:43.161682 15178 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.148474 15110 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:43.162325 15117 consensus_queue.cc:237] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.163357 15060 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.163823 15011 consensus_queue.cc:260] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.164819 15118 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.165647 15099 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.136560 14966 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.166396 14913 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.166887 15025 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.171813 14674 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.156333 15108 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.149708 15113 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.173324 15055 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.176826 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:43.185884 15008 consensus_queue.cc:1048] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:12:43.206152 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.286201 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.287199 13948 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
I20260709 12:12:43.131004 13870 rpcz_store.cc:276] 0709 12:12:41.427000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.855723 (+1428723us) service_pool.cc:224] Handling call
0709 12:12:42.856231 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.953961 (+ 97730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.995933 (+ 41972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.165655 15152 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.295642 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.132951 15129 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.219173 14095 raft_consensus.cc:2468] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:43.204411 15101 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.229671 14090 raft_consensus.cc:2393] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:43.136139 13866 rpcz_store.cc:276] 0709 12:12:41.402740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.838563 (+1435823us) service_pool.cc:224] Handling call
0709 12:12:42.839051 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.839335 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:12:42.839660 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 12:12:43.012128 (+172468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.019302 (+  7174us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:43.025297 (+  5995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.045152 (+ 19855us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.084429 (+ 39277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26076,"prepare.queue_time_us":180,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":9193,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9923,"thread_start_us":157273,"threads_started":1,"wal-append.queue_time_us":366565}
I20260709 12:12:43.233659 15032 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:43.319289 15032 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.319785 15032 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.320524 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.321391 14016 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:43.322460 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:43.322738 15040 consensus_meta.cc:287] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 12:12:43.323382 15069 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.323971 14088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37108 (request call id 251) took 1068 ms. Trace:
I20260709 12:12:43.324362 14088 rpcz_store.cc:276] 0709 12:12:42.255612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.260871 (+  5259us) service_pool.cc:224] Handling call
0709 12:12:43.323756 (+1062885us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540022d8d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:43.323902 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118414080}
I20260709 12:12:43.326185 15129 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.235077 14966 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.328300 14015 raft_consensus.cc:2368] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4.
W20260709 12:12:43.240326 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 175354us
I20260709 12:12:43.329632 13913 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:43.330071 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.330521 13913 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:43.330880 14020 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:43.331969 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.245151 14022 raft_consensus.cc:3060] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.332828 15152 raft_consensus.cc:2804] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:43.333268 15152 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:43.333602 15152 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:43.243281 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 67359.7us
I20260709 12:12:43.323414 15040 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.336478 13912 leader_election.cc:400] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4.
I20260709 12:12:43.336860 13912 leader_election.cc:403] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:12:43.336673 15040 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.178238 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:43.337342 14092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 264) took 2041 ms (client timeout 2626 ms). Trace:
I20260709 12:12:43.327893 15069 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.338336 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:43.244266 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.339066 15129 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:43.339694 15129 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:43.340226 15129 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.344771 13873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 244) took 1185 ms. Trace:
I20260709 12:12:43.345669 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.346621 14020 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:43.347597 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.348913 15055 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.349583 15055 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.351115 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.351845 15055 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.352228 15124 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.354163 15108 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.355401 15113 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.361133 15040 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:43.244652 15187 log.cc:927] Time spent T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:12:43.299172 13949 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
W20260709 12:12:43.284076 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.301165 13840 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:43.362932 13988 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:43.363168 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 62084.4us
I20260709 12:12:43.303666 14802 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:43.283563 15198 log.cc:927] Time spent T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:12:43.366500 13874 raft_consensus.cc:2468] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:43.345216 13873 rpcz_store.cc:276] 0709 12:12:42.159293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.926397 (+767104us) service_pool.cc:224] Handling call
0709 12:12:42.926670 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.020796 (+ 94126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.020829 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.020879 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:43.020909 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.344487 (+323578us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b540026f054. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:43.344530 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.344703 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215931648}
I20260709 12:12:43.339067 14023 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:43.369072 14674 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:43.369491 14674 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:43.369876 14674 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:12:43.371397 15196 log.cc:927] Time spent T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.144s	user 0.003s	sys 0.000s
W20260709 12:12:43.305306 15190 log.cc:927] Time spent T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:43.105744 13865 rpcz_store.cc:276] 0709 12:12:41.356673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.361567 (+  4894us) service_pool.cc:224] Handling call
0709 12:12:42.368250 (+1006683us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:42.368620 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.369231 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.369283 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.533942 (+164659us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b2c0012c678. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:12:42.534618 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.913257 (+378639us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:12:42.932122 (+ 18865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.944442 (+ 12320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.988644 (+ 44202us) raft_consensus.cc:1685] finished
0709 12:12:42.993820 (+  5176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.007213 (+ 13393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43730,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":179217024,"thread_start_us":344267,"threads_started":1,"wal-append.queue_time_us":449269}
I20260709 12:12:43.307179 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:43.337996 14092 rpcz_store.cc:269] 0709 12:12:41.296075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.297895 (+  1820us) service_pool.cc:224] Handling call
0709 12:12:43.337070 (+2039175us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54000cadd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:43.337257 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3861934848}
I20260709 12:12:43.375816 15184 raft_consensus.cc:2804] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:43.283958 15011 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.376665 15184 raft_consensus.cc:697] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:43.378134 15184 consensus_queue.cc:237] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.286013 15027 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.221531 15110 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.382577 15110 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.336488 13942 raft_consensus.cc:1275] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:43.288326 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.385964 13948 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:43.386119 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.387241 13945 raft_consensus.cc:2393] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:43.242007 15193 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:43.389123 15193 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.389551 15193 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.391695 13869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 157) took 1066 ms. Trace:
I20260709 12:12:43.392261 13869 rpcz_store.cc:276] 0709 12:12:42.325129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.962213 (+637084us) service_pool.cc:224] Handling call
0709 12:12:42.979917 (+ 17704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.070682 (+ 90765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.391412 (+320730us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b5400508f54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:43.391617 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206440832}
W20260709 12:12:43.392995 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 60513.5us
I20260709 12:12:43.312227 13986 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.396699 15192 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:43.396741 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 84615.2us
I20260709 12:12:43.398272 13986 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.384810 14950 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:43.398454 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.399391 13941 raft_consensus.cc:2410] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:12:43.399817 14950 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:43.400381 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.403182 13840 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:43.354159 14020 raft_consensus.cc:1240] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:12:43.399394 13986 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:43.411453 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 267771us
I20260709 12:12:43.420398 14022 raft_consensus.cc:2468] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:43.424409 13986 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:43.422287 13914 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:43.434679 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.437744 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.403453 14987 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:43.411489 15040 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:43.453234 14061 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:43.429555 14645 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:43.442466 15058 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:43.443367 14966 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:43.459141 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:43.441771 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 227262us
I20260709 12:12:43.463204 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:43.464803 14096 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:43.466527 14090 raft_consensus.cc:1275] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:43.454226 14987 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.451790 15040 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:43.414508 15104 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.472900 15008 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:43.473371 15008 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.428987 15069 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:12:43.455762 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:43.471783 15032 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.470132 15040 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:43.455915 14060 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.474164 15058 raft_consensus.cc:697] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:43.479875 15053 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.481227 15089 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.460590 14966 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.482193 14966 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.481843 15089 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.483615 15111 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.484911 13944 raft_consensus.cc:2368] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:43.485613 13943 raft_consensus.cc:2468] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:43.486492 15179 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4.
I20260709 12:12:43.473758 15008 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.479826 15058 consensus_queue.cc:237] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.491285 15111 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.492571 15053 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.492801 15101 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:43.493343 15101 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.493680 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:43.499432 14061 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:43.505977 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 356848us
I20260709 12:12:43.508769 13913 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:43.510828 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.513183 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.518865 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:43.520756 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:43.524600 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.526044 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.528463 13986 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:43.493729 15101 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.529675 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:43.525291 14913 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:43.531352 14913 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.531729 14913 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.532786 15181 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:43.535867 13986 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.544780 15032 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.545713 15089 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.534577 15152 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.534006 14016 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:43.550022 15104 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.550231 14950 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:43.550295 14645 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:12:43.548604 15152 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.559374 14987 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.560084 14987 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.566033 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:43.567631 14987 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.572109 14987 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.522543 15069 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.527910 15192 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.582499 15192 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.563858 15040 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:43.541529 15181 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:43.534332 14674 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.590127 15181 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:43.585564 15069 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.599596 15181 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.626906 15192 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.645663 15193 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:43.654600 15207 log.cc:927] Time spent T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:12:43.656935 15208 log.cc:927] Time spent T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:12:43.661602 15193 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:43.707587 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 332015us
I20260709 12:12:43.795626 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:43.717651 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 208813us
I20260709 12:12:43.800822 15184 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.801610 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.802870 15184 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:43.804193 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.539045 13943 raft_consensus.cc:2368] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:43.723875 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.805619 15152 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:43.715922 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 379323us
I20260709 12:12:43.806485 15152 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:43.807343 15152 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:43.810999 13912 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.729948 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:43.813468 13942 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.730984 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:43.816068 13948 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.823513 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.823683 14757 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:43.825277 14757 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.826720 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.833118 15040 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:43.835844 15069 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:43.838546 14950 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.839612 14950 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
PC: @                0x0 (unknown)
I20260709 12:12:43.849145 15184 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.849527 14950 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:43.856709 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.857841 13874 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:43.849154 14674 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:43.879772 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.880995 13874 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:43.886535 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 75907us
I20260709 12:12:43.889220 15178 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:43.852308 13989 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.897763 14950 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:43.898460 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 46579.2us
I20260709 12:12:43.916771 13948 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:43.935719 15110 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:43.936865 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 424726us
I20260709 12:12:43.946990 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:43.947443 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.947944 13912 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:43.948351 13869 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:43.949283 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.949729 13870 raft_consensus.cc:1275] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:43.950460 15092 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:43.951097 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:43.958669 13866 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.950506 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.952613 15222 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.958202 15092 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:43.935786 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:43.964532 13874 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:43.978252 15222 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:43.988093 13989 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
W20260709 12:12:43.986709 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 415410us
I20260709 12:12:43.982805 14757 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.018872 13840 leader_election.cc:400] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:44.019474 13840 leader_election.cc:403] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:12:44.018985 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 56451.5us
I20260709 12:12:44.020834 15092 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:44.024547 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:44.035780 14966 consensus_meta.cc:287] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.017s
I20260709 12:12:44.035969 15156 consensus_queue.cc:1048] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:44.037487 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:44.038364 13865 raft_consensus.cc:3060] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.028074 15231 raft_consensus.cc:2804] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:44.051529 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:44.056885 15231 raft_consensus.cc:697] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:44.053270 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:44.065796 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:44.077428 15129 consensus_meta.cc:287] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.020s
I20260709 12:12:44.077685 13867 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
*** SIGABRT (@0x3e800001d9a) received by PID 7578 (TID 0x7fce30c89840) from PID 7578; stack trace: ***
I20260709 12:12:44.078118 14019 raft_consensus.cc:2410] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:44.078016 15129 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
    @           0x2d4280 __tsan::CallUserSignalHandler() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
    @           0x2d6763 rtl_sigaction() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
I20260709 12:12:44.078837 13873 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.046257 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.067131 15222 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.058943 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:44.070242 13942 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:44.071257 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.047889 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.076404 15231 consensus_queue.cc:237] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.097290 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:44.099263 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.100019 13874 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:44.104789 13869 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:44.104928 15104 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:44.100143 15152 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.111528 15152 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:44.121613 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.111992 15129 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.121122 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.056209 14061 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:44.054755 13871 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:44.042429 14966 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:44.143489 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 87506.5us
I20260709 12:12:44.150995 15200 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:44.152038 15200 raft_consensus.cc:697] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:44.153692 15200 consensus_queue.cc:237] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.070765 15181 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.173295 13866 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:44.174264 14674 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:44.179595 15181 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.159302 15156 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.185793 13873 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
W20260709 12:12:44.186657 15008 consensus_meta.cc:287] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.687s	user 0.016s	sys 0.009s
I20260709 12:12:44.187281 15008 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.190002 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:44.199342 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 50107.5us
I20260709 12:12:44.191589 13867 raft_consensus.cc:1240] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:12:44.192663 13866 raft_consensus.cc:1275] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:44.208017 13838 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.214668 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.215030 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.215416 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.215740 14097 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
W20260709 12:12:44.217196 14913 consensus_meta.cc:287] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.625s	user 0.018s	sys 0.008s
I20260709 12:12:44.217965 14913 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:44.219192 15101 consensus_meta.cc:287] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.008s
I20260709 12:12:44.212598 15156 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.219733 14966 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.229956 15053 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:44.233214 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:44.226076 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:44.241570 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:44.212795 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:44.288992 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:44.245124 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.245502 14801 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:44.246332 13986 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:44.246594 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 298878us
I20260709 12:12:44.250914 15179 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
W20260709 12:12:44.252470 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.255122 15156 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:44.256386 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 194414us
I20260709 12:12:44.258487 14802 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.259373 15152 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:44.260751 15101 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.280267 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:44.280866 14913 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:44.281525 15008 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:44.286942 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.288992 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.290146 13865 raft_consensus.cc:2468] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:44.294284 14097 raft_consensus.cc:2368] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:44.308339 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:44.309643 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:44.310403 15179 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.312539 13912 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:44.313186 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 119149us
I20260709 12:12:44.297789 13871 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:44.317474 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 71512.5us
I20260709 12:12:44.318089 14966 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:44.319360 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.268613 15053 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.331127 15101 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:44.326682 14062 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:44.348145 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 68164.5us
I20260709 12:12:44.320942 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:44.351810 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.348486 14090 raft_consensus.cc:2410] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:44.351217 13947 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:44.360049 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.324211 14802 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.337209 15040 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:44.380429 14097 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:44.353595 13867 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:44.391539 14802 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:44.382170 14093 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:44.385007 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.393157 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:44.393738 14088 raft_consensus.cc:2410] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:12:44.385176 13837 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.386308 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.387166 13866 raft_consensus.cc:2393] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:44.387483 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:44.382874 15040 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.398064 15040 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:44.397439 13940 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:44.403112 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:44.403519 15237 log.cc:927] Time spent T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:44.403993 14022 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:44.366143 15053 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.369014 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.423589 13838 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.437067 13914 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.420924 15181 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.443253 15156 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:44.467106 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 85567.1us
W20260709 12:12:44.460582 15245 log.cc:927] Time spent T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
W20260709 12:12:44.475832 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 163436us
I20260709 12:12:44.458745 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:44.480809 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 188345us
W20260709 12:12:44.490917 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 105898us
I20260709 12:12:44.486377 14016 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:12:44.494910 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 125621us
I20260709 12:12:44.489933 14097 raft_consensus.cc:1275] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:44.511080 15205 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.511602 15205 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.511996 15205 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.507460 14062 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:44.502645 13912 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:44.489967 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:44.518085 15184 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.525285 15184 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:44.527669 15240 log.cc:927] Time spent T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:12:44.528800 15202 raft_consensus.cc:2804] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:44.529367 15202 raft_consensus.cc:697] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:44.530342 15202 consensus_queue.cc:237] T 8ed16159ff574584ad17638f2083106f P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.481748 15181 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.536527 15181 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.537004 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:44.537807 14020 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:44.540232 14092 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.540836 15152 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:44.541261 15152 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.541635 15152 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:44.542062 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:44.542857 14091 raft_consensus.cc:2393] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 5: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
W20260709 12:12:44.544245 15247 log.cc:927] Time spent T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:12:44.549993 14096 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:44.552244 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.555485 13838 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:44.557412 14966 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.558183 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:44.558868 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 68342.9us
I20260709 12:12:44.558425 14966 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.560882 14950 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.562002 14950 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.515479 15231 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.563647 15231 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.566236 15231 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.560953 15254 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:44.574565 14063 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:44.532063 13871 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:44.576941 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.579958 13913 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:44.589548 14061 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:44.587502 15179 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:44.591209 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:44.583128 14913 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:44.586732 14801 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:44.621284 14801 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.623404 14801 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:44.624763 14950 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:44.625098 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 245326us
I20260709 12:12:44.626451 13914 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:44.626564 14061 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:44.627668 15231 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:44.628521 15179 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:44.628340 15231 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
    @     0x7fce3854b980 (unknown) at ??:0
I20260709 12:12:44.629532 15027 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:44.592231 14966 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.628348 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:44.662415 13947 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 6.
W20260709 12:12:44.664975 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 109683us
I20260709 12:12:44.660773 14913 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:44.657605 15101 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:12:44.675098 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 156333us
I20260709 12:12:44.630818 15231 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.619107 15040 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.616084 15212 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:12:44.680748 13838 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.683219 13914 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:44.656558 15179 consensus_queue.cc:1059] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:12:44.673343 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.687525 13840 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:44.678642 14913 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:44.699899 14913 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.701436 15179 raft_consensus.cc:3055] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:44.702019 15179 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:44.703279 15179 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.708783 15200 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.666332 15053 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:44.615477 15117 consensus_queue.cc:1059] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
W20260709 12:12:44.721467 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 46124.4us
W20260709 12:12:44.701475 15243 log.cc:927] Time spent T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:12:44.724959 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 150482us
I20260709 12:12:44.730654 15152 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.737407 13914 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:44.698763 15027 raft_consensus.cc:2749] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:44.718863 15089 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:44.756913 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 74122.9us
W20260709 12:12:44.744920 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 129331us
I20260709 12:12:44.750059 13986 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:44.759017 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 105748us
I20260709 12:12:44.726378 14802 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.763476 14802 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.738857 15179 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:44.766716 13838 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:44.763842 15251 log.cc:927] Time spent T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:12:44.773818 13914 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:44.760756 15156 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:44.763885 14802 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.776162 13840 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:44.760236 15027 consensus_queue.cc:1048] T 16e6426591bd40bcac05d7dc8b5bef57 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:12:44.805732 15260 raft_consensus.cc:2804] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:12:44.812436 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 62494.9us
I20260709 12:12:44.814396 15184 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:44.818246 15252 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:44.818766 15110 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.786551 15156 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.825835 15053 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.830219 15200 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:44.831146 15259 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.745600 15089 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.816298 15205 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.853377 14801 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:44.855522 15152 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.806282 15231 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:44.858407 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 96675.6us
W20260709 12:12:44.858366 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 99642.1us
I20260709 12:12:44.840937 15110 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.864209 14062 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:44.845391 15156 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:44.862380 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 95698us
I20260709 12:12:44.866082 13986 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.856310 15200 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:44.873476 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.881240 13986 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:44.858023 15260 raft_consensus.cc:697] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:44.863551 15231 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
W20260709 12:12:44.884546 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 115697us
I20260709 12:12:44.868842 15110 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.871891 15008 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:44.884503 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 114784us
I20260709 12:12:44.875404 14966 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:44.876822 15152 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.892810 14950 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:12:44.892946 15181 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.907577 15181 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.908238 15181 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.878144 15027 consensus_queue.cc:1048] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:12:44.889170 15231 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.926266 15089 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.897836 15152 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:44.929508 15152 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.928524 13838 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:44.893040 13989 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:41801 timed out after 1.547s (SENT) [suppressed 14 similar messages]
I20260709 12:12:44.894620 15008 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.912040 14913 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:44.944151 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 51157.2us
I20260709 12:12:44.949661 15260 consensus_queue.cc:237] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:44.945539 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 46642.4us
I20260709 12:12:44.941278 14757 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:44.961483 13838 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:44.962088 13914 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:44.962647 15040 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:44.874471 15259 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.974429 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.984038 15027 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:44.984717 15027 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:44.985149 15027 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.989822 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:44.952065 15008 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.990798 14014 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:44.960487 15231 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:44.999080 15231 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:44.999531 15259 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:45.000715 15179 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:45.011322 15200 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.013511 15205 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:44.970079 14757 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:45.014724 14757 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:45.017611 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 77177.3us
I20260709 12:12:44.979982 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:45.021588 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 128314us
I20260709 12:12:45.023388 14023 raft_consensus.cc:2393] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 5: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
W20260709 12:12:45.024422 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 55049.7us
W20260709 12:12:45.026360 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 53214.2us
I20260709 12:12:45.026818 13914 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.034538 13944 raft_consensus.cc:1275] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:45.035234 15222 raft_consensus.cc:3055] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:45.035704 15222 raft_consensus.cc:740] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:45.036136 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.041363 15222 consensus_queue.cc:260] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:44.990361 14913 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.041771 13914 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:45.045652 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:45.047290 14092 consensus_meta.cc:287] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.002s
I20260709 12:12:45.047731 14092 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:45.048769 15212 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:45.050218 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 88902.5us
W20260709 12:12:45.050871 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 105484us
I20260709 12:12:45.051244 13838 leader_election.cc:400] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4.
I20260709 12:12:45.051599 13838 leader_election.cc:403] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.068397 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.042641 15222 raft_consensus.cc:3060] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:45.066183 14062 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:45.058887 15274 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:45.060701 15254 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4.
I20260709 12:12:45.091300 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.092590 13948 raft_consensus.cc:2393] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:45.037483 14802 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:45.096475 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.096274 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:45.097322 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 67686.3us
I20260709 12:12:45.099751 14801 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:45.101068 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.101161 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.101588 15273 consensus_queue.cc:1048] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:45.102459 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.103608 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.103888 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.105194 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.105561 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.105868 13944 raft_consensus.cc:2393] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
W20260709 12:12:45.121758 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 55702.4us
I20260709 12:12:45.081784 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.133311 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.134407 13948 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:45.128008 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:45.136494 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 53131.4us
I20260709 12:12:45.140252 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:45.144016 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 88588us
I20260709 12:12:45.077188 14757 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.148258 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.146885 13838 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.152218 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.080412 15156 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
    @     0x7fce31949e87 gsignal at ??:0
I20260709 12:12:45.136276 15273 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:45.155632 14757 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:45.156293 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:45.156733 15268 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:45.131358 15256 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.105208 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.167781 15027 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.174243 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.175395 15266 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.177259 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.185343 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:45.214222 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:45.205459 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.215983 14096 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:45.148092 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.191046 14674 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.191505 15256 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.192107 14088 raft_consensus.cc:1240] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:45.193215 13872 raft_consensus.cc:1240] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:12:45.195504 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.202461 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.200023 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.205148 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.199709 15273 raft_consensus.cc:697] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:45.174302 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.243132 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.243383 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.243629 13946 raft_consensus.cc:2376] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4. Re-sending same reply.
I20260709 12:12:45.244217 13867 raft_consensus.cc:2393] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 3: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:45.244699 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.245431 13946 raft_consensus.cc:2368] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:45.246255 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.247321 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.247820 13946 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:45.215914 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 134486us
I20260709 12:12:45.251374 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.251586 13944 raft_consensus.cc:1275] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:45.218737 13948 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:45.181205 15110 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.221781 14089 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:45.254654 15110 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.254963 15184 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:12:45.255831 13943 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 4: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:45.186694 13986 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:45.188553 15268 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.168483 15181 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.204998 15156 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:45.222815 14014 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 6.
I20260709 12:12:45.233142 14097 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
W20260709 12:12:45.239766 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 92981.2us
I20260709 12:12:45.240386 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.214226 14913 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.241606 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:45.242899 13866 raft_consensus.cc:1240] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:45.244419 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.258119 13989 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:45.260803 13945 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
W20260709 12:12:45.267629 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 81023.2us
I20260709 12:12:45.213021 15200 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.242588 15273 consensus_queue.cc:237] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.280738 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.290390 13872 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.298398 14020 raft_consensus.cc:2368] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4.
I20260709 12:12:45.299629 13838 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.260937 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:45.263306 15268 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:45.300662 13837 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.313359 14018 raft_consensus.cc:1275] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:45.274509 15231 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:45.217671 15266 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.316326 14966 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:45.331074 14966 raft_consensus.cc:697] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:45.331188 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:45.332173 14966 consensus_queue.cc:237] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.335705 15256 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:45.337496 15181 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.319481 14950 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:45.273823 14913 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:45.321666 13913 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:45.322767 14063 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.339600 13872 raft_consensus.cc:2468] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:45.324203 14017 raft_consensus.cc:1240] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:45.279542 15152 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:45.330395 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 64631.2us
I20260709 12:12:45.351517 13838 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.311826 14757 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:45.342540 14023 raft_consensus.cc:1275] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:45.342190 14096 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:45.323102 15101 consensus_queue.cc:1048] T f903e94ec2ba4603b5cf9a666701027c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:45.345328 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 44759.6us
W20260709 12:12:45.349088 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.356400 13947 raft_consensus.cc:1240] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:45.357426 15266 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.354771 15200 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.357923 14063 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.360246 14913 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:45.362783 15268 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.342788 15231 raft_consensus.cc:697] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:45.366616 13837 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.340760 15279 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.371615 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:45.350780 15110 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:45.363595 15027 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:45.383333 13914 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:45.357275 15156 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:12:45.388393 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 109748us
I20260709 12:12:45.384373 13988 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.366304 15152 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:45.393110 14913 raft_consensus.cc:2749] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.471411 13866 raft_consensus.cc:1240] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:12:45.473452 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.474153 13946 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:45.475834 14089 raft_consensus.cc:2468] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 6.
I20260709 12:12:45.476204 13866 raft_consensus.cc:1275] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:45.477694 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.478049 15008 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.479300 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.480067 13866 raft_consensus.cc:2368] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:45.480338 15008 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:45.416597 14950 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.418463 13986 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:45.419062 14966 consensus_queue.cc:1059] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:45.419893 15184 consensus_queue.cc:1048] T 1a7cfd49af7649a6b615a1ca594b2c67 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:12:45.424960 15268 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:45.426505 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 49867.4us
I20260709 12:12:45.426692 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:45.455346 14757 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.524032 15214 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:45.392859 15110 raft_consensus.cc:697] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:45.524838 15214 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.525861 15110 consensus_queue.cc:237] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.527130 15214 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:45.427856 14063 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.375001 14674 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:45.465757 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 110117us
I20260709 12:12:45.463526 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.391294 14801 consensus_queue.cc:1059] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:12:45.386647 15231 consensus_queue.cc:237] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:45.486495 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.532903 13873 raft_consensus.cc:3060] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.488603 13866 raft_consensus.cc:1240] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:45.415300 15279 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.559314 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:45.504485 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 86062us
I20260709 12:12:45.505759 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.510907 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.511797 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.427106 15179 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:45.511817 14950 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:45.515390 14802 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.517534 15268 consensus_queue.cc:1059] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:45.519824 13914 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.556701 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.556952 13868 raft_consensus.cc:1240] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:45.558598 13837 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:45.576735 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 54680.5us
I20260709 12:12:45.578769 14061 leader_election.cc:400] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4.
I20260709 12:12:45.579317 14061 leader_election.cc:403] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:12:45.580937 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 61214.8us
W20260709 12:12:45.581053 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 153337us
I20260709 12:12:45.582235 14063 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.583643 13914 leader_election.cc:400] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:45.584081 13914 leader_election.cc:403] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.588950 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.559851 15008 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.589596 13872 raft_consensus.cc:2376] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4. Re-sending same reply.
I20260709 12:12:45.590662 13837 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:45.587251 15179 raft_consensus.cc:697] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:45.595222 15179 consensus_queue.cc:237] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.604322 14063 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.604386 15296 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:45.588877 15205 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:45.625725 15254 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:45.629360 14062 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.589712 13865 raft_consensus.cc:2376] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4. Re-sending same reply.
I20260709 12:12:45.589213 15200 consensus_queue.cc:1048] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:12:45.617211 15259 raft_consensus.cc:2804] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:45.635336 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.647264 14096 raft_consensus.cc:2368] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:45.583542 15266 consensus_queue.cc:1048] T c436335260f04d91845c11162c70c7f1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:12:45.616753 15101 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.641382 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.628909 15008 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.630550 15152 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 4. Current term is 5.
I20260709 12:12:45.643622 14913 consensus_queue.cc:1059] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:12:45.654312 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.655594 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.635360 15202 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:45.626430 15296 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:45.660859 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 85702.1us
I20260709 12:12:45.667913 13873 raft_consensus.cc:2468] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:45.610167 15274 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:12:45.644547 15117 raft_consensus.cc:2804] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:45.689070 13837 leader_election.cc:400] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3.
I20260709 12:12:45.646896 14966 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.694975 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 111414us
I20260709 12:12:45.698288 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.658131 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:45.701026 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.701593 13873 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.685074 15259 raft_consensus.cc:697] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:45.706012 13914 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:45.691658 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:45.638594 15254 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.721864 13988 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.727286 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:45.696877 15296 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.703130 15202 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.726997 15117 raft_consensus.cc:697] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:45.731518 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:45.733474 15288 log.cc:927] Time spent T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:12:45.707909 15261 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:45.757550 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:45.763621 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 159404us
I20260709 12:12:45.765594 14063 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.719739 14950 raft_consensus.cc:697] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:45.772934 13872 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:45.776909 13873 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:45.778702 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.780755 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:45.704038 14966 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:45.781667 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.782313 13872 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 1.
I20260709 12:12:45.784478 13914 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
    @     0x7fce3194b7f1 abort at ??:0
I20260709 12:12:45.789239 15117 consensus_queue.cc:237] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
    @           0x2da276 abort at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
I20260709 12:12:45.794767 14021 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:45.796783 15310 raft_consensus.cc:2804] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:45.801098 14950 consensus_queue.cc:237] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:45.792383 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:45.804199 14063 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.790447 15222 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.783725 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.826187 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:45.826546 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 81784.2us
I20260709 12:12:45.814960 15256 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.829847 14023 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:45.814437 15266 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:45.834811 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.820658 15274 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:45.841388 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:45.842126 14022 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:45.846493 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:45.830693 14014 raft_consensus.cc:1240] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:45.850852 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 129084us
W20260709 12:12:45.855243 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 51136.2us
I20260709 12:12:45.856101 14063 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.843801 15274 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:45.865953 15300 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.866065 13988 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.866216 15304 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.869357 15304 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.871866 15304 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.865792 15308 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.845266 15279 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.895080 13838 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.863572 13870 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 4: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:45.894591 14061 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:45.903447 14061 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:45.843993 15256 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.905519 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.864961 15274 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:45.896705 15266 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.913468 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:45.896597 15101 raft_consensus.cc:3055] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:12:45.918046 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 52082.6us
I20260709 12:12:45.898243 15310 raft_consensus.cc:697] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:45.842831 15259 consensus_queue.cc:237] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.908231 14757 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.923156 15301 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.908515 15117 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:45.925263 15202 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.911521 15040 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.920091 15101 raft_consensus.cc:740] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:45.932435 13870 raft_consensus.cc:1240] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:45.933764 15256 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:45.908867 15261 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:12:45.929420 15285 log.cc:927] Time spent T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.499s	user 0.007s	sys 0.003s
I20260709 12:12:45.940860 15117 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.949334 15117 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:45.950980 15279 raft_consensus.cc:2749] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.937222 15254 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:45.917268 15299 consensus_queue.cc:1059] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:12:45.952837 13770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38490 (request call id 48) took 8181 ms. Trace:
I20260709 12:12:45.953780 15320 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:45.954540 15320 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.955929 15310 consensus_queue.cc:237] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.939010 13988 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.946250 15301 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:45.945387 15261 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.973377 14063 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.966579 13988 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:45.976717 13988 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:45.964501 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:45.983215 13988 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:45.953506 15299 raft_consensus.cc:3055] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:45.930851 15296 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:45.989166 14913 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:45.971432 15301 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:45.940707 14757 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.997581 15314 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:45.966926 15306 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:45.972786 15307 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:45.943877 14950 consensus_queue.cc:1059] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:12:46.002024 14063 leader_election.cc:400] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3.
I20260709 12:12:45.982183 15279 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:45.973181 15261 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:45.973448 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:45.986423 15300 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:45.990411 15299 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:46.008785 14063 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:45.953316 13770 rpcz_store.cc:276] 0709 12:12:37.771155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.775512 (+  4357us) service_pool.cc:224] Handling call
0709 12:12:45.952588 (+8177076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:43.161316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:43.162577 (+  1261us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:43.162646 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:12:43.162696 (+    50us) tablet.cc:662] Decoding operations
0709 12:12:43.164848 (+  2152us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:43.164946 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:43.165005 (+    59us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:12:43.180989 (+ 15984us) tablet.cc:701] Row locks acquired
0709 12:12:43.182151 (+  1162us) write_op.cc:260] PREPARE: finished
0709 12:12:43.217446 (+ 35295us) write_op.cc:270] Start()
0709 12:12:43.227859 (+ 10413us) write_op.cc:276] Timestamp: P: 1783599163217356 usec, L: 0
0709 12:12:43.230725 (+  2866us) op_driver.cc:348] REPLICATION: starting
0709 12:12:43.305091 (+ 74366us) log.cc:844] Serialized 4033 byte log entry
0709 12:12:43.860356 (+555265us) op_driver.cc:464] REPLICATION: finished
0709 12:12:43.973436 (+113080us) write_op.cc:301] APPLY: starting
0709 12:12:43.973638 (+   202us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:43.985979 (+ 12341us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:44.007486 (+ 21507us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:44.011797 (+  4311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:44.012325 (+   528us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:12:44.012402 (+    77us) write_op.cc:312] APPLY: finished
0709 12:12:44.014158 (+  1756us) log.cc:844] Serialized 76 byte log entry
0709 12:12:44.040736 (+ 26578us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:44.048421 (+  7685us) write_op.cc:454] Released schema lock
0709 12:12:44.048539 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:44.059719 (+ 11180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:44.059787 (+    68us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1942841,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":111541,"apply.run_cpu_time_us":6353,"apply.run_wall_time_us":75935,"num_ops":10,"prepare.queue_time_us":121653,"prepare.run_cpu_time_us":26109,"prepare.run_wall_time_us":470767,"raft.queue_time_us":207791,"raft.run_cpu_time_us":17242,"raft.run_wall_time_us":62344,"replication_time_us":629204,"thread_start_us":645366,"threads_started":4,"wal-append.queue_time_us":332423,"wal-append.run_cpu_time_us":16202,"wal-append.run_wall_time_us":1378316}]]}
I20260709 12:12:45.972014 15274 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:45.998307 15117 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:46.058027 14063 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.058269 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.065160 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.066044 13873 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:46.053874 15269 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:46.053635 13865 raft_consensus.cc:1275] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:46.070524 14913 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:46.072841 15274 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:46.073932 15117 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:46.008783 15307 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.078181 15008 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4.
I20260709 12:12:46.003100 15101 consensus_queue.cc:260] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.105326 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:46.106860 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:46.108575 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.110069 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.111219 13868 raft_consensus.cc:1240] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:12:46.112963 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 88114.2us
I20260709 12:12:46.120769 14063 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.080595 15307 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.099351 15269 raft_consensus.cc:697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:46.130908 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:46.103583 15314 raft_consensus.cc:697] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.101346 15184 consensus_queue.cc:1059] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:12:46.123631 15181 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:46.096921 15299 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:46.141518 15040 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.123942 14757 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:46.153096 15296 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:46.144392 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:46.131624 14913 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:46.147354 15184 consensus_queue.cc:1059] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.119397 15274 consensus_queue.cc:1059] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:12:46.135953 15101 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:46.165422 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 51095.8us
I20260709 12:12:46.145550 15181 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.142779 15320 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:46.172694 15181 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:46.172950 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.173331 15214 raft_consensus.cc:3055] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.153695 15269 consensus_queue.cc:237] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:46.183852 15280 raft_consensus.cc:3055] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:46.157125 15040 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.219786 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.237627 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:46.184894 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.245016 15040 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:46.191280 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:46.246519 14015 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Advancing to term 6
    @     0x7fce3471bd84 google::LogMessage::SendToLog() at ??:0
I20260709 12:12:46.242367 15280 raft_consensus.cc:740] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.252468 15280 consensus_queue.cc:260] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.254446 15314 consensus_queue.cc:237] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.263703 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.265189 13949 raft_consensus.cc:1240] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:46.271904 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 137303us
I20260709 12:12:46.297789 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.264616 13946 raft_consensus.cc:2393] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:46.247655 15310 raft_consensus.cc:3055] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:46.247498 15299 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:46.246783 15214 raft_consensus.cc:740] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:46.333006 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.334178 14094 raft_consensus.cc:2410] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:12:46.327740 14913 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:46.322326 15310 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:46.339877 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.345709 14095 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:46.299530 15261 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.342473 14913 raft_consensus.cc:515] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.362259 14913 leader_election.cc:290] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.366288 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:46.371361 15181 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.322717 15306 consensus_queue.cc:1059] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:12:46.373780 15306 raft_consensus.cc:3055] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.374130 15306 raft_consensus.cc:740] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.375051 15306 consensus_queue.cc:260] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:46.377151 15310 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.336365 15296 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:46.378985 15296 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.381143 15296 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:46.383236 15214 consensus_queue.cc:260] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:46.385445 15214 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.385916 15261 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.386818 14088 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 5: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:46.388511 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:46.378508 15310 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:46.391454 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.392192 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.393966 14802 raft_consensus.cc:3055] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:46.394511 14802 raft_consensus.cc:740] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:46.395619 14802 consensus_queue.cc:260] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:46.398106 13987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.401139 15320 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:46.404476 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 70972.4us
I20260709 12:12:46.409845 14016 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 5: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:46.414937 15110 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:46.415827 15110 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.453946 13840 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:46.460770 14015 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
W20260709 12:12:46.461524 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 56121.8us
W20260709 12:12:46.472682 13912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.453218 14802 raft_consensus.cc:3060] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:12:46.475118 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.464879 15254 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:12:46.474438 15273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.016s	sys 0.035s
I20260709 12:12:46.481842 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:46.482751 14095 raft_consensus.cc:1240] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:46.483425 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.482869 13869 raft_consensus.cc:3060] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:46.472030 15181 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.462118 15320 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:46.482661 15273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.016s	sys 0.035s
I20260709 12:12:46.484287 15254 raft_consensus.cc:697] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:46.508025 14014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 274) took 1179 ms. Trace:
I20260709 12:12:46.509977 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.510952 14095 raft_consensus.cc:2393] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:46.505297 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.519750 15110 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.526259 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:46.529726 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.509629 14014 rpcz_store.cc:276] 0709 12:12:45.324989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.327729 (+  2740us) service_pool.cc:224] Handling call
0709 12:12:45.328158 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:45.852789 (+524631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.497533 (+644744us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540037b9d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:46.504188 (+  6655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133609216}
I20260709 12:12:46.536762 14095 raft_consensus.cc:1240] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:12:46.532205 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.542090 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.550834 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.551613 14094 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:46.552392 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.553459 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.554466 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.555400 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.542456 14097 raft_consensus.cc:1240] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:46.556804 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.557951 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.558046 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.543949 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.544098 14089 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:46.545279 14092 raft_consensus.cc:1275] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:46.565476 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:46.545617 15279 raft_consensus.cc:3055] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:46.546110 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.546684 14090 raft_consensus.cc:1240] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:46.566488 14096 raft_consensus.cc:2368] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 5. Current term is 6.
I20260709 12:12:46.571410 15279 raft_consensus.cc:740] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.574566 14095 raft_consensus.cc:1240] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 12:12:46.575621 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.582602 13869 raft_consensus.cc:2468] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:46.588047 15222 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:46.589129 13837 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.590932 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.591917 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.592080 13837 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.594810 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.530766 15254 consensus_queue.cc:237] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.592968 13988 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:46.603063 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.602939 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.603907 14089 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:46.603973 14095 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:46.604874 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.605314 13946 raft_consensus.cc:1240] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:46.605638 13941 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:46.601274 15231 raft_consensus.cc:2804] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:46.596909 15040 raft_consensus.cc:2749] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:46.607060 15231 raft_consensus.cc:697] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.597787 15299 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:46.609376 13873 raft_consensus.cc:1275] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:46.603940 13943 raft_consensus.cc:1240] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:46.612260 14095 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:46.602162 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:46.614017 13871 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 5: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:46.593304 15252 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:46.615535 13872 raft_consensus.cc:1240] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:46.588726 15222 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.621054 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.620441 15222 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.623132 13944 raft_consensus.cc:1240] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:46.623322 14089 raft_consensus.cc:1275] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:12:46.623594 13941 raft_consensus.cc:1240] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:12:46.623780 14089 pending_rounds.cc:85] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Aborting all ops after (but not including) 2
I20260709 12:12:46.624078 14089 pending_rounds.cc:107] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:12:46.624362 14089 raft_consensus.cc:2889] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.622974 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.624756 14966 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:46.624881 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:46.625044 13949 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:46.630357 14019 raft_consensus.cc:1240] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:46.631187 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:46.633378 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.634194 14093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 305) took 1016 ms. Trace:
I20260709 12:12:46.634521 14093 rpcz_store.cc:276] 0709 12:12:45.618117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.619516 (+  1399us) service_pool.cc:224] Handling call
0709 12:12:46.633209 (+1013693us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:46.634131 (+   922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5519616}
I20260709 12:12:46.635071 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:46.635614 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.637041 13943 raft_consensus.cc:1240] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:46.640961 13914 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.641135 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.646160 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.602437 15279 consensus_queue.cc:260] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:46.649672 15279 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:46.650192 13867 raft_consensus.cc:1275] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:46.651786 15306 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.652721 14801 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:46.654237 14092 raft_consensus.cc:1275] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:46.656991 15320 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:46.658799 13986 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.659291 15330 raft_consensus.cc:3055] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.659600 14089 raft_consensus.cc:1275] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:46.660167 13943 raft_consensus.cc:3055] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:46.660540 15280 raft_consensus.cc:3060] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:46.660212 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:46.661176 14061 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:46.663381 13949 raft_consensus.cc:1275] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:46.651965 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.664361 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52318 (request call id 275) took 1149 ms. Trace:
I20260709 12:12:46.668047 15312 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.669333 13941 raft_consensus.cc:1240] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:46.716832 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.718084 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.619318 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1030856707044fac9c27c8699f2e770c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:46.676155 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:46.677076 13874 raft_consensus.cc:1240] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:46.690701 15330 raft_consensus.cc:740] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:46.692795 13872 raft_consensus.cc:1275] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:12:46.708858 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.711608 13867 raft_consensus.cc:1275] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:46.713415 13866 raft_consensus.cc:1275] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:46.714349 13944 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 LEADER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:46.608048 15231 consensus_queue.cc:237] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.721195 14089 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:12:46.742856 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.734099 13948 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:46.734233 13913 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.736902 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.694105 15184 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:46.741763 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:46.748880 13913 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.749343 13912 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.693250 13943 raft_consensus.cc:740] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:46.754395 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:46.755024 13949 raft_consensus.cc:3060] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:46.718446 15101 raft_consensus.cc:2804] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:46.703430 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:46.758893 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.725144 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:46.761211 13948 raft_consensus.cc:2410] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:12:46.762369 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.704857 15301 consensus_queue.cc:1048] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:12:46.763828 14092 raft_consensus.cc:2393] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 5: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:46.751211 15320 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:46.754629 15274 raft_consensus.cc:2749] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:46.779008 13944 raft_consensus.cc:1275] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:12:46.739301 15117 consensus_queue.cc:1059] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:12:46.781201 13986 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.764436 13940 raft_consensus.cc:1275] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:46.785089 13944 raft_consensus.cc:1240] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:46.782085 15296 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:46.788259 15205 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:46.795463 13768 catalog_manager.cc:5697] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.798377 13768 catalog_manager.cc:5697] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 2, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 2 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.799845 13768 catalog_manager.cc:5697] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } }
I20260709 12:12:46.763485 14801 consensus_queue.cc:1059] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:12:46.806314 15117 raft_consensus.cc:3055] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.818756 15117 raft_consensus.cc:740] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:46.793128 15296 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.819756 15117 consensus_queue.cc:260] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:46.814772 14801 consensus_queue.cc:1243] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer 4c9b84be2fea4f7094b49292ec17dabe log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:12:46.816592 13946 raft_consensus.cc:2410] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:12:46.818077 13947 raft_consensus.cc:1240] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:46.821851 15296 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:46.821259 13768 catalog_manager.cc:5697] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 1 to 2, leader changed from 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 2 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.823002 13948 raft_consensus.cc:1275] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:12:46.847132 13948 pending_rounds.cc:85] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Aborting all ops after (but not including) 2
I20260709 12:12:46.847385 13948 pending_rounds.cc:107] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:12:46.847622 13948 raft_consensus.cc:2889] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.824654 15314 consensus_queue.cc:1048] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:46.767598 15332 consensus_queue.cc:1048] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:12:46.704365 13865 rpcz_store.cc:276] 0709 12:12:45.514862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.879103 (+364241us) service_pool.cc:224] Handling call
0709 12:12:45.934984 (+ 55881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:46.070903 (+135919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.664059 (+593156us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b5400509954. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:46.664265 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141438848}
W20260709 12:12:46.841378 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 92110.9us
I20260709 12:12:46.861552 13912 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.863168 15214 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:46.842885 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 90319us
W20260709 12:12:46.843092 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 109244us
I20260709 12:12:46.863168 13912 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:46.845033 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 101886us
I20260709 12:12:46.858796 13768 catalog_manager.cc:5697] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:46.876157 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 158078us
I20260709 12:12:46.877130 13949 raft_consensus.cc:2468] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:46.878810 13986 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.878844 14062 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:46.881090 13986 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:46.882730 13768 catalog_manager.cc:5697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:46.890477 13768 catalog_manager.cc:5697] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 3 to 5, leader changed from 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 5 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.882965 15101 raft_consensus.cc:697] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:46.875700 15296 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:46.886511 15292 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:46.900790 13768 catalog_manager.cc:5697] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 1 to 5, leader changed from 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 5 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.790015 15330 consensus_queue.cc:260] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:46.905983 13768 catalog_manager.cc:5697] T 2eb862f5cd014dafaac3c52063ea45d9 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 4 to 5, leader changed from 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131) to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 5 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.907529 13768 catalog_manager.cc:5697] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33ef851003ef478cac1897bfee45a8f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:46.894083 15181 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:46.895020 15214 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:46.913183 15110 consensus_queue.cc:1048] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:46.887326 15269 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:12:46.914136 15320 consensus_queue.cc:1048] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.914791 15110 consensus_queue.cc:1048] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.886364 15301 consensus_queue.cc:1048] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:12:46.896468 15117 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.923081 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:46.918193 13768 catalog_manager.cc:5697] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 3 to 5, leader changed from 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130) to 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131). New cstate: current_term: 5 leader_uuid: "4c9b84be2fea4f7094b49292ec17dabe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } }
I20260709 12:12:46.887945 14966 consensus_queue.cc:1048] T b2e14a4c4c894f76b64a895bf9dd7faa P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:12:46.972988 15273 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:12:46.975456 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 55481.9us
W20260709 12:12:46.980532 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.988075 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.990011 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 84907.4us
I20260709 12:12:46.903856 15296 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:46.993269 15296 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:46.923862 15353 log.cc:927] Time spent T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.184s	user 0.001s	sys 0.003s
I20260709 12:12:46.995841 13943 consensus_queue.cc:260] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:46.997299 13943 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:46.999953 15184 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:47.000857 14016 raft_consensus.cc:1240] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
W20260709 12:12:46.923642 15308 consensus_queue.cc:1175] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:47.003122 15101 consensus_queue.cc:237] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:47.009891 15330 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.011281 14090 raft_consensus.cc:1240] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:46.992515 13912 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:47.020535 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 120490us
I20260709 12:12:47.027786 15279 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.028375 15279 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:47.030656 15279 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:47.033052 13840 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:47.034106 15254 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:47.034533 15254 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:47.035013 15254 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
    @     0x7fce3471c930 google::LogMessage::Flush() at ??:0
I20260709 12:12:47.052055 14801 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:47.034792 13840 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:47.058799 15296 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:47.063338 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 70894.9us
I20260709 12:12:47.065028 13840 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:47.078776 13768 catalog_manager.cc:5697] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e reported cstate change: term changed from 0 to 1, leader changed from <none> to f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132). New cstate: current_term: 1 leader_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:47.083886 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 205151us
W20260709 12:12:47.098660 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.101275 14022 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:47.101330 14062 leader_election.cc:304] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:47.107250 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.117058 14090 raft_consensus.cc:1275] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:47.082712 15296 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:47.123670 15299 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:47.128703 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:47.100018 15110 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.112980 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:47.121686 15361 raft_consensus.cc:2749] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:12:47.148036 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 49977.1us
I20260709 12:12:47.140530 15110 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:47.111743 14757 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:12:47.158898 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:47.110453 15259 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:12:47.129331 15299 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:47.122179 15261 consensus_queue.cc:1059] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:12:47.186043 15110 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:47.186436 13941 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:47.191866 15261 raft_consensus.cc:3055] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:47.192459 15261 raft_consensus.cc:740] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:47.193470 15261 consensus_queue.cc:260] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:47.194819 15261 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:47.196811 15280 consensus_queue.cc:1048] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:47.199164 15117 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:47.200693 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:47.208742 13912 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:47.207178 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 86242.9us
I20260709 12:12:47.213829 13837 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:47.224699 13914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.209774 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:47.241572 13912 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.243148 13912 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.244297 13912 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.215835 15310 raft_consensus.cc:2749] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:47.216976 15279 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:47.253968 13873 raft_consensus.cc:1275] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:47.259387 14021 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:47.262465 15299 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:47.265632 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:47.261498 13912 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.241564 15296 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:47.246713 15110 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:47.246783 15360 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:47.279565 13912 leader_election.cc:400] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 5. Current term is 6.
I20260709 12:12:47.280047 13912 leader_election.cc:403] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:12:47.254751 15205 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:12:47.286528 13912 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.255324 13943 raft_consensus.cc:1275] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:47.260923 15279 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.302073 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 88361.4us
I20260709 12:12:47.314702 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:47.283787 14801 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:47.291272 15310 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 5. Current term is 6.
I20260709 12:12:47.376006 15254 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:47.385106 15370 log.cc:927] Time spent T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:12:47.386170 15367 log.cc:927] Time spent T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:12:47.388818 15040 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:47.307334 15279 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:47.268149 15308 consensus_queue.cc:1048] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:12:47.274583 15296 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:47.500349 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 197099us
I20260709 12:12:47.521203 13837 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:47.317689 15274 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:12:47.304699 15383 raft_consensus.cc:2749] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:47.296819 15320 consensus_queue.cc:1059] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.189s
W20260709 12:12:47.524046 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:47.541949 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 255516us
I20260709 12:12:47.554606 15040 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:47.596969 13912 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.501574 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:47.513459 15184 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:47.600661 15040 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:47.598752 15299 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:47.624646 14674 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:47.636801 15274 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:12:47.650100 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 53224.4us
I20260709 12:12:47.618351 15383 raft_consensus.cc:3055] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:47.656935 13912 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:47.659881 15369 log.cc:927] Time spent T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:12:47.659543 15279 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:47.601935 15362 consensus_queue.cc:1059] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:12:47.618853 15184 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:47.694388 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 132518us
I20260709 12:12:47.703541 13913 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:47.719769 13869 raft_consensus.cc:1275] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:47.676960 15383 raft_consensus.cc:740] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
W20260709 12:12:47.726557 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 205476us
I20260709 12:12:47.680917 14674 raft_consensus.cc:697] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:47.732218 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 75412.7us
I20260709 12:12:47.739921 13912 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.702425 14913 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.733404 13837 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.658180 15299 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:47.744585 14063 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:47.745441 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:47.724225 15363 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.737588 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 209740us
I20260709 12:12:47.723944 15101 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.750932 14093 raft_consensus.cc:2393] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:47.721475 15274 raft_consensus.cc:2749] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:47.729892 15385 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:47.749225 14802 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:47.798971 14022 raft_consensus.cc:1275] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:47.803526 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:47.752722 15358 consensus_queue.cc:1059] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:12:47.730561 15231 consensus_queue.cc:1048] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:12:47.772120 14021 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:12:47.760788 15385 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.817389 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:47.825904 15385 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:47.767153 15396 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.806221 15254 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:47.833324 15396 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:47.766774 15101 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:47.835789 15396 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:47.836493 15101 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:47.837703 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:47.837195 15101 raft_consensus.cc:2804] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:47.838773 15101 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:47.839330 15101 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.799832 15205 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.847592 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:47.753288 14913 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:47.766908 15392 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:12:47.859333 13941 raft_consensus.cc:2393] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 4: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:47.812075 15320 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:47.820770 15308 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:47.829421 14757 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:12:47.878515 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 134018us
I20260709 12:12:47.829078 15301 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:47.855191 15296 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:47.890851 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 67020.3us
I20260709 12:12:47.760419 15363 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:47.903600 15306 consensus_meta.cc:287] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 1.251s	user 0.019s	sys 0.002s
I20260709 12:12:47.890797 15254 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.862176 15205 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:47.934973 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 44759.4us
I20260709 12:12:47.935307 13837 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.941464 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:47.944681 14020 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:47.887323 15320 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:47.853348 14674 consensus_queue.cc:237] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:47.891054 15301 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:47.818516 15383 consensus_queue.cc:260] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:47.994431 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 59210.8us
I20260709 12:12:47.903937 15308 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:47.995870 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 54824.8us
W20260709 12:12:47.995976 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 104116us
I20260709 12:12:47.999915 13837 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:47.997679 14757 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:47.931847 15406 consensus_queue.cc:1048] T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:12:48.003650 15184 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:47.901368 15395 consensus_queue.cc:1048] T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:12:47.952164 15254 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.008970 15301 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
W20260709 12:12:48.015615 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.021242 15354 consensus_queue.cc:1059] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:48.022672 15273 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.023182 15273 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.023456 15363 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
    @     0x7fce34721a6b google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260709 12:12:48.014021 15404 raft_consensus.cc:3055] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.025445 15273 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.025549 15404 raft_consensus.cc:740] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.026153 15273 raft_consensus.cc:3055] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:48.026510 15273 raft_consensus.cc:740] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.026588 15404 consensus_queue.cc:260] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.027678 15404 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.027315 15273 consensus_queue.cc:260] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:48.028151 15261 consensus_meta.cc:287] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.833s	user 0.008s	sys 0.005s
I20260709 12:12:48.028501 15273 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.032718 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.039491 14063 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:48.040244 13872 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:48.030819 15383 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.000967 13940 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:48.024276 15363 consensus_queue.cc:1059] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:12:48.044514 15372 log.cc:927] Time spent T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.648s	user 0.004s	sys 0.000s
I20260709 12:12:48.050344 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.054154 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.064396 14093 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:48.040825 15301 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.056401 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.052724 15299 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.039027 15357 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:48.089558 15301 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.090515 14913 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.092110 15301 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.055048 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.067157 13868 raft_consensus.cc:1240] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:48.069320 13870 raft_consensus.cc:1275] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:48.093379 13866 raft_consensus.cc:1240] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:48.070799 14091 raft_consensus.cc:1275] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:48.071679 15409 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:48.094645 15409 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.096441 15320 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:48.074785 15394 log.cc:927] Time spent T 630f59ad7c7240e99c3f7dba05fa3eb1 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:12:48.053521 15292 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:48.075141 15366 log.cc:927] Time spent T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.574s	user 0.004s	sys 0.000s
I20260709 12:12:48.097770 15292 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.086481 13871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 199) took 1161 ms. Trace:
I20260709 12:12:48.099555 15409 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.060796 13838 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:48.101421 15389 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:48.028173 15040 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.104035 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:48.115178 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 49457.1us
I20260709 12:12:48.120194 13869 raft_consensus.cc:1240] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:48.101964 15389 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.101763 15261 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:12:48.109850 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:48.131101 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 48028.8us
I20260709 12:12:48.139264 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.133255 15408 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:48.107894 15308 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.144315 13869 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:48.127739 15361 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:48.140514 13865 raft_consensus.cc:1240] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:48.098858 13871 rpcz_store.cc:276] 0709 12:12:46.925090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.060927 (+135837us) service_pool.cc:224] Handling call
0709 12:12:47.061442 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:47.062194 (+   752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.062222 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.062744 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.199319 (+136575us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:12:47.199380 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.199472 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.008233 (+808761us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:48.086050 (+ 77817us) raft_consensus.cc:1685] finished
0709 12:12:48.086082 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:48.086396 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":267,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":12981504,"thread_start_us":106706,"threads_started":1,"wal-append.queue_time_us":198993}
I20260709 12:12:48.133848 15222 consensus_queue.cc:1059] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:12:48.175192 14023 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:12:48.154899 15040 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.155357 15363 consensus_queue.cc:1059] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:48.129968 15389 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.190753 15413 raft_consensus.cc:3055] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:48.191287 15413 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.191668 15363 raft_consensus.cc:3055] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:48.192155 15363 raft_consensus.cc:740] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.192413 15413 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.192981 15363 consensus_queue.cc:260] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.193919 15413 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:48.127417 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.196745 15414 consensus_queue.cc:1059] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:12:48.197088 14017 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:48.198076 14913 raft_consensus.cc:3055] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.198462 14913 raft_consensus.cc:740] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.198498 15416 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:48.199277 15416 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.199465 14913 consensus_queue.cc:260] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.201176 14913 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.130311 15301 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:48.205917 15301 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.208848 14088 raft_consensus.cc:1240] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 12:12:48.121500 15358 consensus_queue.cc:1048] T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:12:48.167688 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.133620 15184 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.210134 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.210510 15184 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.179211 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.184082 14090 raft_consensus.cc:1275] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:48.183961 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.184358 15386 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:48.185047 15222 raft_consensus.cc:3055] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:48.185756 14092 raft_consensus.cc:1275] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:48.229379 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.230199 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:48.230645 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 95798.1us
I20260709 12:12:48.230713 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:48.215161 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.235509 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.236877 13988 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:48.237638 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.208554 15301 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.201126 15389 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.238386 14018 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:48.250022 13912 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:48.248514 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.255474 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:48.256450 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.257135 14095 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:48.219857 15222 raft_consensus.cc:740] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.238386 15414 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.163395 15408 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.269972 14062 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:48.248807 15314 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:48.247746 15358 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.236531 15205 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.234933 15362 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:48.171104 15361 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.264669 14802 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:48.251735 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.268164 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.282282 15314 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.286773 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.285938 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:48.404597 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 138467us
I20260709 12:12:48.281304 15274 consensus_queue.cc:1048] T 123e199d60f94411b09c3e9ba4ca38fe P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:12:48.379982 14091 raft_consensus.cc:1240] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:48.417342 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.439400 13941 raft_consensus.cc:2468] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:48.395565 14088 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:48.360116 15184 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.420315 13837 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:48.379541 15205 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.235751 15386 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.441725 13837 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:48.266677 15414 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.396044 15314 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:48.396128 13943 raft_consensus.cc:1275] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:12:48.407756 15261 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:48.316476 15358 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.419991 15110 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.465251 13912 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:48.468091 14089 raft_consensus.cc:1275] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.450106 15404 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.441478 13867 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:48.493283 15110 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.510030 15110 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.361111 15362 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:48.505107 15412 log.cc:927] Time spent T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
I20260709 12:12:48.505280 15432 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:48.452776 15205 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.505944 15416 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.506471 15386 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.445876 14802 consensus_queue.cc:1048] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:12:48.534284 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.546181 15110 consensus_queue.cc:1059] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:48.548357 15389 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.549921 15408 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.492276 15421 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:48.557495 15407 log.cc:927] Time spent T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:12:48.558058 15279 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.559116 15362 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.522509 15214 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:48.531119 15357 raft_consensus.cc:2749] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:48.526345 15404 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:48.562592 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 292686us
I20260709 12:12:48.521731 15432 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
W20260709 12:12:48.578245 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 310259us
W20260709 12:12:48.587278 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 145664us
I20260709 12:12:48.586576 13986 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:48.596591 15362 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.597410 15362 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.598066 15110 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.598935 15110 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.600131 15362 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.601476 15446 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:48.603016 13986 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:48.566912 15214 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.588726 15432 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.601739 15110 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.608515 15446 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:48.629084 15446 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.608263 15261 consensus_queue.cc:1059] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:12:48.605594 15416 consensus_queue.cc:1059] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
    @     0x7fce3e713a9e kudu::TestWorkload::Setup() at ??:0
    @           0x35fb88 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:112
    @           0x358216 kudu::master::LeaderRebalancerTest_RestartTserver_Test::TestBody() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:?
I20260709 12:12:48.587088 15414 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:48.613512 15385 consensus_meta.cc:287] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.782s	user 0.013s	sys 0.000s
I20260709 12:12:48.617424 15214 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:48.616420 15362 raft_consensus.cc:493] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.619558 15312 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:48.612247 15361 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.567245 15421 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:48.648933 15101 consensus_meta.cc:287] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.002s
W20260709 12:12:48.655009 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 49018.3us
I20260709 12:12:48.663019 14062 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:48.663875 15428 consensus_queue.cc:1059] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:12:48.666687 14062 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:48.667515 15261 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:48.667861 15261 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.668138 15261 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:48.651592 15362 raft_consensus.cc:515] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.660940 15433 consensus_queue.cc:1048] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:12:48.674919 15362 leader_election.cc:290] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.681255 15434 consensus_queue.cc:1048] T 9e77febf4abc4228b32c2e9fba94574e P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:12:48.681806 13837 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:48.682796 14092 raft_consensus.cc:1275] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:12:48.684938 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.685629 13948 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:48.686121 15421 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.684990 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.687958 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.688903 13940 raft_consensus.cc:2410] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:12:48.689539 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.690725 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.692252 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.693449 15205 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.694196 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:48.694445 15399 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:48.694859 14089 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.695171 15399 consensus_queue.cc:1048] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.698030 15254 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.643822 15385 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:48.700897 14062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.704766 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.705673 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.706430 13866 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 1.
I20260709 12:12:48.709348 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52336 (request call id 203) took 1061 ms. Trace:
I20260709 12:12:48.709606 15416 raft_consensus.cc:3055] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:48.710155 15416 raft_consensus.cc:740] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.709877 13865 rpcz_store.cc:276] 0709 12:12:47.648043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.648225 (+   182us) service_pool.cc:224] Handling call
0709 12:12:47.648664 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.171731 (+523067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.709068 (+537337us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540050a854. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:48.709259 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106140032}
I20260709 12:12:48.711585 15428 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.711454 15416 consensus_queue.cc:260] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.712222 15428 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.713745 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed16159ff574584ad17638f2083106f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.715219 13947 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:48.715517 15428 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.716549 15385 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.717656 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.660794 15101 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:48.718829 15308 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:48.719435 15308 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.720235 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.720952 14019 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:48.721652 15308 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:48.725525 15450 log.cc:927] Time spent T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:48.728725 13988 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
W20260709 12:12:48.700086 15413 consensus_meta.cc:287] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
I20260709 12:12:48.720100 15214 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:48.755081 15252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.022s	sys 0.013s
W20260709 12:12:48.755574 15252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.022s	sys 0.013s
I20260709 12:12:48.765842 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.743822 15332 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:48.768545 14089 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
W20260709 12:12:48.774152 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.765261 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:48.766366 14088 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 6.
I20260709 12:12:48.772620 15274 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.790555 15413 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.771359 15332 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.793357 15101 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.795033 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:48.797583 15292 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.798635 14061 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:48.781878 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.807881 14966 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:48.809744 15314 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.812826 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.814440 15261 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.815084 15358 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:48.821890 15457 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:48.823799 13838 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:48.822018 15214 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.786845 13943 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:48.843194 14061 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:48.831573 15421 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:48.822660 15332 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.858660 14089 raft_consensus.cc:1240] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:48.859681 14061 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:48.852658 13868 raft_consensus.cc:2368] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:48.803093 15274 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:48.861436 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:48.822516 15413 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.856069 15460 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.873353 15314 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.847347 15296 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:48.878517 15274 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.879602 15205 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.907969 15296 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.910869 15296 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.912544 15460 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.879745 15446 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:48.880254 15358 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:48.856714 15462 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:12:48.880723 15214 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.881306 15421 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:48.880321 15362 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:48.848516 15117 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:48.841053 14966 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:48.885370 15455 log.cc:927] Time spent T dcab28297ec5466180129cc4860d9838 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:12:48.886490 15310 raft_consensus.cc:3055] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:48.894502 15222 consensus_queue.cc:260] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:48.908157 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 45651.7us
I20260709 12:12:48.899143 15409 raft_consensus.cc:3055] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:48.897344 15363 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.928515 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:48.918440 15314 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:48.962369 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.962896 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.964371 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:48.956840 15101 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.965488 15101 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.966887 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.926671 15421 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:48.972832 13869 raft_consensus.cc:2393] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:48.935164 15310 raft_consensus.cc:740] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:48.918174 15205 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.010341 15205 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.971395 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:49.010689 14966 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:48.932335 15117 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.014079 15101 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:48.984177 13986 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:49.014788 15117 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.016281 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:49.016769 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:48.985739 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:48.926560 15214 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:48.940583 15409 raft_consensus.cc:740] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:48.988314 15404 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:48.999238 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:48.971114 15314 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.016947 14018 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:48.970078 15222 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:48.925225 15446 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:48.977035 15421 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:48.931813 15362 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.026913 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.030092 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.033509 14016 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:49.024346 14966 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:49.038210 15310 consensus_queue.cc:260] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.039690 15310 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:49.042536 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:49.043428 14097 raft_consensus.cc:2368] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:49.045715 15362 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.020506 15414 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:49.024086 15308 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:48.944548 15332 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.053149 15442 raft_consensus.cc:3055] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:49.053653 15442 raft_consensus.cc:740] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:49.054709 15214 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.025193 15432 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.051743 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.061710 13986 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:49.060142 14061 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.064869 14096 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:49.071904 15261 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.081336 15446 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:49.080998 15261 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:49.088709 15261 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.054580 15442 consensus_queue.cc:260] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.198344 15261 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:49.210347 15332 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:49.211728 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.210425 13870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:49.215253 15314 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:49.222523 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.232139 13870 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.242389 13865 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 6.
I20260709 12:12:49.249743 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:49.252275 14023 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
    @     0x7fce35286e10 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260709 12:12:49.257066 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.260097 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.265496 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:49.270026 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.240784 15432 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:49.271106 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.271973 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.277626 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.278306 14018 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:49.271209 14801 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.281517 14801 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.283735 14801 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.286034 13942 raft_consensus.cc:2410] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:12:49.286720 13942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48304 (request call id 312) took 1057 ms. Trace:
I20260709 12:12:49.287070 13942 rpcz_store.cc:276] 0709 12:12:48.229408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.232387 (+  2979us) service_pool.cc:224] Handling call
0709 12:12:49.256873 (+1024486us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5800003c98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:49.286629 (+ 29756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13139840}
I20260709 12:12:49.288789 15385 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.288957 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.289351 15385 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.289656 13944 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:49.290897 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.291592 13944 raft_consensus.cc:2393] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:49.288298 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.267071 15362 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.293095 15362 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.293676 13914 leader_election.cc:400] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:49.294014 13914 leader_election.cc:403] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.294806 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.295364 15362 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.292701 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:49.296294 13944 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:49.296424 15205 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.297129 15205 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.293038 14801 consensus_queue.cc:1059] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:12:49.298513 15274 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.293181 13949 raft_consensus.cc:2393] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:49.291497 15385 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.301738 14061 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.262307 15214 raft_consensus.cc:493] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
W20260709 12:12:49.302343 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.300863 15296 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.317162 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:49.322479 14023 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:49.288530 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.306250 14966 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:49.308089 15466 raft_consensus.cc:2804] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:49.333673 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.323997 15332 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:49.310093 15214 raft_consensus.cc:515] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.337956 15332 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:49.342069 15471 log.cc:927] Time spent T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:12:49.312183 15421 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.334887 15392 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:49.345841 14092 raft_consensus.cc:2410] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:12:49.338099 13871 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:49.346108 15392 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.330060 13942 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:49.351912 15421 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.338477 15205 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.332754 14966 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.353164 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.354044 14097 raft_consensus.cc:2393] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:49.354887 14966 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.343441 14091 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:49.356792 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:49.348518 15392 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.359261 13944 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:49.338178 15466 raft_consensus.cc:697] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:49.381444 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.385226 15261 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.387836 15261 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.390271 15466 consensus_queue.cc:237] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.391314 13871 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 5.
I20260709 12:12:49.393905 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.396123 13870 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:49.409533 13838 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:49.397554 15332 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.398501 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.399120 15296 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.411422 15296 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:49.411948 15296 raft_consensus.cc:697] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:49.400784 15205 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.400424 15310 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.413038 15205 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.413149 15310 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.401984 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.415609 15205 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.400807 13947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 308) took 1643 ms. Trace:
I20260709 12:12:49.416394 13947 rpcz_store.cc:276] 0709 12:12:47.757552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.757716 (+   164us) service_pool.cc:224] Handling call
0709 12:12:47.796725 (+ 39009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.715643 (+918918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.400535 (+684892us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54007977d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:49.400723 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111880960}
I20260709 12:12:49.416857 15296 consensus_queue.cc:237] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.402927 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.403594 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.418933 13867 raft_consensus.cc:2393] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:49.418673 15409 consensus_queue.cc:260] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.404806 15385 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.419785 15409 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.419821 15385 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.420668 15274 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:49.408970 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.421988 14097 raft_consensus.cc:2393] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:49.422251 15385 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.422295 15442 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.415563 15310 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.427178 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:49.428077 14022 raft_consensus.cc:2368] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
W20260709 12:12:49.428272 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.430655 13986 leader_election.cc:400] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:49.432928 13986 leader_election.cc:403] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.434401 13986 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.431478 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.435124 15332 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:49.432353 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.438187 15416 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.439136 15332 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:49.439570 15332 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.439957 15332 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.440557 14017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 329) took 1225 ms. Trace:
I20260709 12:12:49.449481 15214 leader_election.cc:290] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:49.448050 14017 rpcz_store.cc:276] 0709 12:12:48.215667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.226200 (+ 10533us) service_pool.cc:224] Handling call
0709 12:12:48.244232 (+ 18032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.492683 (+248451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.513369 (+ 20686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:48.530341 (+ 16972us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:48.535007 (+  4666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.440198 (+905191us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400872154. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:49.440273 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:49.440474 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501752576}
W20260709 12:12:49.455462 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:49.463145 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:49.454516 15332 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.475800 15332 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
    @     0x7fce35264a12 testing::Test::Run() at ??:0
I20260709 12:12:49.482470 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:49.486945 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:49.487869 14017 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:49.493052 14097 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:49.510653 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.511749 13940 raft_consensus.cc:2393] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 5: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:49.515652 14063 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:49.516866 15261 raft_consensus.cc:2804] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:49.517355 15261 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.517796 15261 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.518911 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
W20260709 12:12:49.521422 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.523545 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.529944 13838 leader_election.cc:400] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:49.530418 13838 leader_election.cc:403] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.521028 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:49.531687 14063 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:49.533841 13913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.532135 13986 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.535502 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.537685 14063 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:49.541803 14063 leader_election.cc:304] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:49.547648 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.536662 14090 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:49.557811 15403 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:49.599675 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.600486 13940 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:49.540890 15473 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.603009 15473 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.531031 14088 raft_consensus.cc:1240] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:12:49.536836 15310 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.605667 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 53083.9us
I20260709 12:12:49.605865 15310 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.606678 14063 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:49.608489 15404 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:49.608929 15404 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:49.548293 15273 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:49.609318 15404 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.611502 15473 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.557188 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:49.612722 13948 raft_consensus.cc:3060] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:49.614463 14063 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:49.619434 14063 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:49.627627 15445 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.541641 14913 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:49.615619 15310 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.628274 15445 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.558343 14757 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.629510 14757 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.630769 15445 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.630875 15362 raft_consensus.cc:3055] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:49.631433 15362 raft_consensus.cc:740] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:49.549072 15274 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.626359 14017 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:49.622222 15434 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:49.632380 15362 consensus_queue.cc:260] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:49.634651 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 102593us
I20260709 12:12:49.558108 15414 raft_consensus.cc:2749] T 8ed16159ff574584ad17638f2083106f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:49.635442 15362 raft_consensus.cc:3060] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:49.628319 14913 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.636286 14913 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.557540 15205 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.632543 15274 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.637046 15205 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.634250 15434 raft_consensus.cc:697] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:49.626968 15403 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.639396 15403 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.640060 13986 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.641455 15403 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.642611 15434 consensus_queue.cc:237] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:49.646763 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.647688 13948 raft_consensus.cc:2468] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:49.647734 14061 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.649019 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.650144 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.650985 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.650866 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.654140 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:49.656010 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.538401 15214 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:49.652486 14096 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:49.656963 15117 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:49.657037 15442 raft_consensus.cc:2749] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:49.660069 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.660816 15414 raft_consensus.cc:2804] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:49.660952 15395 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.537333 15461 consensus_queue.cc:1048] T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 12:12:49.677678 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:49.622423 15470 log.cc:927] Time spent T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.391s	user 0.004s	sys 0.000s
I20260709 12:12:49.672649 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.685529 14095 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:49.680092 15414 raft_consensus.cc:697] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:49.657395 15259 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.678359 15402 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:49.698150 14096 raft_consensus.cc:2393] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 2: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:49.698868 13912 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:49.699642 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.658502 14757 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:49.705653 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.708112 13869 raft_consensus.cc:1240] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:49.648491 14090 raft_consensus.cc:2468] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:49.706571 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.695688 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.711344 15310 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.687559 15443 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:12:49.716042 15414 consensus_queue.cc:237] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:49.717716 13867 raft_consensus.cc:1240] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:49.722896 14095 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:49.728897 13837 leader_election.cc:304] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:49.733357 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.658727 15274 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:49.692282 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.737169 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:49.693060 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:49.759106 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:49.692239 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:49.769281 14091 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:49.770785 13873 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:49.723191 15402 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:49.688098 15395 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.776242 15254 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:49.736272 15205 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:49.787123 14094 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:49.771731 15383 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:49.722842 15259 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:49.682122 15214 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:49.776846 13866 raft_consensus.cc:3060] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:49.782446 15402 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.749398 15310 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:49.789089 14757 raft_consensus.cc:2804] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:49.792683 15383 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:49.942943 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 391505us
I20260709 12:12:49.952984 14020 raft_consensus.cc:1240] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:12:49.953940 14020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 336) took 1298 ms. Trace:
I20260709 12:12:49.953821 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:49.955986 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.959939 13944 raft_consensus.cc:2368] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:49.961114 13941 raft_consensus.cc:1240] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:49.949386 14757 raft_consensus.cc:697] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:49.964704 14757 consensus_queue.cc:237] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:49.948917 13915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.980561 13947 raft_consensus.cc:1275] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.982304 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:49.954743 14020 rpcz_store.cc:276] 0709 12:12:48.655569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.657741 (+  2172us) service_pool.cc:224] Handling call
0709 12:12:49.952295 (+1294554us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:49.952598 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.953598 (+  1000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.953876 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408320}
I20260709 12:12:49.989353 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:49.990494 13949 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 6: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:49.797142 15254 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:50.000010 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 275154us
I20260709 12:12:49.950430 15383 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:50.004688 13840 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.102.130:41801 timed out after 2.008s (SENT) [suppressed 9 similar messages]
I20260709 12:12:50.005373 13914 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:50.014020 13914 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:49.933262 15261 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:50.030709 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.030643 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.035737 13947 raft_consensus.cc:2368] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
W20260709 12:12:50.036548 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 307756us
I20260709 12:12:50.045027 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.059767 15424 consensus_queue.cc:1059] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:12:50.063798 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 59176.5us
I20260709 12:12:50.129317 13946 raft_consensus.cc:2468] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:50.123979 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.089524 13871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52318 (request call id 332) took 1182 ms. Trace:
I20260709 12:12:50.065784 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.075006 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:50.131557 13871 rpcz_store.cc:276] 0709 12:12:48.907427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.917113 (+  9686us) service_pool.cc:224] Handling call
0709 12:12:50.089293 (+1172180us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400508a54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:50.089412 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741650176}
W20260709 12:12:50.128001 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 393662us
W20260709 12:12:50.073880 14094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37098 (request call id 329) took 1819 ms (client timeout 1654 ms). Trace:
I20260709 12:12:50.135383 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.136142 13947 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 4.
I20260709 12:12:50.137877 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.126062 13870 raft_consensus.cc:1240] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:50.145328 15296 consensus_queue.cc:1059] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.145978 15362 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.146865 15362 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.148020 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
    @     0x7fce35265d29 testing::TestInfo::Run() at ??:0
I20260709 12:12:50.146121 15296 consensus_queue.cc:1243] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer 33ef851003ef478cac1897bfee45a8f2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:12:50.134585 14094 rpcz_store.cc:269] 0709 12:12:48.254715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.266766 (+ 12051us) service_pool.cc:224] Handling call
0709 12:12:49.259924 (+993158us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:50.073559 (+813635us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400462654. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:50.073736 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223187584}
I20260709 12:12:50.148692 15403 consensus_queue.cc:1048] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.153776 15445 raft_consensus.cc:3055] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:50.154201 15445 raft_consensus.cc:740] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:50.154631 13866 raft_consensus.cc:2468] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:50.155332 15254 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.155115 15445 consensus_queue.cc:260] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.156327 15445 raft_consensus.cc:3060] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:50.149510 15362 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.157101 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.157850 13942 raft_consensus.cc:3060] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.091570 15383 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.161988 15383 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.123747 14092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37120 (request call id 291) took 1184 ms. Trace:
I20260709 12:12:50.162828 14092 rpcz_store.cc:276] 0709 12:12:48.939216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.964102 (+ 24886us) service_pool.cc:224] Handling call
0709 12:12:50.123474 (+1159372us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54000b6dd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:50.123667 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861100288}
W20260709 12:12:50.163482 14913 consensus_meta.cc:287] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 12:12:50.164538 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.164568 13947 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:50.165504 13949 raft_consensus.cc:2393] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
W20260709 12:12:50.177932 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.193516 13941 raft_consensus.cc:2368] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:50.194571 13840 leader_election.cc:400] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:50.134080 13912 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:50.198993 15383 raft_consensus.cc:2804] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:50.199396 15383 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.199719 15383 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.200210 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.201079 13947 raft_consensus.cc:2368] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
W20260709 12:12:50.204926 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 70975.2us
I20260709 12:12:50.205459 15402 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.206249 13912 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:50.207064 15478 log.cc:927] Time spent T 1e33c688f7fe4e14be9fa7c1247d22ba P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:12:50.207296 13912 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:50.207182 15362 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:50.207911 15402 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.208086 15362 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.207501 13840 leader_election.cc:400] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
I20260709 12:12:50.080915 15395 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.083230 15443 raft_consensus.cc:3055] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.286424 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:50.156997 15261 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.208484 13912 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:50.282370 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 75431.9us
I20260709 12:12:50.248582 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:50.296319 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 87889.4us
I20260709 12:12:50.110443 15310 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.292709 14089 raft_consensus.cc:1240] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:12:50.082564 15460 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.208527 15362 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.301285 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:50.299010 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:50.336198 14089 raft_consensus.cc:2410] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:12:50.314374 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.163903 14913 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.331550 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:50.209496 15274 raft_consensus.cc:2804] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:50.208418 15259 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.301205 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:50.447306 14093 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:50.341594 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:50.282644 15461 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:50.287467 15466 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:50.426215 14022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.022s
I20260709 12:12:50.328827 14801 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:50.211555 15479 log.cc:927] Time spent T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:12:50.436403 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 56283.2us
I20260709 12:12:50.435640 15274 raft_consensus.cc:697] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [term 5 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:50.451924 14094 raft_consensus.cc:1240] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:50.330364 15383 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.457827 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:50.462999 15491 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.489369 15491 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:50.490252 15274 consensus_queue.cc:237] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.372931 15435 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
W20260709 12:12:50.467805 14022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.011s	sys 0.022s
I20260709 12:12:50.492475 15435 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:50.426456 15385 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:50.374537 15445 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.494277 15445 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:50.445380 15424 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.496789 15424 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:50.244988 15397 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.471757 14801 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.498976 14801 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:50.508885 15397 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:50.342888 15404 consensus_meta.cc:287] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.003s
I20260709 12:12:50.302175 15443 raft_consensus.cc:740] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:49.768153 13826 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Tablet 16e6426591bd40bcac05d7dc8b5bef57 (table test-workload [id=5c203191cf5d4c66a380510923aa713b]) was not created within the allowed timeout. Replacing with a new tablet 4ef75795ed42436a942bf71018b04daa
I20260709 12:12:50.512121 15404 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.467751 15413 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.508004 14801 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:50.515269 13943 consensus_meta.cc:287] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.532s	user 0.015s	sys 0.000s
I20260709 12:12:50.534489 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:50.535596 13874 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:50.547290 13948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.030s	sys 0.037s
W20260709 12:12:50.547785 13948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.030s	sys 0.037s
I20260709 12:12:50.473604 15461 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:50.475998 15466 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.538000 13943 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:50.593876 14801 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.561012 15416 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.594668 15416 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:50.599184 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.560734 15205 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:50.547106 15413 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:50.625409 13837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.012s
W20260709 12:12:50.633026 13837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.013s
I20260709 12:12:50.637603 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:50.611014 13940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.015s	sys 0.056s
I20260709 12:12:50.647692 14091 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
W20260709 12:12:50.666850 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.668051 13837 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
W20260709 12:12:50.653208 14014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.003s	sys 0.025s
W20260709 12:12:50.618508 15434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.009s
I20260709 12:12:50.683964 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:50.678328 13988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.012s	sys 0.008s
I20260709 12:12:50.680326 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.694294 14020 raft_consensus.cc:2468] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:50.693197 14019 raft_consensus.cc:1275] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:50.658776 13940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.016s	sys 0.057s
I20260709 12:12:50.618289 15416 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:50.697726 13988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.008s
I20260709 12:12:50.698124 14022 raft_consensus.cc:1275] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:12:50.694139 14014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.003s	sys 0.026s
W20260709 12:12:50.710876 13989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.005s	sys 0.017s
W20260709 12:12:50.693591 15434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.009s
I20260709 12:12:50.569504 15443 consensus_queue.cc:260] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.678032 15375 raft_consensus.cc:493] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.678543 15460 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.648360 15413 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:50.711534 13989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.018s
I20260709 12:12:50.692378 15332 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:50.709832 15416 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.705415 15296 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:50.730309 15332 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:50.723695 14913 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:50.732820 15296 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.733532 15296 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:50.735920 13940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48304 (request call id 328) took 1088 ms. Trace:
I20260709 12:12:50.736819 15416 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.737609 15332 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:50.738358 15466 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:50.738889 15416 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:50.742241 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 449976us
I20260709 12:12:50.745908 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:50.748703 14063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.750746 13874 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:50.751914 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
W20260709 12:12:50.753036 13947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.004s	sys 0.009s
W20260709 12:12:50.755057 13947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.004s	sys 0.009s
I20260709 12:12:50.756455 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:50.756783 14062 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:50.757205 13874 raft_consensus.cc:2468] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:50.736402 13940 rpcz_store.cc:276] 0709 12:12:49.647158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.657562 (+ 10404us) service_pool.cc:224] Handling call
0709 12:12:49.707655 (+ 50093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:49.749821 (+ 42166us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:12:49.805234 (+ 55413us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.713227 (+907993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:50.715161 (+  1934us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:12:50.724411 (+  9250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.728377 (+  3966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.735861 (+  7484us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17175,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":3431,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10261,"thread_start_us":764306,"threads_started":1}
I20260709 12:12:50.760438 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.753360 14757 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.765570 14062 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:50.766824 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.771332 13838 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:50.754809 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:50.779676 14062 leader_election.cc:304] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:50.740602 15375 raft_consensus.cc:515] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.768236 15416 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:50.787809 13837 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:50.790045 13873 raft_consensus.cc:1275] T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:12:50.783468 15414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.000s	sys 0.028s
I20260709 12:12:50.776865 15500 raft_consensus.cc:2804] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:50.785646 15273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.000s	sys 0.030s
I20260709 12:12:50.779443 15383 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:50.740307 15460 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:50.798120 15414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.001s	sys 0.028s
I20260709 12:12:50.776460 14757 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:50.787314 15404 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
W20260709 12:12:50.799966 15273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.000s	sys 0.030s
I20260709 12:12:50.811757 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.812829 13944 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:50.799167 15500 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.816605 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.818002 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.829960 14063 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:50.804371 15466 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:50.830811 13946 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.827018 13912 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:50.832662 13949 raft_consensus.cc:1275] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.835305 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:50.808005 15395 consensus_queue.cc:1048] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:12:50.809330 15461 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:50.817469 15414 raft_consensus.cc:2804] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:50.819393 15500 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:50.824546 15280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.010s	sys 0.027s
W20260709 12:12:50.852392 15492 log.cc:927] Time spent T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:12:50.852319 13942 consensus_meta.cc:287] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.001s
I20260709 12:12:50.881642 13942 raft_consensus.cc:2468] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 3.
I20260709 12:12:50.838407 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:50.873181 13914 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:50.869997 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 97216.4us
I20260709 12:12:50.858669 15414 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:50.883049 15414 raft_consensus.cc:3060] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:50.889362 15481 log.cc:927] Time spent T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.878s	user 0.000s	sys 0.013s
W20260709 12:12:50.871227 15494 log.cc:927] Time spent T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:12:50.878481 15416 consensus_queue.cc:1048] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.880342 15375 leader_election.cc:290] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:50.870813 15280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.010s	sys 0.028s
I20260709 12:12:50.868826 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:50.899708 14088 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.900315 14757 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:50.869096 14090 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:50.895991 14063 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:50.878679 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:50.903545 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 263889us
I20260709 12:12:50.904188 13946 raft_consensus.cc:2468] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:50.854272 15383 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:50.902350 13949 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:50.907315 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:50.906483 14063 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:50.910128 13946 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
W20260709 12:12:50.911454 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 123760us
I20260709 12:12:50.917057 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:50.909655 15496 log.cc:927] Time spent T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:12:50.917826 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:50.918594 14063 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:50.916013 13837 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:50.900424 15413 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:50.874905 15508 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:50.915767 13988 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:50.922784 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.917739 13873 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:50.924196 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.910950 15383 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.931169 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.931843 14015 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:50.924741 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:50.926460 14023 raft_consensus.cc:1275] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:50.913115 15466 raft_consensus.cc:2804] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:50.908185 15514 raft_consensus.cc:2749] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:50.929910 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:50.912467 15511 raft_consensus.cc:2749] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:50.937445 13988 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:50.921396 15430 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.950990 13837 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:50.941344 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 57526.9us
I20260709 12:12:50.927377 15508 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.955833 13914 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:50.956972 13837 leader_election.cc:304] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:50.941399 15362 consensus_meta.cc:287] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.004s
I20260709 12:12:50.936465 15383 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:50.960196 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:50.932402 15502 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.936189 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:50.960666 13988 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:50.966399 15466 raft_consensus.cc:697] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:50.942893 15488 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:50.969883 14757 raft_consensus.cc:2764] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:12:50.960847 14014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51082 (request call id 344) took 1937 ms. Trace:
I20260709 12:12:50.958069 15508 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:50.978921 15518 raft_consensus.cc:2804] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:50.961856 15519 raft_consensus.cc:2749] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:50.956053 15521 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:50.946061 15522 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:12:50.993625 15476 log.cc:927] Time spent T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 1.188s	user 0.006s	sys 0.006s
I20260709 12:12:50.982774 13866 raft_consensus.cc:2468] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:50.963542 15489 raft_consensus.cc:2804] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:50.960394 15430 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.964812 15362 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:51.001245 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 64082.8us
I20260709 12:12:50.977901 15466 consensus_queue.cc:237] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:50.973737 14913 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:50.988884 15517 raft_consensus.cc:2804] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:51.021099 13989 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:51.027233 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 66702.8us
I20260709 12:12:51.004925 15392 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:51.030435 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.035051 15296 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:50.989692 15488 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.042554 13945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 311) took 1779 ms. Trace:
I20260709 12:12:51.044181 15296 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:51.047005 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.047674 14090 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:51.049748 15424 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.050871 13941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48298 (request call id 443) took 1027 ms. Trace:
I20260709 12:12:51.051244 13941 rpcz_store.cc:276] 0709 12:12:50.023352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.023601 (+   249us) service_pool.cc:224] Handling call
0709 12:12:51.050666 (+1027065us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540052fdd4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:51.050805 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272186112}
I20260709 12:12:51.006896 15214 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:50.970599 15502 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.054304 15502 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.054935 15362 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.007445 15522 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:51.058990 15522 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:12:51.061758 15480 log.cc:927] Time spent T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 1.084s	user 0.007s	sys 0.007s
I20260709 12:12:51.063843 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.005791 15518 raft_consensus.cc:697] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:51.065462 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.065693 15518 consensus_queue.cc:237] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:51.068943 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbcdeeb9235d42a3b84c08ec08333ad1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.069600 13949 raft_consensus.cc:2376] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4. Re-sending same reply.
W20260709 12:12:51.037340 15507 log.cc:927] Time spent T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:12:51.048342 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.070618 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.075475 13948 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:51.025884 15489 raft_consensus.cc:697] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 5 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.043025 13945 rpcz_store.cc:276] 0709 12:12:49.263438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.263559 (+   121us) service_pool.cc:224] Handling call
0709 12:12:49.263914 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.264274 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.264303 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.269553 (+  5250us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.537152 (+267599us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:12:49.814485 (+277333us) log.cc:844] Serialized 14 byte log entry
0709 12:12:49.930304 (+115819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.930406 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.974064 (+1043658us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:51.042181 (+ 68117us) raft_consensus.cc:1685] finished
0709 12:12:51.042302 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.042479 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64833,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":117028,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":12579,"spinlock_wait_cycles":512892672,"thread_start_us":430386,"threads_started":2,"wal-append.queue_time_us":456297}
I20260709 12:12:51.082600 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.083434 13949 raft_consensus.cc:2393] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 6: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:51.084765 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.085418 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.048657 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.088618 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f903e94ec2ba4603b5cf9a666701027c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.089956 14095 raft_consensus.cc:1240] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:51.091068 14095 raft_consensus.cc:1275] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:51.086135 13945 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:51.093274 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.093900 13948 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
W20260709 12:12:51.089505 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 68791us
I20260709 12:12:51.029561 15517 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:51.096341 13941 raft_consensus.cc:1275] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:51.100065 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 154148us
I20260709 12:12:51.106979 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.123463 13837 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.078142 14017 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:51.132138 14061 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.132390 13989 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.133947 14096 raft_consensus.cc:1240] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 LEADER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:51.126029 14062 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:51.138303 15445 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.134135 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.101936 13840 leader_election.cc:400] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Vote denied by peer 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801) with higher term. Message: Invalid argument: T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 4. Current term is 5.
W20260709 12:12:51.146631 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 44935us
I20260709 12:12:51.146275 15424 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:51.151227 15489 consensus_queue.cc:237] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.132784 15414 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:51.153237 15531 log.cc:927] Time spent T bf5e25fe9f77426fa4a403ff3ebbdf29 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:12:51.153650 15430 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.125016 15503 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:51.154982 14091 raft_consensus.cc:1240] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:51.149614 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.154158 15466 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:51.098546 15488 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.147300 14093 raft_consensus.cc:2468] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 1.
I20260709 12:12:51.130203 15392 raft_consensus.cc:697] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Leader. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:51.154547 15414 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
    @     0x7fce35266d05 testing::TestSuite::Run() at ??:0
I20260709 12:12:51.087185 14090 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:51.176919 15430 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:12:51.155381 15530 consensus_queue.cc:1048] T 0f350f91cb624fb09ebaf23027f592f5 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:12:51.178753 15500 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.183418 15500 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.148875 14062 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:51.098986 14088 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:51.159050 15416 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:51.160977 15466 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.159457 15515 raft_consensus.cc:2749] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:12:51.168783 13866 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
I20260709 12:12:50.989018 14014 rpcz_store.cc:276] 0709 12:12:49.023094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.024162 (+  1068us) service_pool.cc:224] Handling call
0709 12:12:49.624611 (+600449us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b580054ba98. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:49.624977 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:49.625625 (+   648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.625673 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:49.626617 (+   944us) log.cc:844] Serialized 52 byte log entry
0709 12:12:50.008291 (+381674us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:50.725526 (+717235us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.927337 (+201811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.934748 (+  7411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.934955 (+   207us) raft_consensus.cc:1685] finished
0709 12:12:50.941848 (+  6893us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.957820 (+ 15972us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75765,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":78064,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":3412,"spinlock_wait_cycles":9659648,"thread_start_us":1121725,"threads_started":3,"wal-append.queue_time_us":504554}
I20260709 12:12:51.106176 15517 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:51.187991 15414 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:51.162832 13840 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:51.200700 13840 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:51.202319 13914 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:51.187990 15466 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:51.194943 14097 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 6.
I20260709 12:12:51.161805 15528 consensus_queue.cc:1048] T bf5e25fe9f77426fa4a403ff3ebbdf29 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:12:51.188298 15416 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.097167 15383 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.230428 15383 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.232769 15416 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:51.196593 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 165687us
I20260709 12:12:51.190853 14062 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:51.187229 15530 raft_consensus.cc:2749] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:12:51.205433 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:51.211418 13989 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:51.213318 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 73412.8us
I20260709 12:12:51.236209 15488 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.236795 15518 raft_consensus.cc:2749] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:51.236805 15488 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.237509 15530 raft_consensus.cc:2804] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:51.237954 15530 raft_consensus.cc:493] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:51.238314 15530 raft_consensus.cc:3060] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:51.238528 13837 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.238740 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.239209 15488 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.239459 13837 leader_election.cc:304] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.240480 15519 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:51.203303 15296 raft_consensus.cc:2804] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:51.216590 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.208746 15362 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:51.208098 15392 consensus_queue.cc:237] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:51.206079 15424 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:51.202402 15414 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.223256 14757 consensus_queue.cc:1048] T 37b8bed45862453fa77c3294a4231b24 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:12:51.241592 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 50823.9us
I20260709 12:12:51.270614 15414 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.257308 15403 consensus_queue.cc:1059] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:12:51.236917 13989 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.258837 15254 consensus_queue.cc:1048] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:12:51.273969 13989 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.274829 15518 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:51.275293 15518 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:51.275657 15518 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.253047 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.277151 13873 raft_consensus.cc:2393] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:51.281302 15430 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:51.283118 13912 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.253134 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.219650 15522 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.287655 15491 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.288307 15522 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.249048 15519 raft_consensus.cc:2749] T f903e94ec2ba4603b5cf9a666701027c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:51.196666 15508 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.291042 15508 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:51.259371 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 52390.9us
I20260709 12:12:51.261013 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.293617 13871 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:51.294505 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.295110 13871 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:51.296173 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.296808 13949 raft_consensus.cc:2376] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3. Re-sending same reply.
I20260709 12:12:51.259799 15362 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.254726 15296 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:51.266403 15424 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:51.285235 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.301954 14097 raft_consensus.cc:1275] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:51.317633 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.308038 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.302695 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.302961 13914 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:51.301062 13912 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.306828 15214 raft_consensus.cc:2804] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:51.308130 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.328051 14096 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.281819 15430 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:51.308991 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.309516 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.306867 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.304219 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.317262 15424 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:51.321003 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.321882 15511 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:51.347504 15511 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.347955 15511 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:51.324020 15403 raft_consensus.cc:3055] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:51.350849 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:51.240901 13826 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Tablet 67a590283c194e508b8eaab0070f9c01 (table test-workload [id=5c203191cf5d4c66a380510923aa713b]) was not created within the allowed timeout. Replacing with a new tablet d5d94233b84f4d3897d0be1e4dd5a852
I20260709 12:12:51.318251 15296 raft_consensus.cc:3060] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.326646 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.355226 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.329505 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.329696 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.334378 14093 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:51.338523 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.335997 14088 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.336035 15521 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.312851 15362 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.345530 13837 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:51.346835 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.317633 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
W20260709 12:12:51.364614 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 47102.2us
I20260709 12:12:51.368032 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.368667 13947 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:12:51.353901 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 59299.1us
I20260709 12:12:51.359679 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.336980 15430 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.336738 15485 raft_consensus.cc:2804] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:51.362135 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.342180 15214 raft_consensus.cc:697] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.354179 15403 raft_consensus.cc:740] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:51.362793 15521 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.380136 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.382661 14023 raft_consensus.cc:2410] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:12:51.362848 14014 raft_consensus.cc:2368] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:51.379922 15508 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:51.384152 15508 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.384526 15508 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:51.379249 15383 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:12:51.370707 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.391403 13949 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.391582 15397 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:51.392854 15214 consensus_queue.cc:237] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.354516 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.376845 14019 raft_consensus.cc:2393] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 6: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:51.379807 15254 raft_consensus.cc:2804] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:51.396953 15254 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:51.397321 15254 raft_consensus.cc:3060] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.401748 15403 consensus_queue.cc:260] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.402374 15530 raft_consensus.cc:515] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.365588 13837 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.354316 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.404115 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.326494 15517 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:51.409811 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 44302.8us
I20260709 12:12:51.420188 13837 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:51.409080 13949 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:51.413478 14096 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:51.476253 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.416512 15259 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:51.495090 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 72271.2us
I20260709 12:12:51.496600 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.497799 13947 raft_consensus.cc:2468] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:51.500533 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.501776 13912 leader_election.cc:304] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.500873 14063 leader_election.cc:304] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.408619 15485 raft_consensus.cc:697] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.507267 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123e199d60f94411b09c3e9ba4ca38fe" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.510552 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.474143 15542 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:51.508495 14063 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.494257 15490 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:51.513618 15414 raft_consensus.cc:2804] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:51.535043 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.517319 15542 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.517804 15473 raft_consensus.cc:2804] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:51.519510 15544 consensus_queue.cc:1059] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
    @     0x7fce3527b7f5 testing::internal::UnitTestImpl::RunAllTests() at ??:0
I20260709 12:12:51.598001 14018 raft_consensus.cc:3060] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:12:51.599692 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.558282 14088 raft_consensus.cc:2468] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:51.608090 13942 raft_consensus.cc:1275] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:51.593101 15404 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.610244 15404 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.612910 15485 consensus_queue.cc:237] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.613576 15445 consensus_queue.cc:1048] T dbcdeeb9235d42a3b84c08ec08333ad1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:51.525635 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.523154 15522 raft_consensus.cc:2804] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:51.534840 14092 raft_consensus.cc:1240] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:51.532895 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.563918 15516 raft_consensus.cc:493] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.569723 13868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52332 (request call id 322) took 1920 ms. Trace:
I20260709 12:12:51.620436 15473 raft_consensus.cc:697] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.620319 15544 raft_consensus.cc:3055] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:51.672732 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.632663 13866 raft_consensus.cc:3060] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.566666 15435 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.635051 15521 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.612526 15404 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.590337 15530 leader_election.cc:290] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.604795 15542 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.684890 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00fe8bc507b4059ad259285c1183c92" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.685375 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.641783 14018 raft_consensus.cc:2468] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:51.638720 15362 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.568020 15460 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.546789 15490 raft_consensus.cc:697] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:51.622754 15414 raft_consensus.cc:697] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:51.596258 15511 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.642608 15489 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.686798 13912 leader_election.cc:304] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.687656 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.552062 15254 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.712213 15490 consensus_queue.cc:237] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.713649 15254 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.714643 13865 raft_consensus.cc:1240] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:51.649976 15522 raft_consensus.cc:697] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:51.716173 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.716879 14021 raft_consensus.cc:3060] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.716002 15522 consensus_queue.cc:237] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.692562 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.695374 13948 raft_consensus.cc:1240] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:51.523342 15518 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.723613 15518 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.674453 15544 raft_consensus.cc:740] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:51.666781 15516 raft_consensus.cc:515] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.725478 15544 consensus_queue.cc:260] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.727028 15214 raft_consensus.cc:2804] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:51.727806 15214 raft_consensus.cc:697] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.727528 15473 consensus_queue.cc:237] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.728789 15214 consensus_queue.cc:237] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.729187 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.733052 15518 raft_consensus.cc:493] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.733718 15518 raft_consensus.cc:515] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:51.735621 15430 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.704682 13946 raft_consensus.cc:1240] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:51.738690 15518 leader_election.cc:290] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.739782 13946 raft_consensus.cc:1275] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:51.740927 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.741750 14023 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:51.743291 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.644579 15296 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:51.701716 14092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 338) took 1444 ms. Trace:
I20260709 12:12:51.689774 15508 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.745620 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.749898 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.750104 15296 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.750641 15443 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.649159 13868 rpcz_store.cc:276] 0709 12:12:49.649063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.657918 (+  8855us) service_pool.cc:224] Handling call
0709 12:12:50.726843 (+1068925us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:51.568843 (+842000us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:51.569013 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.569207 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.569251 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:51.569386 (+   135us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:51.569437 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.569514 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.569663 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51064448}
I20260709 12:12:51.751639 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:51.752563 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.754129 15511 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.754954 13945 raft_consensus.cc:1240] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:51.740685 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.745747 15489 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.755590 14092 rpcz_store.cc:276] 0709 12:12:50.245965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.282705 (+ 36740us) service_pool.cc:224] Handling call
0709 12:12:51.504576 (+1221871us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d11cfc0 00007fce3d107929 00007fce3d1073d2 00007fce3667ebd4
0709 12:12:51.520075 (+ 15499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.656143 (+136068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.690294 (+ 34151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22328576}
I20260709 12:12:51.710958 15414 consensus_queue.cc:237] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.733381 14015 raft_consensus.cc:1240] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Rejecting Update request from peer 33ef851003ef478cac1897bfee45a8f2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:12:51.750860 13872 raft_consensus.cc:1240] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
W20260709 12:12:51.596025 13826 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Tablet 040f8a0271784f748abc1ed10f9440a1 (table test-workload [id=5c203191cf5d4c66a380510923aa713b]) was not created within the allowed timeout. Replacing with a new tablet deed7a8fed7840c09b25398b8e4928ce
I20260709 12:12:51.763803 13946 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:51.707617 14018 raft_consensus.cc:2368] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:51.766090 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.771059 13914 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.772115 13946 raft_consensus.cc:1275] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:51.745653 13870 raft_consensus.cc:1275] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:51.778857 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.775094 13768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38496 (request call id 55) took 6627 ms. Trace:
I20260709 12:12:51.781946 13989 leader_election.cc:304] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:51.780352 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.727149 15517 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:51.793864 13949 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:51.680785 15466 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:51.797258 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 451667us
I20260709 12:12:51.746209 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e5c0206d594f77b1c65f9d7e8584c3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.803251 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.791647 13941 raft_consensus.cc:1240] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:51.803700 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.804111 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf784ecd514417286b3130eab79f085" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.798574 13837 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:51.798906 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.763202 15516 leader_election.cc:290] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.806257 14015 raft_consensus.cc:3060] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.809969 13869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.811100 15424 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:51.812247 15500 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.812846 15500 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.813812 13871 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:51.813457 15424 leader_election.cc:290] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.815021 15500 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:51.815569 14088 raft_consensus.cc:3060] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:51.815708 15205 consensus_queue.cc:1048] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:51.816466 15205 consensus_queue.cc:1243] T 02548a2cbee943cba6dc06896b099e46 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer 6f3e7e9dcfab49fb99d979c338c67ffb log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:12:51.797982 15332 raft_consensus.cc:2749] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:51.815251 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.823629 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.794633 15530 consensus_queue.cc:1059] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:12:51.825753 15530 raft_consensus.cc:3055] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:51.826098 15530 raft_consensus.cc:740] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:51.826678 14088 raft_consensus.cc:1275] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:51.827003 15530 consensus_queue.cc:260] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:51.828215 15530 raft_consensus.cc:3060] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.829900 13837 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:51.831377 15430 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.834245 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.834381 15296 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:51.835471 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.834297 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:51.836889 15508 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:51.837556 14016 raft_consensus.cc:2393] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 6: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:51.838681 15362 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:51.839214 14096 raft_consensus.cc:1240] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:51.776340 15254 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.836433 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.775218 15385 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.780668 13768 rpcz_store.cc:276] 0709 12:12:45.153683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.155868 (+  2185us) service_pool.cc:224] Handling call
0709 12:12:51.774995 (+6619127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:47.833032 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:47.833986 (+   954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:47.834055 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:12:47.834083 (+    28us) tablet.cc:662] Decoding operations
0709 12:12:47.836823 (+  2740us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:47.836942 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:47.836977 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:12:47.838327 (+  1350us) tablet.cc:701] Row locks acquired
0709 12:12:47.838386 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:12:47.838587 (+   201us) write_op.cc:270] Start()
0709 12:12:47.838772 (+   185us) write_op.cc:276] Timestamp: P: 1783599167838514 usec, L: 0
0709 12:12:47.838792 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:47.839948 (+  1156us) log.cc:844] Serialized 4805 byte log entry
0709 12:12:48.675681 (+835733us) op_driver.cc:464] REPLICATION: finished
0709 12:12:48.806799 (+131118us) write_op.cc:301] APPLY: starting
0709 12:12:48.806920 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:48.807278 (+   358us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:48.807416 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:48.808853 (+  1437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:48.809131 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:12:48.809180 (+    49us) write_op.cc:312] APPLY: finished
0709 12:12:48.809501 (+   321us) log.cc:844] Serialized 88 byte log entry
0709 12:12:48.809682 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:48.809848 (+   166us) write_op.cc:454] Released schema lock
0709 12:12:48.809902 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:48.810296 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:48.810325 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165418,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":123829,"apply.run_cpu_time_us":3526,"apply.run_wall_time_us":7326,"num_ops":12,"prepare.queue_time_us":183485,"prepare.run_cpu_time_us":40291,"prepare.run_wall_time_us":100880,"raft.queue_time_us":95933,"raft.run_cpu_time_us":27232,"raft.run_wall_time_us":110595,"replication_time_us":836695,"thread_start_us":324348,"threads_started":4,"wal-append.queue_time_us":218584,"wal-append.run_cpu_time_us":40786,"wal-append.run_wall_time_us":1867733}]]}
W20260709 12:12:51.858743 13826 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Tablet 37b8bed45862453fa77c3294a4231b24 (table test-workload [id=5c203191cf5d4c66a380510923aa713b]) was not created within the allowed timeout. Replacing with a new tablet 90fa1e03e5ef427682ee2c18afb3a9c6
I20260709 12:12:51.829751 15403 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:51.820351 13866 raft_consensus.cc:2468] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:51.851634 14021 raft_consensus.cc:2468] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
W20260709 12:12:51.867641 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.780228 15392 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.930109 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:51.861948 15254 raft_consensus.cc:515] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:51.936652 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.936782 15489 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.937477 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.938989 15517 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:51.989046 15517 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:51.939332 15466 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:51.860747 15488 consensus_queue.cc:1048] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:12:51.865546 15519 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:51.946476 14092 raft_consensus.cc:1240] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:12:51.948661 13945 raft_consensus.cc:1275] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:51.949457 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:51.865686 15516 consensus_queue.cc:1059] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:12:51.804388 15416 consensus_queue.cc:1048] T 94d5a4389d98450b8318ec8f281182ad P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 12:12:52.009775 14063 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:51.956007 15503 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.011370 15503 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.013870 15503 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:52.014068 14015 raft_consensus.cc:2468] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:52.014184 13913 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:51.956914 15526 raft_consensus.cc:493] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.015028 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:52.015234 15526 raft_consensus.cc:515] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:52.015746 13913 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.016003 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:52.016547 15383 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:52.017719 15526 leader_election.cc:290] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:51.957592 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.017946 13913 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.019320 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.020079 15383 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:51.958954 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:52.021879 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:52.022698 14092 raft_consensus.cc:2368] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:52.024679 15416 consensus_queue.cc:1059] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:52.026094 15416 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:52.026456 15416 raft_consensus.cc:493] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.026800 15416 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:52.027101 13913 leader_election.cc:400] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455) with higher term. Message: Invalid argument: T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:51.959472 15544 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.966338 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.975171 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:51.976444 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcab28297ec5466180129cc4860d9838" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.030632 14091 raft_consensus.cc:2368] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:52.030877 15383 consensus_queue.cc:1059] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:52.031478 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f350f91cb624fb09ebaf23027f592f5" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.032223 15383 raft_consensus.cc:3055] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:12:52.032716 15383 raft_consensus.cc:740] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:51.976698 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.033552 15383 consensus_queue.cc:260] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.034440 14094 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 2.
I20260709 12:12:52.034788 15383 raft_consensus.cc:3060] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:51.965123 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:51.980170 13865 pending_rounds.cc:85] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Aborting all ops after (but not including) 1
I20260709 12:12:52.036265 13865 pending_rounds.cc:107] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:12:52.036602 13865 raft_consensus.cc:2889] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.984318 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:51.981833 15535 consensus_queue.cc:1059] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:12:51.987914 13866 raft_consensus.cc:1275] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:12:51.982419 15435 consensus_queue.cc:1059] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:12:52.039712 15489 raft_consensus.cc:2749] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:51.993391 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e14a4c4c894f76b64a895bf9dd7faa" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.000505 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:51.945406 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:52.005254 13986 leader_election.cc:304] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.031838 14091 raft_consensus.cc:1240] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:52.033648 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.043623 13989 leader_election.cc:304] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.044057 13871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.052023 14020 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 4.
I20260709 12:12:52.044610 13914 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:51.977916 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 43778.1us
I20260709 12:12:52.065599 13913 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:52.082057 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.089967 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 45457.3us
I20260709 12:12:52.090111 13913 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:51.882893 15542 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.101095 15273 raft_consensus.cc:3055] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:52.101855 15273 raft_consensus.cc:740] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:52.102614 15542 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:52.103399 15362 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.103158 15273 consensus_queue.cc:260] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:52.104214 15362 raft_consensus.cc:2749] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:12:52.104620 15517 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:52.003552 15534 consensus_queue.cc:1048] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:12:52.040649 15435 raft_consensus.cc:3055] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:52.095175 15533 raft_consensus.cc:3055] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:12:52.096421 15549 log.cc:927] Time spent T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:12:52.052825 15518 consensus_queue.cc:1059] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:12:52.098222 15555 log.cc:927] Time spent T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:52.109604 13913 leader_election.cc:304] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.078977 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:52.003865 15541 consensus_queue.cc:1059] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
W20260709 12:12:52.110051 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 104918us
W20260709 12:12:52.112138 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 68586.8us
I20260709 12:12:52.108392 15254 leader_election.cc:290] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:52.118891 15398 raft_consensus.cc:2749] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:12:52.053072 15430 consensus_queue.cc:1059] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:12:51.991205 15392 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.007764 15519 raft_consensus.cc:493] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.114988 15435 raft_consensus.cc:740] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:52.090420 15503 consensus_queue.cc:1059] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:12:52.122169 15533 raft_consensus.cc:740] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:52.124524 15535 raft_consensus.cc:2749] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:12:52.121310 15559 raft_consensus.cc:2749] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:52.141453 15273 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:52.170512 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:52.178485 13948 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:52.151662 13942 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:52.154498 15274 raft_consensus.cc:2749] T b2e14a4c4c894f76b64a895bf9dd7faa P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:52.185966 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 176377us
I20260709 12:12:52.165920 15519 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:52.194001 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 250634us
I20260709 12:12:52.195358 14091 raft_consensus.cc:1275] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:52.197356 14062 leader_election.cc:304] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:52.210040 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 100508us
I20260709 12:12:52.213971 13948 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 7.
W20260709 12:12:52.215591 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 173480us
I20260709 12:12:52.218458 13913 leader_election.cc:304] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.222944 15466 raft_consensus.cc:2749] T 123e199d60f94411b09c3e9ba4ca38fe P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:52.212237 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.233371 15435 consensus_queue.cc:260] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.234696 15435 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.236007 15280 raft_consensus.cc:493] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.236549 15280 raft_consensus.cc:515] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.238719 15280 leader_election.cc:290] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:52.204044 15254 raft_consensus.cc:493] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.243032 15254 raft_consensus.cc:515] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
W20260709 12:12:52.243777 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.191522 15517 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:12:52.213408 15541 raft_consensus.cc:3055] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:52.203481 15559 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:52.255039 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 56227.7us
I20260709 12:12:52.257236 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.258054 14062 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.259163 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:52.262830 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 44658.4us
I20260709 12:12:52.264604 13913 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.265323 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:52.308221 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.246292 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d5a4389d98450b8318ec8f281182ad" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:52.311685 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 47162us
I20260709 12:12:52.314364 13913 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.315915 13913 leader_election.cc:304] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.316890 15205 raft_consensus.cc:2749] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:12:52.317165 14063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 121899us
I20260709 12:12:52.246434 15541 raft_consensus.cc:740] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:52.260574 15559 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:52.322875 13837 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.335810 13871 raft_consensus.cc:1240] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:52.337111 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:52.339615 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.340047 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 190120us
I20260709 12:12:52.218155 15533 consensus_queue.cc:260] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:52.322465 13913 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.313604 15557 raft_consensus.cc:2749] T 10e5c0206d594f77b1c65f9d7e8584c3 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:52.321523 15485 raft_consensus.cc:2749] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:52.338925 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:52.357815 14091 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:52.334542 15443 consensus_meta.cc:287] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb: Time spent flushing consensus metadata: real 0.583s	user 0.014s	sys 0.000s
I20260709 12:12:52.356603 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f30b80997e84e0aac7842adc7ae98b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:52.336900 15259 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:52.335901 15414 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:12:52.373625 15564 log.cc:927] Time spent T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:52.378863 13942 raft_consensus.cc:2468] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 7.
I20260709 12:12:52.336483 15383 consensus_queue.cc:1048] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:12:52.380996 15383 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:52.382300 15533 raft_consensus.cc:3060] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:52.360167 15561 log.cc:927] Time spent T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:12:52.385131 15392 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.349335 15570 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.385695 15392 raft_consensus.cc:493] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:52.385861 15570 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.386170 15392 raft_consensus.cc:515] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.388087 15392 leader_election.cc:290] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.345557 15511 raft_consensus.cc:2749] T dcf784ecd514417286b3130eab79f085 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:52.414426 14091 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:52.390502 15403 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.423975 15254 leader_election.cc:290] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:52.424155 15403 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:52.388106 15570 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:52.428903 13867 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 2.
W20260709 12:12:52.430534 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 109892us
I20260709 12:12:52.435245 13865 raft_consensus.cc:1275] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:52.442548 13867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52336 (request call id 229) took 1999 ms (client timeout 1623 ms). Trace:
I20260709 12:12:52.396561 15541 consensus_queue.cc:260] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:52.451458 13867 rpcz_store.cc:269] 0709 12:12:50.443328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.446056 (+  2728us) service_pool.cc:224] Handling call
0709 12:12:51.216445 (+770389us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b5800004298. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501eeee 000000000036eb39 00007fce3d0921e0 00007fce3d15b0c4 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:52.442212 (+1225767us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54008840d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381472fa 00007fce3d108b17 00007fce366836d4 00007fce36683662 00007fce36683591 00007fce3668350c 00007fce366827c2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:52.442430 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704226816}
W20260709 12:12:52.447081 15385 consensus_meta.cc:287] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.006s
I20260709 12:12:52.447182 15519 raft_consensus.cc:515] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.456584 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.430635 15430 consensus_queue.cc:1059] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:12:52.461105 15530 consensus_meta.cc:287] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.009s
W20260709 12:12:52.455459 15280 consensus_queue.cc:1175] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:52.459071 15385 raft_consensus.cc:2749] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:52.431146 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 87245.7us
I20260709 12:12:52.460311 15416 raft_consensus.cc:515] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:52.483702 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 158642us
I20260709 12:12:52.484297 13913 leader_election.cc:304] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.485441 14063 leader_election.cc:304] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:52.486006 15583 raft_consensus.cc:2749] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:52.488250 15392 raft_consensus.cc:493] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.488852 15392 raft_consensus.cc:515] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.489600 15567 raft_consensus.cc:2804] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:12:52.490233 15567 raft_consensus.cc:697] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:52.490949 14063 leader_election.cc:304] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:52.491076 15392 leader_election.cc:290] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.491117 15567 consensus_queue.cc:237] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:52.492869 15574 raft_consensus.cc:493] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:52.493211 13913 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.493635 15574 raft_consensus.cc:515] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.494689 15572 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.496049 13913 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.497097 15572 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.501034 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:52.499754 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.503849 14094 raft_consensus.cc:1275] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:52.504135 13865 raft_consensus.cc:2368] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:52.506261 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.509455 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:52.474354 15579 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
    @     0x7fce35287cd0 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260709 12:12:52.515722 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.521472 14096 raft_consensus.cc:2368] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:52.523936 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.505628 15574 leader_election.cc:290] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.514446 15572 consensus_queue.cc:1048] T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:12:52.531384 13867 raft_consensus.cc:2393] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:52.511693 15404 raft_consensus.cc:2804] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:12:52.551844 13837 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:52.554082 15576 raft_consensus.cc:493] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
W20260709 12:12:52.554467 15550 log.cc:927] Time spent T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.568s	user 0.000s	sys 0.011s
I20260709 12:12:52.554688 15576 raft_consensus.cc:515] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.556840 15414 raft_consensus.cc:493] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:52.557070 15514 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.557432 15414 raft_consensus.cc:515] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:52.557539 15514 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.559551 15414 leader_election.cc:290] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:52.561906 14094 raft_consensus.cc:1275] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:52.560443 14093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 339) took 1153 ms. Trace:
I20260709 12:12:52.559604 15514 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.578361 13873 raft_consensus.cc:1275] T b770dc00e1f8499d88d9fe1d5650d32c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:52.578895 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.579407 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.579619 13865 raft_consensus.cc:2468] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 2.
I20260709 12:12:52.565830 14093 rpcz_store.cc:276] 0709 12:12:51.406585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.406760 (+   175us) service_pool.cc:224] Handling call
0709 12:12:51.492054 (+ 85294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:51.492467 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.492493 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:51.504438 (+ 11945us) log.cc:844] Serialized 52 byte log entry
0709 12:12:51.767876 (+263438us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:51.767936 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.768037 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.553856 (+785819us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce34f7cc85 00007fce34f7d6a2 00007fce37cef1db 00007fce37ceaaaf 00007fce37cde86e 00007fce37cddbb6 00007fce37cdd7d8 00007fce37ce7221 00007fce37ce71d9 00007fce37ce7169
0709 12:12:52.560131 (+  6275us) raft_consensus.cc:1685] finished
0709 12:12:52.560152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.560381 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2828,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8808,"spinlock_wait_cycles":10108288,"thread_start_us":243364,"threads_started":1,"wal-append.queue_time_us":468322}
I20260709 12:12:52.585716 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:52.596478 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.599519 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.599637 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.600351 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.600684 14015 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 4.
I20260709 12:12:52.600965 14021 raft_consensus.cc:2468] T 67a590283c194e508b8eaab0070f9c01 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:52.602866 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.609190 14021 raft_consensus.cc:1275] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:52.611609 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:52.612739 14017 raft_consensus.cc:2468] T c212f97a40314d1dbb07943ef4722563 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
I20260709 12:12:52.612890 15416 leader_election.cc:290] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:52.613920 14016 raft_consensus.cc:1275] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:52.620191 15519 leader_election.cc:290] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:52.584486 15404 raft_consensus.cc:697] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 7 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:52.622901 15404 consensus_queue.cc:237] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:52.625339 15535 raft_consensus.cc:3055] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:52.625768 15535 raft_consensus.cc:740] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:52.626574 15535 consensus_queue.cc:260] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.627539 15535 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:52.628784 15534 raft_consensus.cc:3055] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:52.629176 15534 raft_consensus.cc:740] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:52.630017 15534 consensus_queue.cc:260] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.631021 15534 raft_consensus.cc:3060] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.527097 15579 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:52.633853 15579 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.634992 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c47dd7750a84d98a2f83efe24a70125" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.636216 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.583920 15523 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:52.637265 15523 raft_consensus.cc:697] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:52.637482 15403 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:52.638185 15523 consensus_queue.cc:237] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.583580 15572 consensus_queue.cc:1048] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:12:52.648885 15574 raft_consensus.cc:493] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:52.649572 15574 raft_consensus.cc:515] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.653826 13949 raft_consensus.cc:3060] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:52.659070 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.664871 13872 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
W20260709 12:12:52.576432 15473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.026s	sys 0.024s
I20260709 12:12:52.671353 13866 raft_consensus.cc:1240] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:52.673429 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.674868 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c9db182bf36444d875b066aec0dd8b8" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.666550 15517 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.601554 15576 leader_election.cc:290] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.682591 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.691852 13949 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
W20260709 12:12:52.676287 15473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.026s	sys 0.024s
I20260709 12:12:52.695716 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:52.698132 13945 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:52.728322 13987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.736847 15362 consensus_queue.cc:1048] T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:52.738847 14015 raft_consensus.cc:1275] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:52.739240 14015 pending_rounds.cc:85] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Aborting all ops after (but not including) 1
I20260709 12:12:52.739444 14015 pending_rounds.cc:107] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:52.739661 14015 raft_consensus.cc:2889] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.742991 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
W20260709 12:12:52.747152 13913 leader_election.cc:336] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455): Timed out: RequestConsensusVote RPC to 127.7.102.131:36455 timed out after 1.560s (SENT)
I20260709 12:12:52.755600 13913 leader_election.cc:304] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.750620 15576 consensus_queue.cc:1059] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.665606 15574 leader_election.cc:290] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.680708 15403 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.802187 13988 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.749241 13840 leader_election.cc:304] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:52.785983 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.813411 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 64256.3us
W20260709 12:12:52.801963 14062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 51254.6us
W20260709 12:12:52.802688 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 55591.4us
I20260709 12:12:52.817909 13913 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.809227 13945 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:52.693153 15559 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:52.821362 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.812408 15586 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.682204 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5506586a24f8084e47741b1525e94" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:52.834437 13913 leader_election.cc:304] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.827057 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:52.827780 13945 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:52.825399 15435 raft_consensus.cc:2749] T 02548a2cbee943cba6dc06896b099e46 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:52.832206 13948 raft_consensus.cc:1240] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 6. Current term is 7. Ops: []
I20260709 12:12:52.831899 13988 leader_election.cc:304] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.839188 14062 leader_election.cc:304] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:52.836742 13947 raft_consensus.cc:2468] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
I20260709 12:12:52.849457 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:52.850620 14096 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:52.853542 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:52.854386 14097 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:52.861645 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.865456 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8256693c278a41308741e7b9c2f033a1" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:52.869393 13914 leader_election.cc:304] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
W20260709 12:12:52.875135 13986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.016s
W20260709 12:12:52.876942 13986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.017s
I20260709 12:12:52.867652 13837 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:52.679759 15517 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:52.874157 15522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.021s	sys 0.042s
W20260709 12:12:52.885332 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 539716us
I20260709 12:12:52.831913 15392 raft_consensus.cc:2749] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.884032 13913 leader_election.cc:304] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
W20260709 12:12:52.884646 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 43831.1us
I20260709 12:12:52.890314 13947 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:52.892807 13988 leader_election.cc:400] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:52.896082 13988 leader_election.cc:403] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.888891 13914 leader_election.cc:304] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.899591 14097 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:52.901650 15519 raft_consensus.cc:2804] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:52.904572 13837 leader_election.cc:304] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:52.905723 15296 raft_consensus.cc:2804] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:52.906344 15296 raft_consensus.cc:697] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:52.907480 15296 consensus_queue.cc:237] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:52.835839 15557 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:52.839651 15488 raft_consensus.cc:2764] T b91647541d8445a9bb817662fd2837e3 P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:12:52.880853 15533 raft_consensus.cc:2749] T 4c9db182bf36444d875b066aec0dd8b8 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.832656 15403 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:52.932327 13941 raft_consensus.cc:1240] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5. Ops: []
W20260709 12:12:52.891588 15522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.021s	sys 0.043s
I20260709 12:12:52.929183 13986 leader_election.cc:304] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:52.928723 13988 leader_election.cc:304] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:52.882855 15530 raft_consensus.cc:2804] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:12:52.937934 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 48196.1us
I20260709 12:12:52.941390 13986 leader_election.cc:400] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:52.835988 15573 consensus_queue.cc:1048] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
W20260709 12:12:52.918068 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.015s	sys 0.015s
I20260709 12:12:52.944211 13986 leader_election.cc:403] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.890816 15214 raft_consensus.cc:2804] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:52.902210 15519 raft_consensus.cc:493] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.885720 15460 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:12:52.913281 15485 raft_consensus.cc:2804] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:52.954568 14095 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 LEADER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:52.888322 15582 raft_consensus.cc:2749] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:52.956898 13986 leader_election.cc:400] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:52.935716 15473 raft_consensus.cc:2749] T 8256693c278a41308741e7b9c2f033a1 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:52.911561 15572 consensus_queue.cc:1048] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 12:12:52.955287 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.015s	sys 0.015s
I20260709 12:12:52.836174 15586 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:52.943325 15530 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.944592 15574 raft_consensus.cc:3060] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:12:52.965945 13837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 61470.1us
I20260709 12:12:52.954321 15214 raft_consensus.cc:493] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:52.968582 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 204206us
I20260709 12:12:52.961457 15519 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:52.991343 15595 raft_consensus.cc:2749] T 2c47dd7750a84d98a2f83efe24a70125 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:52.954593 15392 raft_consensus.cc:2749] T dcab28297ec5466180129cc4860d9838 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:52.925947 15362 consensus_queue.cc:1048] T fe541614d477406f98fbe7ccaecdba91 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:12:52.966135 13986 leader_election.cc:403] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:12:53.020912 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 64216.8us
I20260709 12:12:52.963981 15485 raft_consensus.cc:493] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:53.018803 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.935935 15557 raft_consensus.cc:515] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:53.023722 13986 leader_election.cc:304] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.006261 15530 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:53.029894 13913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 131048us
I20260709 12:12:53.008373 15489 raft_consensus.cc:2749] T 94d5a4389d98450b8318ec8f281182ad P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:53.004451 15214 raft_consensus.cc:3060] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:53.033102 13986 leader_election.cc:304] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:53.020614 15604 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 2. Current term is 3.
I20260709 12:12:53.024907 15485 raft_consensus.cc:3060] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:12:53.050449 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.050812 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 97818.8us
I20260709 12:12:53.025633 15516 raft_consensus.cc:2749] T 040f8a0271784f748abc1ed10f9440a1 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
W20260709 12:12:53.055713 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.060544 15403 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:53.035014 15518 raft_consensus.cc:2749] T 0f350f91cb624fb09ebaf23027f592f5 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:53.071625 15517 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:53.073350 15590 log.cc:927] Time spent T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:53.075150 15557 leader_election.cc:290] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.077230 15581 raft_consensus.cc:3055] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:53.078464 15514 raft_consensus.cc:3055] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:53.079063 15434 raft_consensus.cc:3055] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:12:53.080070 15589 log.cc:927] Time spent T 92cd840410aa4879adecc48dc70d6cb2 P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:53.093150 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.124135 14019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:53.129173 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 76221.5us
I20260709 12:12:53.134446 14097 raft_consensus.cc:2468] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
W20260709 12:12:53.129407 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 96439.6us
I20260709 12:12:53.135885 13837 leader_election.cc:304] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:53.137503 13986 leader_election.cc:400] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:53.137984 13986 leader_election.cc:403] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:12:53.132229 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 83632.9us
I20260709 12:12:53.134533 14019 raft_consensus.cc:2468] T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:53.140347 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.142168 13913 leader_election.cc:304] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe; no voters: 
I20260709 12:12:53.154320 15517 raft_consensus.cc:3060] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:53.157122 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:53.165235 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.133210 15561 log.cc:927] Time spent T 0f350f91cb624fb09ebaf23027f592f5 P 6f3e7e9dcfab49fb99d979c338c67ffb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:53.125387 15581 raft_consensus.cc:740] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
W20260709 12:12:53.139966 15534 consensus_meta.cc:287] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.003s
W20260709 12:12:53.173684 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 284844us
I20260709 12:12:53.139984 15392 raft_consensus.cc:2804] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:53.128072 15514 raft_consensus.cc:740] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:53.130903 15434 raft_consensus.cc:740] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:53.183235 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b8bed45862453fa77c3294a4231b24" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:53.184551 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:53.187207 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.187508 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.158499 15544 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.177017 15535 consensus_meta.cc:287] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.003s
I20260709 12:12:53.189543 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.170365 15490 raft_consensus.cc:2804] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:53.194710 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.190629 15533 consensus_queue.cc:1059] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:12:53.199358 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:53.202577 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9419dc9ec23f4da88393bda7056bff9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:53.206187 14089 raft_consensus.cc:1275] T 3ccd00234165409b8ef52c632801c99c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:53.194831 15592 log.cc:927] Time spent T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:12:53.216454 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.216706 14021 raft_consensus.cc:2468] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:53.217970 14094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.218959 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.224049 14094 raft_consensus.cc:2368] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:53.224201 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7cfd49af7649a6b615a1ca594b2c67" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.224550 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb862f5cd014dafaac3c52063ea45d9" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.219218 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e25fe9f77426fa4a403ff3ebbdf29" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.180341 15392 raft_consensus.cc:493] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting leader election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:53.227031 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.227624 14097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.225962 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.229745 14097 raft_consensus.cc:2393] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe in current term 4: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:53.227984 15392 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.230082 14096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e6426591bd40bcac05d7dc8b5bef57" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.196487 15490 raft_consensus.cc:493] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.241534 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd1ba95f0984c21adf769032d2facd7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.243705 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4bab4e93e2433da0f22757b2011ccf" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.249601 15490 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:53.249761 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e383edb46924bb08f4ffe03e4a9ecf3" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.220224 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
W20260709 12:12:53.244433 15588 log.cc:927] Time spent T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 12:12:53.196978 15544 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.264848 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.284188 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.285274 14021 raft_consensus.cc:3060] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:53.293087 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8d848744b04edc98cec359ea13cace" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:53.301733 15602 log.cc:927] Time spent T 2e383edb46924bb08f4ffe03e4a9ecf3 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:12:53.303632 15519 raft_consensus.cc:515] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.304738 15574 raft_consensus.cc:2749] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:53.329164 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:53.329809 14089 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:53.332602 15608 log.cc:927] Time spent T 1e4bab4e93e2433da0f22757b2011ccf P f808da6a0c774bf4aa2e0ad137d6a74e: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:12:53.335273 15544 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:53.308040 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dca4cb3ff414e5dbd73d3036d22ef61" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.337968 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.341209 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.342195 14092 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:53.343667 13837 leader_election.cc:304] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:53.344660 15544 raft_consensus.cc:2804] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:53.344960 14016 raft_consensus.cc:2376] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2. Re-sending same reply.
I20260709 12:12:53.346875 14016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91647541d8445a9bb817662fd2837e3" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.230315 15581 consensus_queue.cc:260] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:53.318730 14021 raft_consensus.cc:2468] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 7.
I20260709 12:12:53.320685 13865 raft_consensus.cc:1240] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Rejecting Update request from peer f808da6a0c774bf4aa2e0ad137d6a74e for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:53.320940 13872 raft_consensus.cc:3055] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:12:53.321388 15523 consensus_queue.cc:1048] T 3ccd00234165409b8ef52c632801c99c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:53.270929 15514 consensus_queue.cc:260] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:53.349850 15514 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.350765 13872 raft_consensus.cc:740] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:53.351239 15214 raft_consensus.cc:515] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:53.351708 13872 consensus_queue.cc:260] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:53.325585 13987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.353071 15508 consensus_queue.cc:1175] T 3beb75018f45482792118f2733509fd0 P f808da6a0c774bf4aa2e0ad137d6a74e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4c9b84be2fea4f7094b49292ec17dabe" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:12:53.345153 15544 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.354080 15544 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:53.355803 15517 raft_consensus.cc:2749] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:53.356954 14061 leader_election.cc:304] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:53.357873 15261 raft_consensus.cc:2749] T 1a7cfd49af7649a6b615a1ca594b2c67 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:12:53.309016 15603 log.cc:927] Time spent T da5bbcf898854fcc96d091127ac642f7 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:12:53.360334 15519 leader_election.cc:290] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:53.363153 15544 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.384251 14022 raft_consensus.cc:2468] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5.
I20260709 12:12:53.384824 15565 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.385632 15565 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.372498 14089 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:53.359555 14061 leader_election.cc:304] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:53.387357 15623 raft_consensus.cc:2749] T 9e77febf4abc4228b32c2e9fba94574e P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:12:53.391358 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 167497us
I20260709 12:12:53.392072 14061 leader_election.cc:304] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:53.400619 13837 leader_election.cc:304] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:53.383558 15517 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:53.406517 15519 raft_consensus.cc:2804] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:53.407112 15519 raft_consensus.cc:697] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
W20260709 12:12:53.407402 14090 consensus_meta.cc:287] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:12:53.407858 14090 raft_consensus.cc:2468] T 17d5506586a24f8084e47741b1525e94 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 3.
W20260709 12:12:53.408454 14090 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37108 (request call id 344) took 1650 ms (client timeout 1958 ms). Trace:
W20260709 12:12:53.408862 14090 rpcz_store.cc:269] 0709 12:12:51.757908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.760796 (+  2888us) service_pool.cc:224] Handling call
0709 12:12:52.679646 (+918850us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b5800004898. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce34ededb1 00007fce3501eb71 00007fce3501ea22 00007fce3df378d9 00007fce3d091ee0 00007fce3d15b0ab 00007fce3d15b131 00007fce3d1090a0 00007fce3d108984 00007fce366836d4 00007fce36683662
0709 12:12:53.408388 (+728742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14658944}
I20260709 12:12:53.414819 14063 leader_election.cc:304] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:53.407975 15519 consensus_queue.cc:237] T e6db04338ea848b182d7538561667571 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.398911 15623 raft_consensus.cc:2749] T bbd1ba95f0984c21adf769032d2facd7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:53.417969 13838 leader_election.cc:304] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.418957 15296 raft_consensus.cc:2749] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:53.421806 13838 leader_election.cc:304] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:53.425568 13988 leader_election.cc:304] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:53.427392 14017 raft_consensus.cc:2468] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:53.416559 15522 raft_consensus.cc:2804] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:53.482282 15544 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:53.482568 15522 raft_consensus.cc:697] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 LEADER]: Becoming Leader. State: Replica: f808da6a0c774bf4aa2e0ad137d6a74e, State: Running, Role: LEADER
I20260709 12:12:53.447733 15533 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:53.472159 15565 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.421015 15530 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:53.426615 15254 raft_consensus.cc:2804] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:53.438313 15595 raft_consensus.cc:2749] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:53.476768 15623 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:53.423971 15517 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.417953 15485 raft_consensus.cc:515] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:53.480858 15214 leader_election.cc:290] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
    @     0x7fce3527adad testing::UnitTest::Run() at ??:0
W20260709 12:12:53.446237 13819 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:53.557796 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.506304 15533 raft_consensus.cc:515] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.539938 15565 raft_consensus.cc:493] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
    @           0x38839c RUN_ALL_TESTS() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
I20260709 12:12:53.572019 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:53.572968 13868 raft_consensus.cc:3060] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:53.587834 13874 raft_consensus.cc:1275] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Refusing update from remote peer 4c9b84be2fea4f7094b49292ec17dabe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
    @           0x386f9d main at /apache/dev/git/kudu/src/kudu/util/test_main.cc:?
I20260709 12:12:53.540326 15530 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 3 election: Requested vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:53.540529 15623 raft_consensus.cc:515] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.542593 15544 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:53.543231 14088 raft_consensus.cc:1240] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 1. Current term is 3. Ops: []
I20260709 12:12:53.544540 15522 consensus_queue.cc:237] T b91647541d8445a9bb817662fd2837e3 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.546983 15485 leader_election.cc:290] T c212f97a40314d1dbb07943ef4722563 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 election: Requested vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.547655 15254 raft_consensus.cc:697] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:53.566694 14016 raft_consensus.cc:2468] T b91647541d8445a9bb817662fd2837e3 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:53.476305 15490 raft_consensus.cc:515] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.659250 15254 consensus_queue.cc:237] T d9646480a7ea4c26ad61c0bd8dc866a0 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:53.661190 13867 raft_consensus.cc:2368] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:53.662091 15490 leader_election.cc:290] T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 election: Requested vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:53.653591 15544 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
W20260709 12:12:53.671893 13989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.590004 15565 raft_consensus.cc:515] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
W20260709 12:12:53.709589 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 310090us
I20260709 12:12:53.712267 14015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51076 (request call id 348) took 1107 ms. Trace:
W20260709 12:12:53.717227 14061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.712815 14015 rpcz_store.cc:276] 0709 12:12:52.604415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.604540 (+   125us) service_pool.cc:224] Handling call
0709 12:12:52.604794 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.740043 (+135249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.711966 (+971923us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400a1a254. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:53.712193 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307485056}
I20260709 12:12:53.724521 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c436335260f04d91845c11162c70c7f1" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.726056 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9646480a7ea4c26ad61c0bd8dc866a0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.726662 14015 raft_consensus.cc:2376] T d9646480a7ea4c26ad61c0bd8dc866a0 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2. Re-sending same reply.
I20260709 12:12:53.732466 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb75018f45482792118f2733509fd0" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.742964 15526 raft_consensus.cc:3055] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:53.743542 15526 raft_consensus.cc:740] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c9b84be2fea4f7094b49292ec17dabe, State: Running, Role: LEADER
I20260709 12:12:53.744429 15526 consensus_queue.cc:260] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:53.751386 14092 raft_consensus.cc:1275] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Refusing update from remote peer 33ef851003ef478cac1897bfee45a8f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:53.748667 15541 raft_consensus.cc:3060] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:53.794018 15517 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:53.732810 15645 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.793394 15635 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:53.805123 13948 raft_consensus.cc:1275] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:53.802965 13868 raft_consensus.cc:2468] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:53.809422 15635 raft_consensus.cc:515] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.812461 15635 leader_election.cc:290] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.815676 13838 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.815845 13948 raft_consensus.cc:1275] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:12:53.818751 13838 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.821182 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:53.826642 14091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37108 (request call id 357) took 1290 ms. Trace:
I20260709 12:12:53.827297 14091 rpcz_store.cc:276] 0709 12:12:52.536428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.537067 (+   639us) service_pool.cc:224] Handling call
0709 12:12:52.537553 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:52.553880 (+ 16327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.553925 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:52.822443 (+268518us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b2c00200538. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:12:53.395191 (+572748us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b2c00200538. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce36a3ca11 00007fce36a4c372 00007fce3817ea01 00007fce3814343a 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2
0709 12:12:53.407899 (+ 12708us) log.cc:844] Serialized 52 byte log entry
0709 12:12:53.651911 (+244012us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:12:53.775838 (+123927us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.826127 (+ 50289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.826246 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.826323 (+    77us) raft_consensus.cc:1685] finished
0709 12:12:53.826344 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.826550 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49842,"raft.queue_time_us":153,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":61189760,"thread_start_us":348720,"threads_started":2,"wal-append.queue_time_us":279742}
I20260709 12:12:53.844420 13986 leader_election.cc:304] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.815595 13826 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Sending DeleteTablet for 3 replicas of tablet 16e6426591bd40bcac05d7dc8b5bef57
I20260709 12:12:53.847675 13986 leader_election.cc:304] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.851234 13986 leader_election.cc:304] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.857093 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af4ae64d1de450c8bd0508dadc3e2b1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.858076 13943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:53.859359 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cd840410aa4879adecc48dc70d6cb2" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.860702 13948 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:12:53.836130 15647 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.846622 15392 consensus_meta.cc:287] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe: Time spent flushing consensus metadata: real 0.585s	user 0.014s	sys 0.007s
I20260709 12:12:53.862660 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:53.863835 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.846132 15490 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:53.846969 15519 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:53.866750 14021 raft_consensus.cc:2468] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:53.872207 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744458046f6a4a1ab713dbb3659c7803" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.876979 13947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:53.861892 15544 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:53.878575 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:53.879362 14021 raft_consensus.cc:2468] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 1.
I20260709 12:12:53.880009 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:53.814919 15645 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.885128 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:53.887254 13948 raft_consensus.cc:2468] T 630f59ad7c7240e99c3f7dba05fa3eb1 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 3.
I20260709 12:12:53.864871 15623 leader_election.cc:290] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.893972 15643 consensus_queue.cc:1048] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 12:12:53.894506 15574 raft_consensus.cc:3060] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.892344 15656 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.902281 15656 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.904616 15398 raft_consensus.cc:2749] T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:53.897207 15651 raft_consensus.cc:2749] T 2eb862f5cd014dafaac3c52063ea45d9 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:53.873275 15533 leader_election.cc:290] T f415f012981848b3aedcb29bc5e00e4b P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
W20260709 12:12:53.910717 13986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 59576.8us
I20260709 12:12:53.913703 15645 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:53.873582 15392 raft_consensus.cc:515] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:53.916988 14014 raft_consensus.cc:3060] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:53.921692 15656 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:53.922207 15392 leader_election.cc:290] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 election: Requested vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:53.870281 15647 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.930373 15613 raft_consensus.cc:493] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:53.931087 15613 raft_consensus.cc:515] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.932509 14088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 373) took 1091 ms. Trace:
I20260709 12:12:53.931560 15647 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:53.932960 14088 rpcz_store.cc:276] 0709 12:12:52.840973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.870017 (+ 29044us) service_pool.cc:224] Handling call
0709 12:12:52.925491 (+ 55474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.652721 (+727230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.932252 (+279531us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540057ec54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:53.932443 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400664448}
I20260709 12:12:53.937026 13872 raft_consensus.cc:3060] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:53.939188 15362 raft_consensus.cc:493] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.939795 15214 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.940210 15385 raft_consensus.cc:2804] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:12:53.941259 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 212420us
I20260709 12:12:53.941659 13986 leader_election.cc:304] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.940514 15214 raft_consensus.cc:515] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.942611 15582 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.944839 15595 raft_consensus.cc:493] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.943699 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ef392070824cb5a20c5ecebb1b0ce7" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:53.953598 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 70680.4us
I20260709 12:12:53.954687 13986 leader_election.cc:400] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 3. Current term is 4.
I20260709 12:12:53.946657 15582 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:53.956044 13986 leader_election.cc:304] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.958420 13986 leader_election.cc:304] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:53.946836 15595 raft_consensus.cc:515] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:53.965119 14016 raft_consensus.cc:1275] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:12:53.958408 15280 raft_consensus.cc:2749] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:53.953162 15362 raft_consensus.cc:515] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.967891 14015 raft_consensus.cc:1275] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:53.960079 15647 raft_consensus.cc:2749] T 1e4bab4e93e2433da0f22757b2011ccf P 4c9b84be2fea4f7094b49292ec17dabe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:53.970072 15214 leader_election.cc:290] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:53.974920 15613 leader_election.cc:290] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:53.977641 15659 raft_consensus.cc:2749] T c436335260f04d91845c11162c70c7f1 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:12:53.978505 15626 log.cc:927] Time spent T 37b8bed45862453fa77c3294a4231b24 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.670s	user 0.011s	sys 0.006s
I20260709 12:12:53.978881 14093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37098 (request call id 374) took 1137 ms. Trace:
I20260709 12:12:53.986106 15582 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:53.992846 15574 raft_consensus.cc:2749] T 3beb75018f45482792118f2733509fd0 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:54.040174 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 198700us
I20260709 12:12:54.054054 13826 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Sending DeleteTablet for 3 replicas of tablet 67a590283c194e508b8eaab0070f9c01
I20260709 12:12:54.059119 13856 tablet_service.cc:1558] Processing DeleteTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 with delete_type TABLET_DATA_DELETED (Replaced by 4ef75795ed42436a942bf71018b04daa at 2026-07-09 12:12:50 UTC) from {username='slave'} at 127.0.0.1:52306
W20260709 12:12:54.061761 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 107071us
I20260709 12:12:54.069305 13860 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a590283c194e508b8eaab0070f9c01 with delete_type TABLET_DATA_DELETED (Replaced by d5d94233b84f4d3897d0be1e4dd5a852 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:52306
W20260709 12:12:54.071617 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.072325 13941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 355) took 1421 ms. Trace:
I20260709 12:12:54.073064 13941 rpcz_store.cc:276] 0709 12:12:52.650524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.850894 (+200370us) service_pool.cc:224] Handling call
0709 12:12:52.932077 (+ 81183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.945418 (+ 13341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.071635 (+1126217us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b5400279cd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:54.071999 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93205376}
I20260709 12:12:54.092777 13988 leader_election.cc:400] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927) with higher term. Message: Invalid argument: T 608ec46055a04e7d9feb7162d37e3fec P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9b84be2fea4f7094b49292ec17dabe for earlier term 4. Current term is 5.
I20260709 12:12:54.093359 13988 leader_election.cc:403] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:54.095372 15432 raft_consensus.cc:493] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.097074 15432 raft_consensus.cc:515] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:53.979341 15362 leader_election.cc:290] T b770dc00e1f8499d88d9fe1d5650d32c P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:54.101604 15661 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.979331 14093 rpcz_store.cc:276] 0709 12:12:52.841381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.841519 (+   138us) service_pool.cc:224] Handling call
0709 12:12:52.841955 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.842274 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:12:52.887820 (+ 45546us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.888190 (+   370us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.905760 (+1017570us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b18001a4640. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce35056522 00007fce350587c1 00007fce35058779 00007fce35058709 00007fce350586d1 00007fce350579cd 0000000000388634 0000000000388479 00007fce3503983a
0709 12:12:53.978248 (+ 72488us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b18001a4640. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce3df1eab1 00007fce3df2b281 00007fce34fd0c0a 00007fce3e710219 00007fce37cf9d70 00007fce37ced293 00007fce37ce2cea 00007fce37ce323a 00007fce3814da2a 00007fce3815d0bf 00007fce3815d038
0709 12:12:53.978509 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:53.978562 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:12:53.978610 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.978678 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.978812 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"prepare.queue_time_us":1066647,"prepare.run_cpu_time_us":201,"prepare.run_wall_time_us":204,"raft.queue_time_us":30361,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12112,"spinlock_wait_cycles":65275520}
I20260709 12:12:54.102018 14079 tablet_service.cc:1558] Processing DeleteTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 with delete_type TABLET_DATA_DELETED (Replaced by 4ef75795ed42436a942bf71018b04daa at 2026-07-09 12:12:50 UTC) from {username='slave'} at 127.0.0.1:37082
I20260709 12:12:54.091610 13826 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Sending DeleteTablet for 3 replicas of tablet 040f8a0271784f748abc1ed10f9440a1
I20260709 12:12:54.099040 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:54.111951 14007 tablet_service.cc:1558] Processing DeleteTablet for tablet 16e6426591bd40bcac05d7dc8b5bef57 with delete_type TABLET_DATA_DELETED (Replaced by 4ef75795ed42436a942bf71018b04daa at 2026-07-09 12:12:50 UTC) from {username='slave'} at 127.0.0.1:51064
I20260709 12:12:54.112998 15577 raft_consensus.cc:493] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.113621 14013 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a590283c194e508b8eaab0070f9c01 with delete_type TABLET_DATA_DELETED (Replaced by d5d94233b84f4d3897d0be1e4dd5a852 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:51064
I20260709 12:12:54.114120 13942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48298 (request call id 487) took 1296 ms. Trace:
I20260709 12:12:54.114226 15577 raft_consensus.cc:515] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.117097 15656 raft_consensus.cc:493] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.118263 15656 raft_consensus.cc:515] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.119107 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:54.121328 15519 raft_consensus.cc:493] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:54.122392 15519 raft_consensus.cc:515] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.124385 15635 raft_consensus.cc:493] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.125002 15544 raft_consensus.cc:493] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.125934 15544 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.126888 15254 raft_consensus.cc:493] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.127302 14018 raft_consensus.cc:1275] T 7c8d848744b04edc98cec359ea13cace P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:54.127749 15254 raft_consensus.cc:515] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.129004 13912 leader_election.cc:304] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:54.130879 14757 raft_consensus.cc:493] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:54.131968 14757 raft_consensus.cc:515] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:54.116092 13840 leader_election.cc:304] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:54.132913 15362 raft_consensus.cc:2804] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:54.133667 15362 raft_consensus.cc:697] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [term 3 LEADER]: Becoming Leader. State: Replica: 33ef851003ef478cac1897bfee45a8f2, State: Running, Role: LEADER
I20260709 12:12:54.114660 13942 rpcz_store.cc:276] 0709 12:12:52.817146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.927986 (+110840us) service_pool.cc:224] Handling call
0709 12:12:52.928358 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.044420 (+116062us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:12:53.411696 (+367276us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.939717 (+528021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:53.939779 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:12:53.939838 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.113499 (+173661us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400153e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:54.113571 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.113839 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718578,"prepare.queue_time_us":367266,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":357250,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":266236672,"thread_start_us":175908,"threads_started":1,"wal-append.queue_time_us":272221}
I20260709 12:12:54.135108 14757 leader_election.cc:290] T 1213da0dbe3d443f90796ab3861aeaee P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.135425 15523 raft_consensus.cc:2749] T 2e383edb46924bb08f4ffe03e4a9ecf3 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:54.139540 14095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37120 (request call id 322) took 2164 ms. Trace:
I20260709 12:12:54.140429 15274 consensus_queue.cc:1048] T 744458046f6a4a1ab713dbb3659c7803 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.141167 15214 raft_consensus.cc:493] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.140043 14095 rpcz_store.cc:276] 0709 12:12:51.975254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.977087 (+  1833us) service_pool.cc:224] Handling call
0709 12:12:51.977445 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.966979 (+989534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.138934 (+1171955us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400441e54. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:54.139305 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239647104}
I20260709 12:12:54.142266 15214 raft_consensus.cc:515] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:54.144210 13941 raft_consensus.cc:1240] T 67a590283c194e508b8eaab0070f9c01 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3e7e9dcfab49fb99d979c338c67ffb for earlier term 3. Current term is 4. Ops: []
I20260709 12:12:54.146613 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.148036 13948 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 2.
I20260709 12:12:54.150815 15661 raft_consensus.cc:515] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.113173 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5563bcf555d04206a7dd0106f28be38c" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:54.170840 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f415f012981848b3aedcb29bc5e00e4b" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.155448 15544 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.154322 13840 leader_election.cc:304] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 4c9b84be2fea4f7094b49292ec17dabe
I20260709 12:12:54.116283 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccd00234165409b8ef52c632801c99c" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:54.125407 15635 raft_consensus.cc:515] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.182423 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6db04338ea848b182d7538561667571" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
W20260709 12:12:54.183459 13988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 104220us
I20260709 12:12:54.183940 13940 raft_consensus.cc:3060] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:54.185649 13826 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 801713bd61dd4918a2db2d1c1a92af72: Sending DeleteTablet for 3 replicas of tablet 37b8bed45862453fa77c3294a4231b24
I20260709 12:12:54.185992 15460 raft_consensus.cc:493] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.186996 15460 raft_consensus.cc:515] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.189747 15577 leader_election.cc:290] T fe541614d477406f98fbe7ccaecdba91 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.190860 15432 leader_election.cc:290] T 8ed16159ff574584ad17638f2083106f P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.191191 14023 raft_consensus.cc:2376] T 5563bcf555d04206a7dd0106f28be38c P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 5. Re-sending same reply.
I20260709 12:12:54.193347 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb"
I20260709 12:12:54.193706 15519 leader_election.cc:290] T 17d5506586a24f8084e47741b1525e94 P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.135277 15362 consensus_queue.cc:237] T 17d5506586a24f8084e47741b1525e94 P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.195737 15460 leader_election.cc:290] T 02548a2cbee943cba6dc06896b099e46 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.204216 14085 tablet_service.cc:1558] Processing DeleteTablet for tablet 040f8a0271784f748abc1ed10f9440a1 with delete_type TABLET_DATA_DELETED (Replaced by deed7a8fed7840c09b25398b8e4928ce at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:37082
I20260709 12:12:54.205026 15214 leader_election.cc:290] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:54.206408 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
W20260709 12:12:54.209049 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 98488.8us
I20260709 12:12:54.209991 13947 raft_consensus.cc:1240] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Rejecting Update request from peer 4c9b84be2fea4f7094b49292ec17dabe for earlier term 5. Current term is 6. Ops: []
I20260709 12:12:54.211014 13989 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe; no voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e
I20260709 12:12:54.212491 15296 raft_consensus.cc:493] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:54.213486 15296 raft_consensus.cc:515] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } }
I20260709 12:12:54.218326 13872 raft_consensus.cc:1275] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 7 FOLLOWER]: Refusing update from remote peer f808da6a0c774bf4aa2e0ad137d6a74e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:12:54.218550 15254 leader_election.cc:290] T 123e199d60f94411b09c3e9ba4ca38fe P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.218952 13872 pending_rounds.cc:85] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Aborting all ops after (but not including) 3
I20260709 12:12:54.219411 13872 pending_rounds.cc:107] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:12:54.219918 13872 raft_consensus.cc:2889] T 0f30b80997e84e0aac7842adc7ae98b1 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:54.219460 14061 leader_election.cc:304] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 4c9b84be2fea4f7094b49292ec17dabe, 6f3e7e9dcfab49fb99d979c338c67ffb
I20260709 12:12:54.222494 15661 leader_election.cc:290] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.222855 15656 leader_election.cc:290] T da5bbcf898854fcc96d091127ac642f7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.223376 15460 raft_consensus.cc:2749] T 9af4ae64d1de450c8bd0508dadc3e2b1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:12:54.227965 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2"
I20260709 12:12:54.228940 13942 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:12:54.232878 15574 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:12:54.235322 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd49a6d68614f9a9a7d20bf06695f9e" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.237169 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.238313 13945 raft_consensus.cc:2393] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 6: Already voted for candidate 33ef851003ef478cac1897bfee45a8f2 in this term.
I20260709 12:12:54.223676 15583 consensus_queue.cc:1048] T 5bd49a6d68614f9a9a7d20bf06695f9e P 33ef851003ef478cac1897bfee45a8f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:12:54.242070 15526 raft_consensus.cc:3060] T 2f077c5104b446b1a849137d25615c4c P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.245262 15565 leader_election.cc:290] T 2f077c5104b446b1a849137d25615c4c P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:54.247218 15518 raft_consensus.cc:2749] T 82ef392070824cb5a20c5ecebb1b0ce7 P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:54.265861 15586 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
W20260709 12:12:54.285458 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 131442us
I20260709 12:12:54.284271 13860 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b8bed45862453fa77c3294a4231b24 with delete_type TABLET_DATA_DELETED (Replaced by 90fa1e03e5ef427682ee2c18afb3a9c6 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:52306
W20260709 12:12:54.291822 13989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 81046.2us
I20260709 12:12:54.298508 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.300217 13872 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 5.
I20260709 12:12:54.300848 15667 tablet_replica.cc:333] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb: stopping tablet replica
I20260709 12:12:54.301571 15432 raft_consensus.cc:2804] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:12:54.314232 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 209661us
I20260709 12:12:54.304733 15296 leader_election.cc:290] T 9e77febf4abc4228b32c2e9fba94574e P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.313570 15432 raft_consensus.cc:493] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.311740 15635 leader_election.cc:290] T 040f8a0271784f748abc1ed10f9440a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.328436 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.335791 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.336661 13865 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 6.
I20260709 12:12:54.336848 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.338397 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.339430 13866 raft_consensus.cc:2368] T d0ea7290d3204b53837a7521af690e79 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
W20260709 12:12:54.341485 13988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.348991 13872 raft_consensus.cc:2368] T 93543c2dbfd24b67ace7fa568ca3371f P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 3. Current term is 4.
I20260709 12:12:54.352802 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630f59ad7c7240e99c3f7dba05fa3eb1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:54.354180 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef75795ed42436a942bf71018b04daa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:54.355305 15565 raft_consensus.cc:493] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.356247 15565 raft_consensus.cc:515] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.357110 15649 consensus_queue.cc:1048] T b770dc00e1f8499d88d9fe1d5650d32c P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:54.365244 15430 consensus_queue.cc:1059] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:12:54.378221 13942 raft_consensus.cc:2468] T 93543c2dbfd24b67ace7fa568ca3371f P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 4.
I20260709 12:12:54.371038 13840 leader_election.cc:304] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:54.329161 15432 raft_consensus.cc:3060] T 0dca4cb3ff414e5dbd73d3036d22ef61 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:54.382771 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "4c9b84be2fea4f7094b49292ec17dabe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.386559 13941 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9b84be2fea4f7094b49292ec17dabe in term 7.
I20260709 12:12:54.360615 15635 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:12:54.395064 15434 consensus_queue.cc:260] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.360837 15583 raft_consensus.cc:493] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.400964 15583 raft_consensus.cc:515] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.371145 13940 raft_consensus.cc:2468] T e6db04338ea848b182d7538561667571 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:54.403627 15583 leader_election.cc:290] T 2c47dd7750a84d98a2f83efe24a70125 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.404733 15214 raft_consensus.cc:493] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:54.405714 15214 raft_consensus.cc:515] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.407045 13944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48292 (request call id 360) took 1204 ms. Trace:
I20260709 12:12:54.359043 15565 leader_election.cc:290] T 1e33c688f7fe4e14be9fa7c1247d22ba P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.366927 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef75795ed42436a942bf71018b04daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.407755 13944 rpcz_store.cc:276] 0709 12:12:53.202487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.202757 (+   270us) service_pool.cc:224] Handling call
0709 12:12:53.203021 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.894476 (+691455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:53.894514 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:53.894558 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:12:53.894592 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.406382 (+511790us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54002d82d4. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce38143e01 00007fce3814283e 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6
0709 12:12:54.406504 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.406810 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589609216}
W20260709 12:12:54.417742 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 46950us
W20260709 12:12:54.419750 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 103471us
I20260709 12:12:54.359795 15649 consensus_queue.cc:1048] T 0f30b80997e84e0aac7842adc7ae98b1 P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:12:54.433053 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:54.434712 13860 tablet_service.cc:1511] Processing CreateTablet for tablet d5d94233b84f4d3897d0be1e4dd5a852 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:54.435480 14063 leader_election.cc:304] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 
I20260709 12:12:54.444941 15503 raft_consensus.cc:493] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.445211 15671 tablet_replica.cc:333] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: stopping tablet replica
I20260709 12:12:54.429243 15668 tablet_replica.cc:333] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe: stopping tablet replica
I20260709 12:12:54.450850 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b770dc00e1f8499d88d9fe1d5650d32c" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:54.451175 15205 raft_consensus.cc:493] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.444226 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:54.452060 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.430663 15583 raft_consensus.cc:493] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.452761 13866 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:54.426769 14014 raft_consensus.cc:2468] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 3.
I20260709 12:12:54.451802 15572 raft_consensus.cc:493] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.458166 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea7290d3204b53837a7521af690e79" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:54.466324 14093 raft_consensus.cc:2393] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 in current term 3: Already voted for candidate f808da6a0c774bf4aa2e0ad137d6a74e in this term.
I20260709 12:12:54.472429 13931 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a590283c194e508b8eaab0070f9c01 with delete_type TABLET_DATA_DELETED (Replaced by d5d94233b84f4d3897d0be1e4dd5a852 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:48288
I20260709 12:12:54.472748 15542 raft_consensus.cc:2804] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:54.473657 15542 raft_consensus.cc:697] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 LEADER]: Becoming Leader. State: Replica: 6f3e7e9dcfab49fb99d979c338c67ffb, State: Running, Role: LEADER
I20260709 12:12:54.475100 15542 consensus_queue.cc:237] T 5563bcf555d04206a7dd0106f28be38c P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.475926 15595 leader_election.cc:290] T 94d5a4389d98450b8318ec8f281182ad P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.475942 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.453588 14090 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 6.
I20260709 12:12:54.482092 14095 raft_consensus.cc:2368] T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:54.482425 14061 leader_election.cc:304] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:54.488602 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d94233b84f4d3897d0be1e4dd5a852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.461931 15503 raft_consensus.cc:515] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.499322 13935 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b8bed45862453fa77c3294a4231b24 with delete_type TABLET_DATA_DELETED (Replaced by 90fa1e03e5ef427682ee2c18afb3a9c6 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:48288
I20260709 12:12:54.499526 14020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:54.493393 13936 tablet_service.cc:1558] Processing DeleteTablet for tablet 040f8a0271784f748abc1ed10f9440a1 with delete_type TABLET_DATA_DELETED (Replaced by deed7a8fed7840c09b25398b8e4928ce at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:48288
I20260709 12:12:54.501668 15665 raft_consensus.cc:493] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f808da6a0c774bf4aa2e0ad137d6a74e)
I20260709 12:12:54.502239 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.503283 13866 raft_consensus.cc:2468] T da5bbcf898854fcc96d091127ac642f7 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 5.
I20260709 12:12:54.457739 15205 raft_consensus.cc:515] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.506457 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e77febf4abc4228b32c2e9fba94574e" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:54.506946 15205 leader_election.cc:290] T 9419dc9ec23f4da88393bda7056bff9e P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.508070 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1213da0dbe3d443f90796ab3861aeaee" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:54.510399 15671 raft_consensus.cc:2243] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.511024 15503 leader_election.cc:290] T d00fe8bc507b4059ad259285c1183c92 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.482788 15565 raft_consensus.cc:2804] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:54.523731 14020 raft_consensus.cc:2393] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3e7e9dcfab49fb99d979c338c67ffb in current term 7: Already voted for candidate 4c9b84be2fea4f7094b49292ec17dabe in this term.
I20260709 12:12:54.521293 13868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.484591 15583 raft_consensus.cc:515] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.532711 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef75795ed42436a942bf71018b04daa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:54.534850 15671 raft_consensus.cc:2272] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.535437 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef75795ed42436a942bf71018b04daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.536482 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c212f97a40314d1dbb07943ef4722563" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
W20260709 12:12:54.537696 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 48692.1us
I20260709 12:12:54.538681 15635 raft_consensus.cc:493] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.528138 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f077c5104b446b1a849137d25615c4c" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" is_pre_election: true
I20260709 12:12:54.518215 13914 leader_election.cc:304] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33ef851003ef478cac1897bfee45a8f2, 6f3e7e9dcfab49fb99d979c338c67ffb; no voters: 
I20260709 12:12:54.541029 15460 raft_consensus.cc:493] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.539769 15635 raft_consensus.cc:515] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.519981 15565 raft_consensus.cc:493] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:54.502511 15665 raft_consensus.cc:515] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
W20260709 12:12:54.555065 13914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.129:45927, user_credentials={real_user=slave}} blocked reactor thread for 126489us
I20260709 12:12:54.504482 15572 raft_consensus.cc:515] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.566960 13942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.544369 15649 raft_consensus.cc:2804] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:54.554462 15565 raft_consensus.cc:3060] T 630f59ad7c7240e99c3f7dba05fa3eb1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:54.580175 13865 raft_consensus.cc:2393] T 2f077c5104b446b1a849137d25615c4c P 6f3e7e9dcfab49fb99d979c338c67ffb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f808da6a0c774bf4aa2e0ad137d6a74e in current term 2: Already voted for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in this term.
I20260709 12:12:54.580528 14018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8856b5d7dc044dd8a605f2fd9aebb785" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe" is_pre_election: true
I20260709 12:12:54.585282 14018 raft_consensus.cc:2468] T 8856b5d7dc044dd8a605f2fd9aebb785 P 4c9b84be2fea4f7094b49292ec17dabe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33ef851003ef478cac1897bfee45a8f2 in term 7.
I20260709 12:12:54.571197 15649 raft_consensus.cc:493] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.573393 15205 raft_consensus.cc:2804] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:54.598584 13942 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:54.596333 13945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02548a2cbee943cba6dc06896b099e46" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.587348 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe541614d477406f98fbe7ccaecdba91" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.598596 15583 leader_election.cc:290] T b6ded665a2ee4f6abfcc6b7b67c0b68d P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.588547 15214 leader_election.cc:290] T d9646480a7ea4c26ad61c0bd8dc866a0 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.608893 14095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93543c2dbfd24b67ace7fa568ca3371f" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:54.592304 13935 tablet_service.cc:1511] Processing CreateTablet for tablet d5d94233b84f4d3897d0be1e4dd5a852 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:54.617596 14095 raft_consensus.cc:3060] T 93543c2dbfd24b67ace7fa568ca3371f P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:54.599697 14017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a590283c194e508b8eaab0070f9c01" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4c9b84be2fea4f7094b49292ec17dabe"
I20260709 12:12:54.576479 15460 raft_consensus.cc:515] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.600173 15649 raft_consensus.cc:3060] T f415f012981848b3aedcb29bc5e00e4b P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:54.601553 15205 raft_consensus.cc:493] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.632261 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040f8a0271784f748abc1ed10f9440a1" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.619141 15274 raft_consensus.cc:493] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.640810 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 186346us
I20260709 12:12:54.645697 13944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5bbcf898854fcc96d091127ac642f7" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.652292 14091 raft_consensus.cc:1275] T 7c8d848744b04edc98cec359ea13cace P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:54.652460 14085 tablet_service.cc:1511] Processing CreateTablet for tablet deed7a8fed7840c09b25398b8e4928ce (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:12:54.653095 15674 log.cc:927] Time spent T 040f8a0271784f748abc1ed10f9440a1 P 33ef851003ef478cac1897bfee45a8f2: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:12:54.653680 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d94233b84f4d3897d0be1e4dd5a852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.653888 13856 tablet_service.cc:1511] Processing CreateTablet for tablet deed7a8fed7840c09b25398b8e4928ce (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:54.654770 13946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e33c688f7fe4e14be9fa7c1247d22ba" candidate_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "33ef851003ef478cac1897bfee45a8f2" is_pre_election: true
I20260709 12:12:54.655283 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deed7a8fed7840c09b25398b8e4928ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.655145 15274 raft_consensus.cc:515] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.657823 15274 leader_election.cc:290] T 0f30b80997e84e0aac7842adc7ae98b1 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469), 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927)
I20260709 12:12:54.660159 15403 consensus_queue.cc:1059] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:12:54.661120 14093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608ec46055a04e7d9feb7162d37e3fec" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e"
I20260709 12:12:54.655624 13946 raft_consensus.cc:2468] T 1e33c688f7fe4e14be9fa7c1247d22ba P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f808da6a0c774bf4aa2e0ad137d6a74e in term 6.
I20260709 12:12:54.611925 15414 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.625473 15583 raft_consensus.cc:493] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.631332 15205 raft_consensus.cc:3060] T 8c774f66b196446f9e30b948a1733adc P 33ef851003ef478cac1897bfee45a8f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:12:54.669625 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.130:41801, user_credentials={real_user=slave}} blocked reactor thread for 119480us
I20260709 12:12:54.672513 14007 tablet_service.cc:1558] Processing DeleteTablet for tablet 040f8a0271784f748abc1ed10f9440a1 with delete_type TABLET_DATA_DELETED (Replaced by deed7a8fed7840c09b25398b8e4928ce at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:51064
I20260709 12:12:54.672745 14013 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b8bed45862453fa77c3294a4231b24 with delete_type TABLET_DATA_DELETED (Replaced by 90fa1e03e5ef427682ee2c18afb3a9c6 at 2026-07-09 12:12:51 UTC) from {username='slave'} at 127.0.0.1:51064
I20260709 12:12:54.677233 14061 leader_election.cc:304] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2, 4c9b84be2fea4f7094b49292ec17dabe
W20260709 12:12:54.721848 14061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 44763us
I20260709 12:12:54.722674 14061 leader_election.cc:304] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9b84be2fea4f7094b49292ec17dabe, f808da6a0c774bf4aa2e0ad137d6a74e; no voters: 33ef851003ef478cac1897bfee45a8f2
I20260709 12:12:54.722476 15583 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P 33ef851003ef478cac1897bfee45a8f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.724870 15656 raft_consensus.cc:2749] T 744458046f6a4a1ab713dbb3659c7803 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:54.725160 15530 raft_consensus.cc:2804] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:54.725580 15530 raft_consensus.cc:493] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.725967 15530 raft_consensus.cc:3060] T 82ef392070824cb5a20c5ecebb1b0ce7 P f808da6a0c774bf4aa2e0ad137d6a74e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.726397 14022 raft_consensus.cc:1275] T 3ccd00234165409b8ef52c632801c99c P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Refusing update from remote peer 6f3e7e9dcfab49fb99d979c338c67ffb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:54.732807 14022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51094 (request call id 379) took 1274 ms. Trace:
I20260709 12:12:54.691792 15514 raft_consensus.cc:493] T 1030856707044fac9c27c8699f2e770c P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
W20260709 12:12:54.693153 15675 log.cc:927] Time spent T bf5e25fe9f77426fa4a403ff3ebbdf29 P 4c9b84be2fea4f7094b49292ec17dabe: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:12:54.693819 15460 leader_election.cc:290] T 8256693c278a41308741e7b9c2f033a1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
I20260709 12:12:54.699349 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deed7a8fed7840c09b25398b8e4928ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.710037 15635 leader_election.cc:290] T 5bd49a6d68614f9a9a7d20bf06695f9e P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.713905 15665 leader_election.cc:290] T 1e4bab4e93e2433da0f22757b2011ccf P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.714071 14014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51094 (request call id 374) took 1512 ms. Trace:
I20260709 12:12:54.715327 15385 raft_consensus.cc:493] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3e7e9dcfab49fb99d979c338c67ffb)
I20260709 12:12:54.693186 15581 raft_consensus.cc:3060] T 1213da0dbe3d443f90796ab3861aeaee P 4c9b84be2fea4f7094b49292ec17dabe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.717353 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 90fa1e03e5ef427682ee2c18afb3a9c6 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:54.718365 15434 raft_consensus.cc:3060] T 92cd840410aa4879adecc48dc70d6cb2 P 4c9b84be2fea4f7094b49292ec17dabe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:54.739424 15490 raft_consensus.cc:3055] T 67a590283c194e508b8eaab0070f9c01 P 6f3e7e9dcfab49fb99d979c338c67ffb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:54.690985 14093 raft_consensus.cc:3060] T 608ec46055a04e7d9feb7162d37e3fec P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:54.712363 15572 leader_election.cc:290] T 92cd840410aa4879adecc48dc70d6cb2 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.744319 14022 rpcz_store.cc:276] 0709 12:12:53.458954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.904869 (+445915us) service_pool.cc:224] Handling call
0709 12:12:54.725634 (+820765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.726980 (+  1346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.731953 (+  4973us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400433fd0. stack: 00007fce35024343 00007fce35024240 00007fce349b31d4 00007fce3e6f1304 00007fce3e6f1299 00007fce380ac571 00007fce381428ad 00007fce3d107419 00007fce3667ebd4 00007fce3667eb62 00007fce3667ea91 00007fce3667ea0c 00007fce3667dcc2 00007fce3647e48c 00007fce3647d8c6 00007fce3647d26f
0709 12:12:54.732711 (+   758us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886278528}
I20260709 12:12:54.688465 15671 ts_tablet_manager.cc:1916] T 16e6426591bd40bcac05d7dc8b5bef57 P f808da6a0c774bf4aa2e0ad137d6a74e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260709 12:12:54.754237 13837 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.756554 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c774f66b196446f9e30b948a1733adc" candidate_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
I20260709 12:12:54.732889 15503 raft_consensus.cc:493] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33ef851003ef478cac1897bfee45a8f2)
I20260709 12:12:54.789376 15503 raft_consensus.cc:515] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } } peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } }
I20260709 12:12:54.789659 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef75795ed42436a942bf71018b04daa (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:54.791429 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef75795ed42436a942bf71018b04daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.791790 15503 leader_election.cc:290] T 744458046f6a4a1ab713dbb3659c7803 P 4c9b84be2fea4f7094b49292ec17dabe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469)
I20260709 12:12:54.757436 15414 raft_consensus.cc:515] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" member_type: VOTER last_known_addr { host: "127.7.102.132" port: 34469 } } peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } }
I20260709 12:12:54.794057 15414 leader_election.cc:290] T dbcdeeb9235d42a3b84c08ec08333ad1 P f808da6a0c774bf4aa2e0ad137d6a74e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f3e7e9dcfab49fb99d979c338c67ffb (127.7.102.129:45927), 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801)
    @     0x7fce3192cc87 __libc_start_main at ??:0
I20260709 12:12:54.758329 15635 consensus_queue.cc:1048] T b6ded665a2ee4f6abfcc6b7b67c0b68d P f808da6a0c774bf4aa2e0ad137d6a74e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
    @           0x29f0da _start at ??:?
W20260709 12:12:54.758942 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.131:36455, user_credentials={real_user=slave}} blocked reactor thread for 97102.3us
I20260709 12:12:54.800812 15668 raft_consensus.cc:2243] T 16e6426591bd40bcac05d7dc8b5bef57 P 4c9b84be2fea4f7094b49292ec17dabe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.802901 14090 raft_consensus.cc:2468] T 8c774f66b196446f9e30b948a1733adc P f808da6a0c774bf4aa2e0ad137d6a74e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3e7e9dcfab49fb99d979c338c67ffb in term 6.
I20260709 12:12:54.804435 15544 raft_consensus.cc:493] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4c9b84be2fea4f7094b49292ec17dabe)
I20260709 12:12:54.805163 15544 raft_consensus.cc:515] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
I20260709 12:12:54.808051 15544 leader_election.cc:290] T b2e14a4c4c894f76b64a895bf9dd7faa P 6f3e7e9dcfab49fb99d979c338c67ffb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33ef851003ef478cac1897bfee45a8f2 (127.7.102.130:41801), 4c9b84be2fea4f7094b49292ec17dabe (127.7.102.131:36455)
I20260709 12:12:54.804461 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 90fa1e03e5ef427682ee2c18afb3a9c6 (DEFAULT_TABLE table=test-workload [id=5c203191cf5d4c66a380510923aa713b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:54.810417 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fa1e03e5ef427682ee2c18afb3a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.811705 14092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ded665a2ee4f6abfcc6b7b67c0b68d" candidate_uuid: "33ef851003ef478cac1897bfee45a8f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f808da6a0c774bf4aa2e0ad137d6a74e" is_pre_election: true
W20260709 12:12:54.813746 13912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.102.132:34469, user_credentials={real_user=slave}} blocked reactor thread for 61222.1us
I20260709 12:12:54.814116 14757 consensus_queue.cc:1048] T 7c8d848744b04edc98cec359ea13cace P 6f3e7e9dcfab49fb99d979c338c67ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:54.815071 13912 leader_election.cc:400] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f808da6a0c774bf4aa2e0ad137d6a74e (127.7.102.132:34469) with higher term. Message: Invalid argument: T d0ea7290d3204b53837a7521af690e79 P f808da6a0c774bf4aa2e0ad137d6a74e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33ef851003ef478cac1897bfee45a8f2 for earlier term 2. Current term is 3.
I20260709 12:12:54.815408 13912 leader_election.cc:403] T d0ea7290d3204b53837a7521af690e79 P 33ef851003ef478cac1897bfee45a8f2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:54.815882 15214 raft_consensus.cc:493] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.766309 15385 raft_consensus.cc:3060] T 37b8bed45862453fa77c3294a4231b24 P 33ef851003ef478cac1897bfee45a8f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:54.816520 15214 raft_consensus.cc:515] T 5563bcf555d04206a7dd0106f28be38c P 33ef851003ef478cac1897bfee45a8f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f3e7e9dcfab49fb99d979c338c67ffb" member_type: VOTER last_known_addr { host: "127.7.102.129" port: 45927 } } peers { permanent_uuid: "33ef851003ef478cac1897bfee45a8f2" member_type: VOTER last_known_addr { host: "127.7.102.130" port: 41801 } } peers { permanent_uuid: "4c9b84be2fea4f7094b49292ec17dabe" member_type: VOTER last_known_addr { host: "127.7.102.131" port: 36455 } }
